The system allows to record the traffic for selected protocols in PCAP format. It can save also metadata of HTTP requests, SIP, FTP in log files.
To start recording IP or CIDR traffic (0.0.0.0/0 - to record all traffic)
ajb_save_ip=192.168.0.0/24
This is a "hot" parameter, so this list can be changed with the command: service fastdpi reload
ajb_save_ip
works independently of the subscriber on the input itself and writes all subscriber traffic before services and policing were applied to it.
If you set the configuration parameter
ajb_reserved=1
the memory for the record buffer is allocated in advance (at DPI start) and you can start and stop data recording on the run. You only need to change parameters ajb_save_url, ajb_save_udpi and ajb_save_ip.
To record the data in PCAP format: please use the following parameters in configuration file /etc/dpi/fastdpi.conf:
ajb_save_udpi=1
ajb_save_udpi_proto=OSPFIGP:ospf-lite
ajb_udpi_path=/var/dump/dpi
Here:
PCAP files index mask
ajb_pcap_ind_mask=0 // not created
ajb_pcap_ind_mask=1 // via IPv4
ajb_pcap_ind_mask=2 // via IPv6
ajb_pcap_ind_mask=3 // via both IPv4 and IPv6
This is a hot parameter. It can be changed on the run by command service fastdpi reload.
To record HTTP requests' metadata: please use the following parameters in configuration file /etc/dpi/fastdpi.conf:
ajb_save_url=-1
ajb_save_url_format=ts:prg:login:ipsrc:ipdst:host:path:ref:uagent:cookie:tphost:blockd:method
ajb_url_path=/var/dump/dpi
ajb_url_ftimeout=30
Here:
ajb_save_url=-1 - activate recording of HTTP metadata
ajb_url_path=/var/dump/dpi - is the directory to place files with these records (/var/dump/dpi by default)
ajb_url_ftimeout=30 - recording frequency
ajb_save_url_format=ts:prg:login:ipsrc:ipdst:host:path:ref:uagent:cookie:tphost:blockd:method - is the list of metadata to record:
ts - timestamp
prg - id of currently active services
login - subscriber's login
ipsrc - IP address of the request source (subscriber)
ipdst - IP address of the request recipient (host)
host - host name (field Host/CNAME/SNI/QUIC)
path - path to the requested resource (
URI) on the host
ref - referral source (Referer field)
uagent - browser type (User-Agent field)
cookie - cookies (Cookie field)
ssid - session identifier (for connection with Netflow/IPFIX volume data)
tphost - data type in the Host field (HTTP=1/CNAME=2/SNI=3/QUIC=4)
blockd - bit mask, blocking/redirect sign (0x3 - for HTTP, 0x1 - for the rest)
method - method 1 - GET, 2 - POST, 3 - PUT, 4 - DELETE (the field is available from version 6.0)
To record SSL/TLS requests' metadata: please use the following parameters in configuration file /etc/dpi/fastdpi.conf:
ajb_save_ssl=-1
Here flag mask for saving SSL:
0 - not saved
1 - sni (SSL)
2 - cname
3 - sni (QUIC)
-1 - to record everything
ajb_save_ssl_format=ts:prg:login:ipsrc:ipdst:host:tphost:blockd:method
ajb_ssl_path=/var/dump/dpi
ajb_ssl_ftimeout=30
Here:
ajb_save_ssl=-1 - enable SSL/TLS metadata recording
ajb_ssl_path=/var/dump/dpi - the location of the files with the record (by default /var/dump/dpi)
ajb_ssl_ftimeout=30 - recording frequency
ajb_save_ssl_format=ts:prg:login:ipsrc:ipdst:host:path:ref:uagent:cookie:tphost:blockd:method - list of metadata to write, where
ts - timestamp
prg - id of currently active services
login - subscriber's login
ipsrc - IP address of the request source (subscriber)
ipdst - IP address of the request recipient (host)
host - host name (field Host/CNAME/SNI/QUIC)
path - path to the requested resource (
URI) on the host (where applicable)
ref - referral source (Referer field) (where it is applicable)
uagent - browser type (User-Agent field)(where it is applicable)
cookie - cookies (Cookie field) (where it is applicable)
ssid - session identifier (for connection with Netflow/IPFIX volume data)
tphost - data type in the Host field (HTTP=1/CNAME=2/SNI=3/QUIC=4)
blockd - bit mask, blocking/redirect sign (0x3 - for HTTP, 0x1 - for the rest)
method - method 1 - GET, 2 - POST, 3 - PUT, 4 - DELETE (the field is available from version 6.0) (where it is applicable)
</code>
To record SIP requests' metadata: please use the following parameters in configuration file /etc/dpi/fastdpi.conf:
ajb_save_sip=1
ajb_sip_ftimeout=15
ajb_sip_path=/home/sip
ajb_save_sip_format=ts:ssid:ipsrc:ipdst:login:msg:scode:from:to:callid:uagent
Here:
ajb_save_sip=1 - enable writing SIP metadata
ajb_sip_path==/home/sip - the location of the files with the record (by default /var/dump/dpi)
ajb_sip_ftimeout=15 - recording frequency
ajb_save_sip_format=ts:ssid:ipsrc:ipdst:login:msg:scode:from:to:callid:uagent - list of metadata to write, where
ts - timestamp
ssid - session identifier (for connection with Netflow/IPFIX volume data)
ipsrc - subscriber's IP
ipdst - Server IP
login - subscriber's LOGIN
msg - message type
scode - status code
from - number/id of the caller
to - number/identifier of the callee
callid - call identifier
uagent - type of subscriber device (User-Agent)