| Both sides previous revisionPrevious revisionNext revision | Previous revision |
| en:dpi:dpi_options:opt_statistics:statistics_description [2024/09/26 15:29] – external edit 127.0.0.1 | en:dpi:dpi_options:opt_statistics:statistics_description [2026/04/16 13:34] (current) – elena.krasnobryzh |
|---|
| ====== General description ====== | ====== General Description ====== |
| {{indexmenu_n>1}} | {{indexmenu_n>1}} |
| VAS Experts DPI exports statistics in formats: | {{ :dpi:dpi_options:opt_statistics:statistics_upload.png?nolink&800 |}} |
| * [[https://en.wikipedia.org/wiki/IP_Flow_Information_Export|IPFIX (NetFlow v10)]] | |
| * [[https://en.wikipedia.org/wiki/NetFlow|netflow5 v5]] | |
| |
| ====== IPFIX (NetFlow v10) ====== | SSG supports statistics export for the following [[en:dpi:dpi_options:opt_statistics:statistics_settings|main data streams]]: |
| Full statisctics by sessions is exported for the billing system. You can find the description of format in [[en:dpi:dpi_options:opt_statistics:statistics_ipfix|Configuring export in IPFIX]] section. | - NetFlow by protocols — protocol-related information. [[en:dpi:dpi_options:protocols|Protocol numbers are transmitted according to the reference guide]], |
| To collect, process and store NetFlow, we suggest using the [[en:dpi:dpi_components:qoestor|QoE Store software]] and the [[en:dpi:dpi_components:dpiui|DPIUI2 graphical interface]]. | - NetFlow by directions — information on Autonomous System (AS) numbers. [[en:dpi:dpi_options:opt_statistics:statistics_asn|AS numbers are transmitted according to the reference guide]], |
| | - NetFlow for billing (RADIUS accounting) — information on the volume of transmitted data per subscriber. [[en:dpi:bras_bng:radius_integration:radius_accounting|This stream is sent to fastPCRF and converted into RADIUS accounting]], |
| | - Full NetFlow — complete (unsampled) data for each subscriber with additional fields for [[en:dpi:qoe_analytics:qoe_gui:reports:paramdescript|QoE (RTT, retransmissions)]] and NAT flow. [[en:dpi:dpi_options:opt_statistics:statistics_ipfix|Additional fields are available only for the IPFIX format (NetFlow v10)]]. |
| |
| The section [[en:dpi:dpi_options:opt_li:li_ipfix|Loging using IPFIX]] describes the export of meta-information: | Full NetFlow can be exported in one of the following formats: |
| * ClickStream | * [[https://en.wikipedia.org/wiki/IP_Flow_Information_Export|IPFIX (NetFlow v10)]], |
| * SIP | * [[http://en.wikipedia.org/wiki/Netflow|NetFlow v5]]. |
| * FTP | |
| * instant messengers (XMPP) | |
| * mail protocols (POP, IMAP, SMTP) | |
| * raw unresolved metadata. | |
| |
| ====== NetFlow v5 ====== | <note tip>For receiving, processing, and storing NetFlow, we recommend using the [[en:dpi:qoe_analytics|QoE Store statistical data collection software]] and the [[en:dpi:dpi_components:dpiui|DPIUI2 graphical interface]].</note> |
| This format is supported by most of free and commercial tools for collecting and analysing stat data. For your convenience, we deliver [[en:dpi:dpi_components:utilities:oldutility:nfsen|free SW to view and analyse statistics]] - slightly adopted version of [[http://nfsen.sourceforge.net|nfsen]], with extensions to build reports by protocols and independent systems' names. | |
| |
| Transmission of the DPI information by netflow5 has some peculiarities: | [[en:dpi:dpi_options:opt_li:li_ipfix|IPFIX export for the implementation of Lawful Interception (LI)]]: |
| | * ClickStream — users' web requests. Use cases in the QoE module: [[en:dpi:qoe_analytics:cases:subscriber_analytics|]] |
| - The information on the used protocol is defined in [[http://netflow.caligare.com/netflow_v5.htm|dstport]] field (port number). [[http://www.iana.org/assignments/service-names-port-numbers/service-names-port-numbers.xhtml|The port number specified by IANA association for the protocol]] is used when available. However, for [[en:dpi:dpi_options:opt_statistics:statistics_info|the protocols with floating number (torrents, skype and so on)]] the special number in the upper range (49152-65534) is reserved. This range is specified by IANA for private ports. The port number 65535 is assigned for protocols that failed to be detected. | * Protocol metadata: FTP, SIP, XMPP, POP, IMAP, SMTP |
| - The statistics by protocols is transmitted in aggregated format. DPI accumulates statistics by the protocol by combining an information from various sessions. Then DPI sends this information to a collector within the specified schedule. This method allows dramatical reduction of amount of transmitted data. | |
| - Direction information is defined by [[http://netflow.caligare.com/netflow_v5.htm|dst_as]] field (independent system's number) | |
| - The statistics by directions is transmitted in aggregated format. DPI accumulates statistics by the direction (AS number) by combining an information from various sessions. Then DPI sends this information to a collector within the specified schedule. This method allows dramatical reduction of amount of transmitted data. | |
| |
| | Additional data streams for IPFIX export: |
| | * NAT flow - [[en:dpi:opt_cgnat:log|]] |
| | * GTP flow - [[en:dpi:dpi_components:platform:dpi_mobile_spec:ipfix|export of GTP-C signaling information for mobile networks to implement Location-Based Services]] |