General Description [Документация VAS Experts]
Документация VAS Experts Документация VAS Experts-mobile
in

Settings

  • Show page
  • Old revisions
  • Export to PDF
  • Fold/unfold all
  • Backlinks
  • Show page
  • Old revisions
  • Export to PDF
  • Fold/unfold all
  • Backlinks

    • Differences

    This shows you the differences between two versions of the page.

    Link to this comparison view

    Both sides previous revisionPrevious revision
    Next revision    		Previous revision
    en:dpi:dpi_options:opt_statistics:statistics_description [2024/09/26 15:29] – external edit 127.0.0.1en:dpi:dpi_options:opt_statistics:statistics_description [2025/10/31 08:21] (current) – elena.krasnobryzh
    Line 1: Line 1:
    -====== General description ====== +====== General Description ======   
    -{{indexmenu_n>1}} +{{indexmenu_n>1}}   
    -VAS Experts DPI exports statistics in formats: +{{ :dpi:dpi_options:opt_statistics:statistics_upload.png?nolink&800 |}}  
    -  * [[https://en.wikipedia.org/wiki/IP_Flow_Information_Export|IPFIX (NetFlow v10)]] +
    -  * [[https://en.wikipedia.org/wiki/NetFlow|netflow5 v5]]+
      
    -====== IPFIX (NetFlow v10) ====== +SSG supports statistics export for the following [[en:dpi:dpi_options:opt_statistics:statistics_settings|main data streams]]:   
    -Full statisctics by sessions is exported for the billing system. You can find the description of format in [[en:dpi:dpi_options:opt_statistics:statistics_ipfix|Configuring export in IPFIX]] section. +  - NetFlow by protocols — protocol-related information. [[en:dpi:dpi_options:protocols|Protocol numbers are transmitted according to the reference guide]],   
    -To collect, process and store NetFlow, we suggest using the [[en:dpi:dpi_components:qoestor|QoE Store software]] and the [[en:dpi:dpi_components:dpiui|DPIUI2 graphical interface]].+  - NetFlow by directions — information on Autonomous System (AS) numbers. [[en:dpi:dpi_options:opt_statistics:statistics_asn|AS numbers are transmitted according to the reference guide]],   
     +  - NetFlow for billing (RADIUS accounting) — information on the volume of transmitted data per subscriber. [[en:dpi:bras_bng:radius_integration:radius_accounting|This stream is sent to fastPCRF and converted into RADIUS accounting]],   
     +  - Full NetFlow — complete (unsampled) data for each subscriber with additional fields for [[en:dpi:qoe_analytics:qoe_gui:reports:paramdescript|QoE (RTT, retransmissions)]] and NAT flow. [[en:dpi:dpi_options:opt_statistics:statistics_ipfix|Additional fields are available only for the IPFIX format (NetFlow v10)]].  
      
    -The section [[en:dpi:dpi_options:opt_li:li_ipfix|Loging using IPFIX]] describes the export of meta-information: +Full NetFlow can be exported in one of the following formats:   
    -  * ClickStream +  * [[https://en.wikipedia.org/wiki/IP_Flow_Information_Export|IPFIX (NetFlow v10)]],   
    -  * SIP +  * [[http://en.wikipedia.org/wiki/Netflow|NetFlow v5]].  
    -  * FTP +
    -  * instant messengers (XMPP) +
    -  * mail protocols (POP, IMAP, SMTP) +
    -  * raw unresolved metadata.+
      
    -====== NetFlow v5 ====== +<note tip>For receiving, processing, and storing NetFlow, we recommend using the [[en:dpi:qoe_analytics|QoE Store statistical data collection software]] and the [[en:dpi:dpi_components:dpiui|DPIUI2 graphical interface]].</note>  
    -This format is supported by most of free and commercial tools for collecting and analysing stat data. For your convenience, we deliver [[en:dpi:dpi_components:utilities:oldutility:nfsen|free SW to view and analyse statistics]] - slightly adopted version of [[http://nfsen.sourceforge.net|nfsen]], with extensions to build reports by protocols and independent systems' names.+
      
    -Transmission of the DPI information by netflow5 has some peculiarities: +[[en:dpi:dpi_options:opt_li:li_ipfix|IPFIX export for the implementation of Lawful Interception (LI)]]:   
    -  +  * ClickStream — users' web requests. [[en:dpi:qoe_analytics:cases:subscriber_analytics:clickstream_analytics|Use cases in the QoE module]]   
    -  - The information on the used protocol is defined in [[http://netflow.caligare.com/netflow_v5.htm|dstport]] field (port number). [[http://www.iana.org/assignments/service-names-port-numbers/service-names-port-numbers.xhtml|The port number specified by IANA association for the protocol]] is used when available. However, for [[en:dpi:dpi_options:opt_statistics:statistics_info|the protocols with floating number (torrents, skype and so on)]] the special number in the upper range (49152-65534) is reserved. This range is specified by IANA for private ports. The port number 65535 is assigned for protocols that failed to be detected. +  * Protocol metadata: FTP, SIP, XMPP, POP, IMAP, SMTP  
    -  - The statistics by protocols is transmitted in aggregated format. DPI accumulates statistics by the protocol by combining an information from various sessions. Then DPI sends this information to a collector within the specified schedule. This method allows dramatical reduction of amount of transmitted data. +
    -  - Direction information is defined by  [[http://netflow.caligare.com/netflow_v5.htm|dst_as]] field (independent system's number)     +
    -  - The statistics by directions is transmitted in aggregated format. DPI accumulates statistics by the direction (AS number) by combining an information from various sessions. Then DPI sends this information to a collector within the specified schedule. This method allows dramatical reduction of amount of transmitted data.+
      
     +Additional data streams for IPFIX export:  
     +  * NAT flow - [[en:dpi:opt_cgnat:log|]]  
     +  * GTP flow - [[en:dpi:dpi_components:platform:dpi_mobile_spec:ipfix|export of GTP-C signaling information for mobile networks to implement Location-Based Services]]