Sharding configuration and QoE cluster setup [Документация VAS Experts]
Документация VAS Experts Документация VAS Experts-mobile
in

Settings

  • Show page
  • Old revisions
  • Export to PDF
  • Fold/unfold all
  • Backlinks
  • Show page
  • Old revisions
  • Export to PDF
  • Fold/unfold all
  • Backlinks

    • Differences

    This shows you the differences between two versions of the page.

    Link to this comparison view

    Both sides previous revisionPrevious revision
    Next revision    		Previous revision
    en:dpi:qoe_analytics:implementation_administration:configuration_setup:sharding [2025/10/30 09:18] – elena.krasnobryzhen:dpi:qoe_analytics:implementation_administration:configuration_setup:sharding [2025/10/31 11:32] (current) – elena.krasnobryzh
    Line 3: Line 3:
      
     QoE Stor can operate in sharding mode — horizontal cluster scaling, where parts of a single database are distributed across different shards (nodes). QoE Stor can operate in sharding mode — horizontal cluster scaling, where parts of a single database are distributed across different shards (nodes).
     +
     Sharding allows you to: Sharding allows you to:
    -1. Distribute the IPFIX insertion load from multiple DPI units by spreading it across nodes. +  - Distribute the IPFIX insertion load from multiple DPI units by spreading it across nodes. 
    -2. Significantly accelerate report generation by leveraging the combined computational power of all nodes — reports are built in parallel and merged into a final result.+  - Significantly accelerate report generation by leveraging the combined computational power of all nodes — reports are built in parallel and merged into a final result.
      
     ===== 1. Cluster creation ===== ===== 1. Cluster creation =====
      
    -To create a QoE Stor cluster, configure the cluster node settings on each node in the file `/etc/clickhouse-server/config.d/qoestor-cluster-config.xml`.+To create a QoE Stor cluster, configure the cluster node settings on each node in the file ''/etc/clickhouse-server/config.d/qoestor-cluster-config.xml''.
      
     Edit the file on the first node: Edit the file on the first node:
    Line 45: Line 46:
     Copy the file to the remaining cluster nodes.  Copy the file to the remaining cluster nodes. 
      
    -Restart the database with the `fastor-db-restart` command on each node. The cluster is now ready for operation.+Restart the database with the ''fastor-db-restart'' command on each node. The cluster is now ready for operation.
      
     <note important>Port 9000 must be open on all cluster nodes in the internal network between nodes.</note> <note important>Port 9000 must be open on all cluster nodes in the internal network between nodes.</note>
    Line 56: Line 57:
     Select which node will act as the master. Connect it in the GUI settings and enable cluster mode. See the screenshot below. Select which node will act as the master. Connect it in the GUI settings and enable cluster mode. See the screenshot below.
      
    -{{ :dpi:dpi_components:qoestor:configuration:sharding:sharding-master-node.png?direct&1100 |}}+{{ :dpi:qoe_analytics:implementation_administration:configuration_setup:sharding:sharding-master-node.png?&1100 |}}
      
     <note important>Port 8123 must be open on all cluster nodes.</note> <note important>Port 8123 must be open on all cluster nodes.</note>
    Line 64: Line 65:
     In the GUI section **Administrator / Equipment**, add all nodes for SSH management.  In the GUI section **Administrator / Equipment**, add all nodes for SSH management. 
      
    -{{ :dpi:dpi_components:qoestor:configuration:sharding:sharding-ssh.png?direct&1100 |}}+{{ :dpi:qoe_analytics:implementation_administration:configuration_setup:sharding:sharding-ssh.png?&1100 |}}
      
      
    Line 71: Line 72:
     In the QoE Stor configuration, set up receivers for each node.  In the QoE Stor configuration, set up receivers for each node. 
      
    -{{ :dpi:dpi_components:qoestor:configuration:sharding:sharding-receivers.png?direct&1100 |}}+{{ :dpi:qoe_analytics:implementation_administration:configuration_setup:sharding:sharding-receivers.png?&1100 |}}
      
     Reconfigure the DPI to send IPFIX to the corresponding QoE cluster nodes. Reconfigure the DPI to send IPFIX to the corresponding QoE cluster nodes.