Differences

This shows you the differences between two versions of the page.

--- en:dpi:dpi_options:opt_filtration:filtration_troubleshooting:filtration_delta [2023/10/12 07:14] – [VAS Experts DPI configuration guide] elena.krasnobryzh
+++ en:dpi:dpi_options:opt_filtration:filtration_troubleshooting:filtration_delta [2024/07/29 12:48] (current) – removed elena.krasnobryzh
@@ Line 1: / Line 1: @@
-====== A new delta filtration mechanism ======
-{{indexmenu_n>5}}
-====== Introduction ======
-Roscomnadzor, the Russian regulator and competition authority in communications industries is moving to a new mechanism for collecting lists in the form of "deltas" (description is at the end of the document). For operators fetching the lists from our cloud, you need to configure the VAS Experts DPI according to the instructions. If the lists prepared independently, it is necessary to make changes to their algorithms.\\
-For the transition period of 2 weeks, the fines were canceled, please clarify all the taxpayer identification numbers (TIN) from your curator in the Roscomnadzor the test period is valid for.
-====== VAS Experts DPI configuration guide ======
-Dear operator, as part of the transition to a new mechanism for obtaining the unloading of the Roscomnadzor (delta) lists, we have prepared the following instruction.
-   * 1.Specify the following  settings (or modify it) in the /etc/dpi/fastdpi.conf file:
-<code>#work on the deltas from the cloud VAS Experts
-federal_black_list=2
-# verification period is 1 minute
-timeout_check_new_bl=1</code>
-   * 2.Restart the DPI service в подходящее время
-<code>service fastdpi restart</code>
-   * 3.Check in the fastdpi_alert.log file located in the /var/log/dpi/ directory whether the list loading once per minute is successfull or check the information the list has not changed.
-====== Instruction for lists loading ======
-Lists in the cloud are downloaded from the Roscomnadzor registry on behalf of "IT-GRAD" LLC TIN 7838413489
-  - If you download lists independently http://vasexperts.ru/wiki/doku.php?id=filtration_script
-  - If you use the service of loading lists in support http://vasexperts.ru/wiki/doku.php?id=filtration_eds , then you need to create a request for support with your login and password (you can get it from the Roscomnadzor curator). When using our service the ftp access will be provided to archives.
-====== A new loading mechanism using "deltas" ======
-Roscomnadzor changes method of authorization, if earlier you was required an electronic digital signature, which greatly delayed the process of downloading the registry of sites to be blocked, now it is enough to enter your personal account by providing your login and password.\\
-The basis of the new mechanism is the form of deltas, that is, the changes that Roscomnadzor made to this part of registry compared to the previous one. Note that updates do not happen every hour, it occurs only when new entries is added or when the old ones are modified. Since the "delta" is significantly smaller than the entire registry (about 200-300 resources), its placement for downloading by telecom operators is faster than before.\\
-Communication operators have to download the "delta" and load it into its blocking system, which should support not only the downloading of hourly updated registry as it does according to the current regulations, but also a lightweight incremental version of the list.\\
-The purpose of the new mechanism is to increase the response speed of telecom operators to the requirements for blocking new resources or resources with changed addresses.
-====== Getting the registry ======
-In order to receive changes to registry of resources to be blocked quickly, you can, as before, use the Web service. Now it works as in the basic mode of fetching full registry when it changes, along with fetching the delta packets.\\
-At any time, it is possible to get full registry, a complete update of the filtering rules satisfying the requirements, along with a transition to the delta packet mode concerning particular registry part.\\
-Each delta packet has a unique identifier and an up-to-date date, and is a file in the xml format having the same structure as the main registry part. This format is described in the Memo to the communication operator. The difference is that there are only new and modified records in the delta packet. Also delta packet contains the delete tags, where the id attribute value is the the identifier of the registry entry being deleted. As a result, when applying a delta packet, you should perform the following actions.\\
-  * Update or add a registry entry for each content element.
-  * Delete a registry entry using the id attribute value for each delete element.

Profile

Settings

Differences