Categorized lists [Документация VAS Experts]

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
en:dpi:dpi_options:use_cases:categor_lists [2023/08/29 12:53] elena.krasnobryzhen:dpi:dpi_options:use_cases:categor_lists [2024/09/26 15:29] (current) – external edit 127.0.0.1
Line 1: Line 1:
-====== categor_lists ======+<note tip>Categories and Schedule for Blocklists: {{youtube>7q-LDW9eS78?}}</note> 
 +<note important>The use of categorized lists is currently in beta test</note> 
 + 
 +====== Categorized lists  ====== 
 +{{indexmenu_n>6}} 
 +Service provider's clickstream is used to categorize lists in order to obtain more precise information on domain lists and IP addresses used by subscribers. Clickstream data is available on request and technical capability. The list of categories is accurate to the domain or IP. 
 + 
 +====== Getting a list and making a sublist to use ====== 
 +Downloading from Cloud: 
 +<code> 
 +wget --no-check-certificate https://catalog.vasexperts.ru/catlist/outcat.lst.dic.gz 
 +wget --no-check-certificate https://catalog.vasexperts.ru/catlist/outcat.lst.gz 
 +gzip -d outcat.lst* 
 +</code> 
 + 
 +Contents: 
 +<code> 
 +outcat.lst.dic - categories description 
 +outcat.lst - domain lists by categories 
 +</code> 
 + 
 +Example: getting a combined list of 4,5 categories: 
 +<code>grep -P '4\t|5\t' outcat.lst | awk -F '\t' '{print $2}'</code> 
 + 
 +====== Examples of list activation ====== 
 +===== Blocking social networks and video hostings for corporate clients ===== 
 +Block resources from the category "porn" \\ 
 +List of categories to which the access will be blocked: \\ 
 +9 porno_sex \\ 
 + 
 +Form a list of the received files: 
 +<code> 
 +zcat outcat.lst.gz | awk -F '\t' '{if ($1=="9") {print $2 "\n*." $2}}'| url2dic porno_block.bin 
 + 
 +fdpi_ctrl load profile --service 4 --profile.name 1_black --profile.json '{"url_list": "/root/porn/porno_block.bin", "sni_list": "/root/porn/porno_block.bin", "redirect": "http://vasexperts.ru/block", "federal": true} ' 
 + 
 +fdpi_ctrl load --service 4 --profile_name 1_black --ip 10.64.66.100 
 +</code> 
 + 
 +The task is to block social networks and other resources not required for work in the organization. 
 +<code> 
 +the list of categories to be blocked: 
 +9       porno_sex 
 +12      music_sites 
 +13      game_sites 
 +16      social_networks 
 +27      miners_pools_curs_etc 
 +38      forex 
 +43      gambling 
 + 
 +Form the list of received files: 
 +mkdir /home/lst; cd /home/lst 
 +grep -P '9\t|12\t|13\t|16\t|27\t|38\t|43\t' outcat.lst | awk -F '\t' '{print $2}' | url2dic 1_block.bin 
 + 
 +Create a profile: 
 +fdpi_ctrl load profile --service 4  --profile.name 1_black --profile.json '{ "url_list" : "/home/lst/1_block.bin" , "sni_list" : "/home/lst/1_block.bin", "redirect" : "http://mysite.ru/block", "federal" : true }' 
 +here, 
 +http://mysite.ru/block - redirect page. 
 + 
 +Assign to subscriber: 
 +fdpi_ctrl load --service 4 --profile_name 1_black --ip 192.168.0.1 
 +</code> 
 +===== Providing access only to certain sites categories ===== 
 +The task is to limit subscriber access by only certain categories of sites. 
 +<code> 
 +the list of categories to which the access will be provided: 
 +4       school 
 +19      goverment 
 +25      museum 
 +26      medicina_hostitals 
 +32      child_sites 
 + 
 +Form the list of the received files: 
 +mkdir /home/lst;cd /home/lst 
 +grep -P '4\t|19\t|25\t|26\t|32\t' outcat.lst | awk -F '\t' '{print $2}' | url2dic 1_white.bin 
 + 
 +Create profile: 
 +fdpi_ctrl load profile --service 5  --profile.name 1_white --profile.json '{ "url_list" : "/home/lst/1_white.bin" , "sni_list" : "http:///home/lst/1_white.bin", "redirect" : "mysite.ru/block" }' 
 +here, 
 +http://mysite.ru/block - redirect page. 
 + 
 +Assign to subscriber: 
 +fdpi_ctrl load --service 5 --profile.name 1_white --ip 192.168.0.1 
 +</code> 
 + 
 +====== Questions ====== 
 +  * How often is the list updated? - Once a day. We plan to reduce the update period.