<note tip>Categories and Schedule for Blocklists: {{youtube>7q-LDW9eS78?}}</note>
<note important>The use of categorized lists is currently in beta test</note>

====== Categorized lists  ======
{{indexmenu_n>6}}
Service provider's clickstream is used to categorize lists in order to obtain more precise information on domain lists and IP addresses used by subscribers. Clickstream data is available on request and technical capability. The list of categories is accurate to the domain or IP.

====== Getting a list and making a sublist to use ======
Downloading from Cloud:
<code>
wget --no-check-certificate https://catalog.vasexperts.ru/catlist/outcat.lst.dic.gz
wget --no-check-certificate https://catalog.vasexperts.ru/catlist/outcat.lst.gz
gzip -d outcat.lst*
</code>

Contents:
<code>
outcat.lst.dic - categories description
outcat.lst - domain lists by categories
</code>

Example: getting a combined list of 4,5 categories:
<code>grep -P '4\t|5\t' outcat.lst | awk -F '\t' '{print $2}'</code>

====== Examples of list activation ======
===== Blocking social networks and video hostings for corporate clients =====
Block resources from the category "porn" \\
List of categories to which the access will be blocked: \\
9 porno_sex \\

Form a list of the received files:
<code>
zcat outcat.lst.gz | awk -F '\t' '{if ($1=="9") {print $2 "\n*." $2}}'| url2dic porno_block.bin

fdpi_ctrl load profile --service 4 --profile.name 1_black --profile.json '{"url_list": "/root/porn/porno_block.bin", "sni_list": "/root/porn/porno_block.bin", "redirect": "http://vasexperts.ru/block", "federal": true} '

fdpi_ctrl load --service 4 --profile_name 1_black --ip 10.64.66.100
</code>

The task is to block social networks and other resources not required for work in the organization.
<code>
the list of categories to be blocked:
9       porno_sex
12      music_sites
13      game_sites
16      social_networks
27      miners_pools_curs_etc
38      forex
43      gambling

Form the list of received files:
mkdir /home/lst; cd /home/lst
grep -P '9\t|12\t|13\t|16\t|27\t|38\t|43\t' outcat.lst | awk -F '\t' '{print $2}' | url2dic 1_block.bin

Create a profile:
fdpi_ctrl load profile --service 4  --profile.name 1_black --profile.json '{ "url_list" : "/home/lst/1_block.bin" , "sni_list" : "/home/lst/1_block.bin", "redirect" : "http://mysite.ru/block", "federal" : true }'
here,
http://mysite.ru/block - redirect page.

Assign to subscriber:
fdpi_ctrl load --service 4 --profile_name 1_black --ip 192.168.0.1
</code>
===== Providing access only to certain sites categories =====
The task is to limit subscriber access by only certain categories of sites.
<code>
the list of categories to which the access will be provided:
4       school
19      goverment
25      museum
26      medicina_hostitals
32      child_sites

Form the list of the received files:
mkdir /home/lst;cd /home/lst
grep -P '4\t|19\t|25\t|26\t|32\t' outcat.lst | awk -F '\t' '{print $2}' | url2dic 1_white.bin

Create profile:
fdpi_ctrl load profile --service 5  --profile.name 1_white --profile.json '{ "url_list" : "/home/lst/1_white.bin" , "sni_list" : "http:///home/lst/1_white.bin", "redirect" : "mysite.ru/block" }'
here,
http://mysite.ru/block - redirect page.

Assign to subscriber:
fdpi_ctrl load --service 5 --profile.name 1_white --ip 192.168.0.1
</code>

====== Questions ======
  * How often is the list updated? - Once a day. We plan to reduce the update period.