Service provider's clickstream is used to categorize lists, and more specifically in order to obtain more precise information on domain lists and IP addresses used by operator's subscribers. Clickstream data is available on request and technical capability. The list of categories is accurate to the domain or IP.

downloading:

wget https://5.200.37.126/catlist/outcat.lst.dic.gz
wget https://5.200.37.126/catlist/outcat.lst.gz
gzip -d outcat.lst*

contents:

outcat.lst.dic - описание категорий
outcat.lst - список доменов по категориям

Example: getting a combined list of 4,5 categories:

grep -E '4\t|5\t' outcat.lst | awk -F '\t' '{print $2}'

The task is to block social networks and other resources not required for work in the organization.

the list of categories to be blocked:
9       porno_sex
12      music_sites
13      game_sites
16      social_networks
27      miners_pools_curs_etc
38      forex
43      gambling

form the list of received files:
mkdir /home/lst; cd /home/lst
grep -E '9\t|12\t|13\t|16\t|27\t|38\t|43\t' outcat.lst | awk -F '\t' '{print $2}' | url2dic 1_block.bin

create a profile:
fdpi_ctrl load profile --service 4  --profile.name 1_black --profile.json '{ "url_list" : "/home/lst/1_block.bin" , "sni_list" : "/home/lst/1_block.bin", "redirect" : "http://mysite.ru/block", "federal" : true }'
here,
http://mysite.ru/block - redirect page.

assign to subscriber:
fdpi_ctrl load --service 4 --profile_name 1_black --ip 192.168.0.1

The task is to limit subscriber access by only certain categories of sites.

the list of categories to which the access will be provided:
4       school
19      goverment
25      museum
26      medicina_hostitals
32      child_sites

form the list of the received files:
mkdir /home/lst;cd /home/lst
grep -E '4\t|19\t|25\t|26\t|32\t' outcat.lst | awk -F '\t' '{print $2}' | url2dic 1_white.bin

create profile:
fdpi_ctrl load profile --service 5  --profile.name 1_white --profile.json '{ "url_list" : "/home/lst/1_white.bin" , "sni_list" : "http:///home/lst/1_white.bin", "redirect" : "mysite.ru/block" }'
here,
http://mysite.ru/block - redirect page.

assign to subscriber:
fdpi_ctrl load --service 5 --profile.name 1_white --ip 192.168.0.1

• How often is the list updated? - Once a day, we plan to reduce the update period in the future.