Categories and Schedule for Blacklists: video tutorial
The use of categorized lists is currently in beta test

6 Categorized lists

Service provider's clickstream is used to categorize lists in order to obtain more precise information on domain lists and IP addresses used by subscribers. Clickstream data is available on request and technical capability. The list of categories is accurate to the domain or IP.

Getting a list and making a sublist to use

Downloading:

wget https://5.200.37.126/catlist/outcat.lst.dic.gz
wget https://5.200.37.126/catlist/outcat.lst.gz
gzip -d outcat.lst*

Contents:

outcat.lst.dic - categories description
outcat.lst - domain lists by categories

Example: getting a combined list of 4,5 categories:

grep -P '4\t|5\t' outcat.lst | awk -F '\t' '{print $2}'

Examples of list activation

Blocking social networks and video hostings for corporate clients

The task is to block social networks and other resources not required for work in the organization.

the list of categories to be blocked:
9 porno_sex
12 music_sites
13 game_sites
16 social_networks
27 miners_pools_curs_etc
38 forex
43 gambling
form the list of received files:
mkdir /home/lst; cd /home/lst
grep -P '9\t|12\t|13\t|16\t|27\t|38\t|43\t' outcat.lst | awk -F '\t' '{print $2}' | url2dic 1_block.bin
create a profile:
fdpi_ctrl load profile --service 4 --profile.name 1_black --profile.json '{ "url_list" : "/home/lst/1_block.bin" , "sni_list" : "/home/lst/1_block.bin", "redirect" : "http://mysite.ru/block", "federal" : true }'
here,
http://mysite.ru/block - redirect page.
Assign to subscriber:
fdpi_ctrl load --service 4 --profile_name 1_black --ip 192.168.0.1

Providing access only to certain sites categories

The task is to limit subscriber access by only certain categories of sites.

the list of categories to which the access will be provided:
4 school
19 goverment
25 museum
26 medicina_hostitals
32 child_sites
Form the list of the received files:
mkdir /home/lst;cd /home/lst
grep -P '4\t|19\t|25\t|26\t|32\t' outcat.lst | awk -F '\t' '{print $2}' | url2dic 1_white.bin
Create profile:
fdpi_ctrl load profile --service 5 --profile.name 1_white --profile.json '{ "url_list" : "/home/lst/1_white.bin" , "sni_list" : "http:///home/lst/1_white.bin", "redirect" : "mysite.ru/block" }'
here,
http://mysite.ru/block - redirect page.
Assign to subscriber:
fdpi_ctrl load --service 5 --profile.name 1_white --ip 192.168.0.1

Questions

How often is the list updated? - Once a day. We plan to reduce the update period.