Categories and Schedule for Blocklists:
The use of categorized lists is currently in beta test
Categorized lists
Service provider's clickstream is used to categorize lists in order to obtain more precise information on domain lists and IP addresses used by subscribers. Clickstream data is available on request and technical capability. The list of categories is accurate to the domain or IP.
Getting a list and making a sublist to use
Downloading from Cloud:
wget --no-check-certificate https://catalog.vasexperts.ru/catlist/outcat.lst.dic.gz wget --no-check-certificate https://catalog.vasexperts.ru/catlist/outcat.lst.gz gzip -d outcat.lst*
Contents:
outcat.lst.dic - categories description outcat.lst - domain lists by categories
Example: getting a combined list of 4,5 categories:
grep -P '4\t|5\t' outcat.lst | awk -F '\t' '{print $2}'
Examples of list activation
Blocking social networks and video hostings for corporate clients
Block resources from the category "porn"
List of categories to which the access will be blocked:
9 porno_sex
Form a list of the received files:
zcat outcat.lst.gz | awk -F '\t' '{if ($1=="9") {print $2 "\n*." $2}}'| url2dic porno_block.bin fdpi_ctrl load profile --service 4 --profile.name 1_black --profile.json '{"url_list": "/root/porn/porno_block.bin", "sni_list": "/root/porn/porno_block.bin", "redirect": "http://vasexperts.ru/block", "federal": true} ' fdpi_ctrl load --service 4 --profile_name 1_black --ip 10.64.66.100
The task is to block social networks and other resources not required for work in the organization.
the list of categories to be blocked: 9 porno_sex 12 music_sites 13 game_sites 16 social_networks 27 miners_pools_curs_etc 38 forex 43 gambling Form the list of received files: mkdir /home/lst; cd /home/lst grep -P '9\t|12\t|13\t|16\t|27\t|38\t|43\t' outcat.lst | awk -F '\t' '{print $2}' | url2dic 1_block.bin Create a profile: fdpi_ctrl load profile --service 4 --profile.name 1_black --profile.json '{ "url_list" : "/home/lst/1_block.bin" , "sni_list" : "/home/lst/1_block.bin", "redirect" : "http://mysite.ru/block", "federal" : true }' here, http://mysite.ru/block - redirect page. Assign to subscriber: fdpi_ctrl load --service 4 --profile_name 1_black --ip 192.168.0.1
Providing access only to certain sites categories
The task is to limit subscriber access by only certain categories of sites.
the list of categories to which the access will be provided: 4 school 19 goverment 25 museum 26 medicina_hostitals 32 child_sites Form the list of the received files: mkdir /home/lst;cd /home/lst grep -P '4\t|19\t|25\t|26\t|32\t' outcat.lst | awk -F '\t' '{print $2}' | url2dic 1_white.bin Create profile: fdpi_ctrl load profile --service 5 --profile.name 1_white --profile.json '{ "url_list" : "/home/lst/1_white.bin" , "sni_list" : "http:///home/lst/1_white.bin", "redirect" : "mysite.ru/block" }' here, http://mysite.ru/block - redirect page. Assign to subscriber: fdpi_ctrl load --service 5 --profile.name 1_white --ip 192.168.0.1
Questions
- How often is the list updated? - Once a day. We plan to reduce the update period.