Preparing dictionaries that list resources to block [Документация VAS Experts]

This is an old revision of the document!


Preparing dictionaries that list resources to block

Preparing a dictionary with a list of resources to block takes two steps. Firstly, one creates a text file with a list of resources. Secondly, one converts this file into an internal format by means of a special utility.

The conversion is carried out with two utilities:
  • url2dic - for URL, SNI CN
  • ip2bin - for IP

Blacklist Checker Utility - checklock.

File format with a list of URLs to block:

Each line contains one URL (with no http:// prefix). For example:

1magehut.com/users.php?act=gallery&gal=81&page=4
3dmx.net

To convert into the internal format

cat my_url_list.txt|url2dic my_url_list.dic

To convert into the internal format with automatic conversion of domains and URL-letters written in the national alphabet in utf-8 encoding:

cat my_url_list.txt|url2norm|url2dic my_url_list.dic

File format with a list of names to block in SSL certificates:

Each line contains one name. For example:

*.facebook.com
www.vasexpertsdpi.com

To convert into the internal format:

cat my_cn_list.txt|url2dic my_cn_list.dic

File format with a list of public SNI (HTTPS domains)

Each line contains one SNI (without http:// prefix), it is allowed to use *, for example:

qiwi.ru
*.qiwi.ru

To convert into internal format

cat my_sni_list.txt|url2dic my_sni_list.bin

File format with a list of IP addresses to block:

Each line contains one IP then space then the port's number:

78.47.115.34 443
95.211.6.92 443

To convert into the internal format:

cat my_ip_list.txt|ip2bin my_ip_list.bin
SSG 12.4+ Added the ability to use CIDRs, addresses, and ports for IPv4 and IPv6 blacklists and whitelists.
If CIDR or address is set, all TCP ports are blocked (UDP with the setting udp_block=3)