====== Cloning a website ====== {{indexmenu_n>4}} To go to the section, click the LAWFUL INTERCEPTION menu item, then click the CLONING A WEBSITE menu item. {{ en:dpi:dpi_components:dpiui:user_guide:lawful_interception:clonin_a_website:pth_1.png? 800 }} ===== Sites ===== ==== Add a subtask ==== To add a subtask to the website download **"Add a subtask"**.\\ In the window that opens, enter the parameters. {{ en:dpi:dpi_components:dpiui:user_guide:lawful_interception:clonin_a_website:create_2.png? 400 }} Basic parameters: 1. **Description**. This field contains the name or description of the profile\\ 2. **URL(a)**. Url(a) or a list of URLs of files that the user needs to download.\\ 3. **Virtual host address**. The address of the virtual host on which the cloned site will be deployed (URL links).\\ 4. **Virtual host address**. The address of the virtual port on which the cloned site will be deployed (URL links). == Additional parameters: == == Recursion == {{ en:dpi:dpi_components:dpiui:user_guide:lawful_interception:clonin_a_website:rec_3.png? 300 }} * **Recursive loading**. If the user needs all the links contained on the cloned site, then it is necessary to check the box in this cell.\\ * **Recursion depth**\\ * **Upload banking details**. If the user needs the images needed to load the html site, then it is necessary to check the box in this cell.\\ * **Convert links**. Make links local in uploaded HTML or CSS.\\ * **Make a backup**. Creating a copy of a file with расширением.огд . The ORIG format is used to indicate the original version of a file that is saved as a backup after editing or updating.\\ * **Create a site mirror**. If the user wants to create a duplicate (copy) of the site, then it is necessary to check the box in this cell. The mirror is a duplicate, a copy of the site.\\ * ** Do not climb**. Do not go up to the parent directory. == Input data == {{ en:dpi:dpi_components:dpiui:user_guide:lawful_interception:clonin_a_website:input_4.png? 300 }} * **Continue downloading**. If the operation was interrupted while downloading files, then you can resume downloading from the place of interruption by checking the continue downloading checkbox.\\ * **Force HTML**\\ * **The URL prefix** indicating the protocol used to access the location, i.e. the data transfer protocol.\\ * **Additional parameters**. == Download == {{ en:dpi:dpi_components:dpiui:user_guide:lawful_interception:clonin_a_website:downl_5.png? 300 }} * **Pause**. The user can set a pause before each file download. The duration of the pause is specified by the user independently in seconds.\\ * **Attempts**. The user can configure the number of repeated attempts to download the file in case it is interrupted. The number of attempts is entered manually by the user.\\ * **Arbitrary pause**. The user can choose an arbitrary pause before downloading each file. The pause duration is determined randomly in the range from 0.5 to 1.5 seconds.\\ * **Speed (bits/sec)**. If necessary, the download speed can be limited. As a result, this operation will not occupy the entire available data channel and will not affect other processes associated with the network. You can do this by specifying a speed limit expressed in bytes (as a regular number) per second.\\ * **Repeat in case of refusal **. Repeat the download even if the connection is denied.\\ * **Timeout**. File download standby mode. Entered manually by the user in seconds.\\ * **Response from the server**. Conclusions of the response from the server.\\ * **Skip downloads**. If a user wants to copy an entire website, but does not need files of a certain type, you can disable their download using the parameter.\\ * **Do not re-upload**. Do not re-upload files only if they are not newer than the local ones. == Directories == {{ en:dpi:dpi_components:dpiui:user_guide:lawful_interception:clonin_a_website:dir_6.png? 300 }} * **Do not create directories**.\\ * **Force the creation of directories**.\\ * **Do not create host directories**.\\ * **Ignore the number of components of the remote directory**. == FTP == {{ en:dpi:dpi_components:dpiui:user_guide:lawful_interception:clonin_a_website:ftp_8.png? 300 }} * **Do not delete files.listing**\\ * **Upload files by links, not directories**\\ * **Turn off masks**\\ * **Disable passive mode** == HTTP == {{ en:dpi:dpi_components:dpiui:user_guide:lawful_interception:clonin_a_website:http_7.png? 300 }} * **HTTP user**. Login input.\\ * **HTTP password**. Enter the password.\\ * **Proxy user**. Login input.\\ * **Proxy password**. Enter the password.\\ * **POST-lines**. Sending a string as data.\\ * **Referer header**. The HTTP referer header is transmitted from the browser to the server to tell which page the reader was on before switching to the current one.\\ * **Do not use cookies**.\\ * **Do not use keep alive**.\\ * **Do not use the cache**. Reject data cached by the server.\\ * **Agent**. Identify yourself as an agent instead of Wget ==== Add a crawl ==== To add a subtask to the website download, click on the button **"Add subtask"**, which is located in the toolbar and do the tasks described above. {{ en:dpi:dpi_components:dpiui:user_guide:lawful_interception:clonin_a_website:create_9.png? 400 }} ==== Run scan ==== To start scanning a profile, select a profile from the list and click on the **"Start scanning"** button. {{ en:dpi:dpi_components:dpiui:user_guide:lawful_interception:clonin_a_website_10.png? 400 }} ==== Stop scanning ==== To stop the running profile scan, click on the **"Stop scanning"** button. {{ en:dpi:dpi_components:dpiui:user_guide:lawful_interception:clonin_a_website:stop_11.png? 400 }} ==== Get acquainted with the properties of data folders ==== To view the properties of the data folder, click on the "Data Folder Properties" button, after which a window with the folder data will be displayed. {{ en:dpi:dpi_components:dpiui:user_guide:lawful_interception:clonin_a_website:learn_12.png? 400 }} ==== Download archive ==== To download the zip archive, click on the "Download" button. {{ en:dpi:dpi_components:dpiui:user_guide:lawful_interception:clonin_a_website:save_13.png? 400 }} ==== Clear Folder ==== To clear the folder with subtasks, click on the "Clear Folder" button. {{ en:dpi:dpi_components:dpiui:user_guide:lawful_interception:clonin_a_website:clear_14.png? 400 }} ==== Enable Virtual Host ==== To enable the virtual host of the selected task or subtask, click on the "Enable virtual host" button. {{ en:dpi:dpi_components:dpiui:user_guide:lawful_interception:clonin_a_website:on_15.png? 400 }} ==== Turn off the virtual host ==== To turn off the virtual host of the selected task or subtask, click on the "Turn off virtual host" button. {{ en:dpi:dpi_components:dpiui:user_guide:lawful_interception:clonin_a_website:off_16.png? 400 }} ==== Site Spoofing ==== {{ en:dpi:dpi_components:dpiui:user_guide:lawful_interception:clonin_a_website:spoofing_17.png? 400 }} ==== Update the list ==== To update the list of profiles, click on the **"Update"** button. {{ en:dpi:dpi_components:dpiui:user_guide:lawful_interception:clonin_a_website:update_18.png? 400 }} ==== Change List Item ==== To change the profile or subprofile parameters, click on the **"Edit"**, which is located to the left of each list item. {{ en:dpi:dpi_components:dpiui:user_guide:lawful_interception:clonin_a_website:change_19.png? 500 }} ==== Delete a list item ==== To delete an item from the list, click on the **"Delete"**, which is located to the right of each list item. {{ en:dpi:dpi_components:dpiui:user_guide:lawful_interception:clonin_a_website:delete_20.png? 500 }} ===== Statistics ===== This subsection contains information about logical statistics, file statistics - information about the download of each file, spoofing — information about the final download.