Offline Browser General settings
Before running the program it is advisable to adjust the general settings.
Follow new links / URL - this option allows you to automatically extract other websites linked to the one you are scanning.
A very convenient option that allows you to extract (not download) hyperlinks (websites) not included in the original list of addresses. Here you should decide whether you need to download other websites referred to from one you are downloading. Using this option you will only download the files you order. In this case the sites linked to the one you are investigating will also be downloaded.
For example, you only need to download a list of (URL) addresses
and you don't need to download other domains linked to the original list of domains (e.g. internet-soft.com)
Extract only extrernal link - to search for external hyperlinks.
Links level limit - number of downloading levels - shows the number of steps involved in the hyperlinks.
An example will help to illustrate this option. Let's assume there is a hyperlink from one site to another. There is a link from the second link to the third, etc.
As you can see, a number of hyperlinks must be followed to get from one site to another. This option gives you the greatest possible number of hyperlink steps. Each step enables you to make some hyperlinks with a number of other websites. So if you have selected only one level, you will only be able to copy the websites (let's call them XI websites) to which there is a link on the website you are downloading (scanning), and not the sites with hyperlinks from XI websites.
The following chart shows how the links level limit works.
In this item you enter the number of simultaneous connections.
Save results automatically
Time out for one connection
At the end of this time the program starts downloading the next document.
Number of retries
This option shows the number of attempts to download the same file if the provider connection or website link is broken off. The program will make as many attempts to download as you specify.
Copy subdirectory structure from website
Apply domainname.com = www.domainname.com
Expand the nodes parents to make the node visible
Identify browser as
For example, when you download a page using Internet Explorer 5.0, the remote server performs this operations and writes the contents of the server as a protocol. The Extractor program does the same thing when you visit a website.
Then choose any other options you would like to use in downloading and searching for hyperlinks.
We would like to draw your attention to the following:
Since the worldwide web contains a huge number of pages great data processing power may be needed as well as a large amount of disk space on your computer to download links and websites. A few hours of work by the program may take up many gigabytes on your hard disk.
File Type Filter: Limiting the types
and sizes of files
This is important, for example, when you only want to download text documents without banners, pictures or archive files.
In this case, check the option beside html, htm, txt and shtml, etc. files.
You can use these menu options to limit the size
of files to be downloaded. If you have selected "Load all file sizes",
files of all sizes will be downloaded. Otherwise you will only get the
sizes (specified in bytes) you have selected.
You can make limitations by entering certain words in domains. Let's say you're downloading files only from http://www.asona.org. You would only enter asona as the filter word.
The filter can be used separately:
- to adjust the word content in a domain name;
- to expand the domain;
- to adjust the contents of a certain word in a directory name;
- to modify any given word in the file name.
Domains: Limitations by domain type.
This option enables you to make limitations by type and country of the domain.
To do this click on the requested domain type.
This is all you have to do for the main program settings.
When you exit the menu window you save by default the data you have entered and you can proceed to download websites.
Now we can start a project. The default properties you have entered will automatically be called up when you start a new project. These properties can be altered and saved for a later time for each separate project.
The term "project" therefore refers to the total number of options that define which site and properties are to be downloaded.
Downloading a website
In order to download the website you need into your hard drive, first create a downloading project.
- Select Project on the main menu and then New. A window will appear for viewing websites and entering download properties;
- Now enter the address of the site you would like to download;
- Press Download / Extract.
You can also use the local menu, which is called up by clicking on the right button on your mouse. The structure of the site is created automatically only if you choose the option "Follow new links".
You can view pages both offline and online while you download other documents.
Other setting options
The program also offers a range of other frequently-used options.
If you have a text file with a list of websites, you can download this file into the site window using the load button.
You can also copy a link into the clipboard and the paste it:
- Into the list of sites to be downloaded;
- Into the site map.
Other properties can be set by selecting options or project options on the menu list. For example, using the latter item you can make customized filter settings and downloading level options.