WebFetch WebFetch is a Perl module to download and save information from the Web.
Download

WebFetch Ranking & Summary

WebFetch Tags

download information Perl module save download information save information

WebFetch Description

WebFetch is a Perl module to download and save information from the Web. WebFetch is a Perl module to download and save information from the Web.SYNOPSIS use WebFetch;The WebFetch module is a general framework for downloading and saving information from the web, and for display on the web. It requires another module to inherit it and fill in the specifics of what and how to download. WebFetch provides a generalized interface for saving to a file while keeping the previous version as a backup. This is expected to be used for periodically-updated information which is run as a cron job.INSTALLATIONAfter unpacking and the module sources from the tar file, runperl Makefile.PLmakemake installOr from a CPAN shell you can simply type "install WebFetch" and it will download, build and install it for you.If you need help setting up a separate area to install the modules (i.e. if you don't have write permission where perl keeps its modules) then see the Perl FAQ.To begin using the WebFetch modules, you will need to test your fetch operations manually, put them into a crontab, and then use server-side include (SSI) or a similar server configuration to include the files in a live web page.MANUALLY TESTING A FETCH OPERATIONSelect a directory which will be the storage area for files created by WebFetch. This is an important administrative decision - keep the volatile automatically-generated files in their own directory so they'll be separated from manually-maintained files.Choose the specific WebFetch-derived modules that do the work you want. See their particular manual/web pages for details on command-line arguments. Test run them first before committing to a crontab.SETTING UP CRONTAB ENTRIESFirst of all, if you don't have crontab access or don't know what they are, contact your site's system administrator(s). Only local help will do any good on local-configuration issues. No one on the Internet can help. (If you are the administrator for your system, see the crontab(1) and crontab(5) manpages and nearly any book on Unix system administration.)Since the WebFetch command lines are usually very long, you may prefer to make one or more scripts as front-ends so your crontab entries aren't so huge.Do not run the crontab entries too often - be a good net.citizen and do your updates no more often than necessary. Popular sites need their users to refrain from making automated requests too often because they add up on an enormous scale on the Internet. Some sites such as Freshmeat prefer no shorter than hourly intervals. Slashdot prefers no shorter than half-hourly intervals. When in doubt, ask the site maintainers what they prefer.(Then again, there are a very few sites like Yahoo and CNN who don't mind getting the extra hits if you're going to create links to them. Even so, more often than every 20 minutes would still be excessive to the biggest web sites.) Requirements: · Perl

WebFetch Related Software