Date: Tue, 10 Apr 2001 15:42:35 -0400 From: madodelatptdprolog.net Subject: [VOICENWS] Two powerful web downloaders From: "Platon Fomichev : plaatcland.ru" 10.04.2001 Two powerful web downloaders I am glad to introduce you two extremely powerful Web grabbers and downloaders for XFree86/2 and for Hobb X Server. First one is X-Downloader, second Pavuk mirror tool. Their respective sites are: http://www.krasu.ru/soft/chuchelo/ and http://www.idata.sk/~ondrej/pavuk/ Some features of X-Downloader: Downloader for X has a nice userfriendly interface for comfortable using. Program also has queue of downloads and support many various features for powerfull downloading: supporting both ftp and http protocols saving list before quit log for all downloads limits for strings in logs start stop threads, moving they in queue and other recursive downloading via ftp recursive downloading via http! mask support for recursive downloading via ftp auto reconnecting and resuming after connections' breaks supporting resuming download http proxy support (such as squid) ftp proxy support (such as wingate) able to set limit amount of threads able to setup limitation of connections to the host able to limit speed of downloading able to setup starting time for any download very configurable nice userfriendly GTK interface saving interface for next session main log for various information which can be writen to file Drag and Drop support from Netscape and various apps able to setup default username and password for any host Ability to run without X interface. Ability to split file to separate parts (up to 10) and download all parts at the same time! Localisation to 15 different languages (16 with English) And more features ... Pavuk is UNIX program used to mirror contents of WWW documents or files. It transfers documents from HTTP, FTP, Gopher and optionaly from HTTPS (HTTP over SSL) servers. Pavuk have optional GUI based on GTK+ widget set. Pavuk tool has this features: recursive downloading based on links inside HTML documents supports CSS and HTML4.0 local tree of documents is similiar to original (located on remote server) transformation of Gopher and FTP directories into HTML document HTML links translation from remote to local or local to remote supports proxy servers (HTTP , FTP , SSL , HTTP gateway for FTP , HTTP gateway for Gopher,SOCKS 4/5) supports authentification against HTTP server and proxy HTTP server have many options to define the set of documents for transfer : limit on server limit on domain limit on prefix limit on suffix limit on document tree level limit on maximal and minimal size of file limit on type of document (as yet only for document transfered via HTTP or HTTPS) matching patterns on URLs and document names and many other does restart of transfer (only when server support it) after program break , link down , timeout or some other error stalled connection should timeout after given period can be run in differend modes : normal - simlpe recursion sync - pavuk looks for newer versions of allready downloaded documnts/files singlepage - download of single document with all inline objects (pictures , backgrounds , sounds , ...) resumereget - looks for documents which transfer were broken and try to download missing parts singlereget - retries to transfer file until is not succesfuly downloaded linkupdate - scans local tree of documents and try to update links inside HTML document when some linked documents are allready downloaded, but it is not reflected in dontstore - used to fetch files to cache/proxy server reminder - used to inform user about changes on remote HTTP servers. can be run on terminal or inside Xwindows window Xwindows interface based on GTK+ toolkit DnD of URLs with GTK+-1.2 fetching URLs from clipboard have Native Language Support based on GNU gettext asynchronous buffered DNS name resolving when runing in X-windows so called dirty FTP proxy support (using CONNECT request to HTTP proxy) can be used as full featured FTP mirroring tool (preserves modification time,permisions , symbolic links, ...) optional transfer speed limitation max./min. very customizable URL - local filename mapping algoritm automaticaly loads copy from Netscape browser cahce if enabled can remove advertisement banners from HTML pages HTTP/1.1 support FTP over SSL supports POST requests an in GTK UI have also dialog for intercative HTML forms filling supports many formats of FTP directory listings (Unix BSD/SYSV, EPFL, Novel, VMS, MS DOS/Windows) optional multithreading support multiple round-robin used HTTP proxies supports javascript via regular expression patterns supports NTLM authorization etc. You can get ports of this apps on ftp://ftp.os2.ru ftp://ftp.os2.ru/incoming/pavuk-0.9pl27os2.zip ftp://ftp.os2.ru/incoming/nt-1-25os2.zip If anyone will place them in any other place it will be cool. P.S. Fellow OS/2 users - if you will not submit bugs or confirmations that app works fine I will not have a wish to continue porting them, I know X apps are just a pain-in-the-butt for many of you, but it works. Btw this apps require GTK 1.2.x it can be found on birdy.hpage.net P.P.S Applications work fine with XWarpzilla Send via OS2.org online news forumlar. ----------- To unsubscribe yourself from this list, send the following message to majormajoratos2voice.org unsubscribe news end If you have an announcement you would like posted to the VOICE News list, please send it to submitatos2voice.org. Please include a valid reply address and a real contact name. If you wish to comment on this post, please reply to feedbackatos2voice.org