Java開發的整個網站下載工具，JoBo
JoBo是一個用于下載整個Web站點的簡單工具。它本質是一個 Web Spider。與其它下載工具相比較它的主要優勢是能夠自動填充form(如：自動登錄)和使用cookies來處理session。JoBo還有靈活的 下載規則(如：通過網頁的URL，大小，MIME類型等)來限制下載。
特性
</div>
- command line and graphical version (but command line version needs a major update, currently the GUI version has much more features)
- recursive search of all documents starting from a given start document
- support of tags (with fault tolerance)
- support of the robot exclusion protocol
- user controlled maximal search depth
- user agent name can be defined
- support of referrer headers
- support of automated form handling (JoBo can fill fields with predefined values)
- cookie support
- XML configuration
- used bandwidth can be limited
- allow/deny downloads by mime type and document size (e.g. ignore all image/* files)
- allow/deny downloads by regular expressions (e.g. don't download /cgi-bin)
- can convert absolute links to relative
- download only files newer then a given age
- resume job </a></ul>
項目主頁：
http://www.baiduhome.net/lib/view/home/1349861484181</p> </div> 本文由用戶 jopen 自行上傳分享，僅供網友學習交流。所有權歸原作者，若您的權利被侵害，請聯系管理員。
轉載本站原創文章，請注明出處，并保留原始鏈接、圖片水印。
本站是一個以用戶分享為主的開源技術平臺，歡迎各類分享！