free web crawler, if use together with Search engine builder -lexst-SEA, you can index 10 billion pages.Multi threads and distributed free web crawler, for both internet and interanet.You can control how frequency the spider should crawl your pages,
© 1999-2024 Shareware Junction. All rights reserved. Shareware Junction Network is your source for Shareware, Freeware, Demos, Betas and Pre-Releases. This is the place to come for a first look at the hottest new software. Shareware companies need your support. Beta testing is a unique opportunity to try the latest programs and provide feedback directly to the program developers. The final version of many programs is often determined by suggestions from testers like you. Shareware Junction lets you choose from a variety of these products - all in one convenient location. Use of this site subject to Terms and Privacy Policy