Smart and Simple Web Crawler

Smart and easy framework thats crawls a web site

Homepage POM file JAR file Javadoc

'com.torunski.crawler:crawler:0.6.0'

<dependency>
	<groupId>com.torunski.crawler</groupId>
	<artifactId>crawler</artifactId>
	<version>0.6.0</version>
</dependency>

<dependency org="com.torunski.crawler" name="crawler" rev="0.6.0"/>

"com.torunski.crawler", "crawler", "0.6.0"

Dependencies

Compile dependencies

backport-util-concurrent » backport-util-concurrent » 2.2 (optional)
commons-codec » commons-codec » 1.3
commons-httpclient » commons-httpclient » 3.0.1
commons-logging » commons-logging » 1.1
org.apache.lucene » lucene-core » 2.0.0 (optional)
org.apache.lucene » lucene-demos » 2.0.0 (optional)
org.htmlparser » htmlparser » 1.6 (optional)

Runtime dependencies

log4j » log4j » 1.2.9 (optional)