Apache Nutch

Nutch is open source web-search software. It builds on Lucene and Solr, adding web-specifics, such as a crawler, a link-graph database, parsers for HTML and other document formats, etc.

Homepage POM file JAR file Javadoc

'org.apache.nutch:nutch:2.0-dev'

<dependency>
	<groupId>org.apache.nutch</groupId>
	<artifactId>nutch</artifactId>
	<version>2.0-dev</version>
</dependency>

<dependency org="org.apache.nutch" name="nutch" rev="2.0-dev"/>

"org.apache.nutch", "nutch", "2.0-dev"

Dependencies

Compile dependencies

com.healthmarketscience.sqlbuilder » sqlbuilder » 2.0.6
com.ibm.icu » icu4j » 4.0.1
commons-codec » commons-codec » 1.3
commons-collections » commons-collections » 3.1
commons-httpclient » commons-httpclient » 3.1
commons-lang » commons-lang » 2.4
log4j » log4j » 1.2.15
org.apache.hadoop » avro » 1.3.2
org.apache.hadoop » hadoop-core » 0.20.2
org.apache.lucene » lucene-core » 3.0.2
org.apache.lucene » lucene-misc » 3.0.2
org.apache.solr » solr-solrj » 1.4.1
org.apache.tika » tika-core » 0.7
org.apache.tika » tika-parsers » 0.7
org.gora » gora-core » 0.1
org.gora » gora-sql » 0.1
org.hsqldb » hsqldb » 2.0.0
org.jdom » jdom » 1.1
org.mortbay.jetty » jetty-client » 6.1.22
org.slf4j » slf4j-log4j12 » 1.5.11
oro » oro » 2.0.8
xerces » xercesImpl » 2.6.2
xerces » xmlParserAPIs » 2.6.2

Test dependencies

junit » junit » 3.8.1
org.apache.hadoop » hadoop-test » 0.20.2
org.mortbay.jetty » jetty » 6.1.22
org.mortbay.jetty » jetty-util » 6.1.22