webmagic-parent

A crawler framework. It covers the whole lifecycle of crawler: downloading, url management, content extraction and persistent. It can simply the development of a specific crawler.

Homepage POM file JAR file Javadoc
'us.codecraft:webmagic-parent:0.4.3'

Dependencies

no dependencies