A crawler framework. It covers the whole lifecycle of crawler: downloading, url management, content extraction and persistent. It can simply the development of a specific crawler.
Homepage POM file JAR file Javadoc'us.codecraft:webmagic-scripts:0.4.2'