Nutch is an open-source Java-implemented search engine

Source: Internet
Author: User
Tags java open source projects

Nutch is an open source Java-implemented search engine. It provides all the tools we need to run our own search engine. Includes full-text search and web crawlers.

Nutch's founder is Doug Cutting, who is also the founder of Lucene, Hadoop and Avro Open source projects.

Nutch was born in August 2002 and is a Java-implemented open source search engine project by Apache, Since the Nutch1.2 version, Nutch has evolved from a search engine to a web crawler, then nutch further evolved into two major branches: 1.X and 2.X, the biggest difference between these two branches is 2.X of the underlying data storage is abstracted to support a variety of underlying storage technology.

During the evolution of Nutch, Hadoop, Tika, Gora, and crawler Commons four Java open source projects. Today, these four projects are fast-growing, extremely hot, especially Hadoop, which has become a de facto standard for massive data processing. Tika uses a variety of existing open source content resolution projects to extract metadata and structured text from multiple formats of files, Gora supports persisting big data to a variety of storage implementations, and Crawler Commons is a common web crawler component.

Nutch is committed to making it easy for everyone to configure world-class web search engines at a fraction of the cost. To accomplish this ambitious goal, Nutch must be able to:

  • Take billions of pages per month

  • Maintain an index for these pages

  • Thousands of searches per second for index files

  • Provide high-quality search results

  • operate at minimal cost

online Javadoc:http://tool.oschina.net/apidocs/apidoc?api=nutch2.0

Nutch is an open-source Java-implemented search engine

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.