Lao Li shares: Java and Hadoop relationships in big data testing

The founder of Hadoop is Doug Cutting, and also the founder of the famous Java-based search engine library Apache Lucene. Hadoop was originally used for the famous open source search engine Apache Nutch, and Nutch itself is based on Lucene, and is also a sub-project of Lucene. So Hadoop is Java-based, soHadoop is written by Java .

Hadoop is written in Java, so Hadoop natively supports Java language authoring, but in real-world applications, it is sometimes possible to use a third-party library for non-Java or other reasons to write MapReduce jobs in C + + or other languages. Some of the tools provided by Hadoop may be used at this time.

If you want to write a mpareduce job in C + +, the tools you can use are Hadoop streaming or Hadoop Pipes.

If you want to write a mapreduce job in Python, you can use Hadoop streaming or pydoop.

If you want to use a different language, such as Shell,php,ruby, you can use Hadoop streaming.

Lao Li shares: Java and Hadoop relationships in big data testing