Tachyon with Hadoop

hadoop2.2.0 jdk1.7 tachyon0.5.0 No zookeeper

Both Tachyon and Hadoop are pseudo-distributed patterns

1. Modify the Core-site.xml file

<property> <name>fs.tachyon.impl</name> <value>tachyon.hadoop.tfs</value></ Property>

2. Configure hadoop-env.sh

Add an environment variable for the Tachyon client jar package path in the hadoop-env.sh file

Export hadoop_classpath=/home/hadoop/tachyon-0.5. 0-bin/client/target/tachyon-client-0.5. 0-jar-with-dependencies.jar

3. Start the Hadoop cluster

sbin/start-dfs.shsbin/start-yarn.sh

4. Start Tachyon

Tachyon-start.sh Local

5. Performing Mr Jobs

Hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-2.2. 0. Jar wordcount-libjars/home/hadoop/tachyon-0.5. 0-bin/client/target/tachyon-client-0.5. 0-jar-with-dependencies.jar tachyon://hadoop:19998/test/passwd tachyon:// Hadoop:19998/out

6. View Results

Tachyon TFS CAT/out/part-r-00000

Tachyon with Hadoop