a16z 7.5 million USD investment in Distributed File system Tachyon

Absrtact: According to WSJ News, Tachyon has won the Silicon Valley VC a16z 7.5 million dollar a-round investment. A16z's general partner, Peter Levine, joined the Tachyon board. According to the introduction of the project's official website, Tachyon is a memory-centric distributed file system capable of

According to WSJ News, Tachyon has won a 7.5 million dollar a-round investment in Silicon Valley's VC a16z. A16z's general partner, Peter Levine, joined the Tachyon board.

According to the project's official website, Tachyon is a memory-centric distributed file system that can provide a reliable memory-level file sharing service for cluster frameworks such as Spark, MapReduce, Java-like file APIs, compatible Hadoop MapReduce and Spark, the underlying file system pluggable features.

Tachyon first appeared to address the following issues:

Large data analysis pipeline data sharing through the disk file system (HDFS, etc.) performance is relatively slow, the large data computing engine processing process (spark executor,mapreduce child JVM, etc.) after the crash, the cached data will be lost all; Memory-based systems store data redundancy, and too many objects can cause the Java GC to be too long.

The overall architecture of the tachyon is shown in the following illustration (to learn Tachyon)

It is reported that the Tachyon project was released at the end of 2012, the AMP lab, which was hatched from UCLA Berkeley, was founded by a computer in Dr. Li Haoyuan, Tachyon is also a PhD candidate in Li Haoyuan. In an interview with INFOQ, Li Haoyuan said

In the long run, like Apache Mesos and Apache Spark, we enter the Apache Software Foundation. More developers are welcome to join.

Currently, the Open-source project has attracted more than 70 contributors from more than 30 companies. including Yahoo, Red Hat, Intel and EMC, EMC has tried to integrate Tachyon in its flash products DSSD, Isilon. Founder Li Haoyuan said that Tachyon's commercial software was being developed, and there was no time for an exact release.

It is noteworthy that a16z also invested in large data start-ups Adatao, Mesosphere, databricks and so on, to the emerging large data areas, data analysis software optimistic. These companies, like Tachyon, are linked to the AMP labs.