Not just storage large data analysis can also be transferred to the cloud

Source: Internet
Author: User
Keywords Indicates that large data analysis through virtualization

Can you imagine storing data in a cloud and running complex queries and analyses of data without needing to move data? This is a problem that the High-performance cloud computing infrastructure and large data analysis company Joyent tries to solve through its new Joyent Manta Storage Service.

Manta is the next generation cloud computing object storage and data service platform designed to bring computing and analytics capabilities directly into the cloud's customer data.

"The killer app for personal computers is spreadsheets," says Bryan Cantrill, vice president of engineering at Joyent (who spent three years concentrating on manufacturing Manta), saying that "the reason the electronic representation is a killer application is because it blends data and computing, which allows business people to run data on their desktops, And they don't need a time-sharing program to do this. ”

Cloud computing combines two pillars of technology-data and networks-and now manta a step further.

Manta is the cloud computing spreadsheet?

"I think Manta is a spreadsheet in cloud computing," Cantril says. "It opens up a new picture of the analysis of unstructured data." What we're doing is combining computing with data and networks, and we're merging these three into a single facility. These three are unified into a single product that will form the ' Holy Trinity ' of computing, networking and data. ”

By eliminating the need to manage infrastructure and mobile data, Cantrill says, Manta allows businesses to process large data faster and more easily, while keeping the data safe and on par with Amazon's public cloud.

"If your product is not competitive in price, you really can't bring the product to market," he says. "We think there's more to the competition than the price, but in the beginning, you can't overestimate the price of the product." You will pay for the storage of S3 price, also, you will pay for EC2 or joyent infrastructure, or services, for any calculation that accelerates your data, and you may start for a second, two seconds, or three seconds, and if so, you only have to pay a second, two second, and three second calculation. ”

For example, you may want to perform regular validation checks on your backups. You don't usually do that because it will mean dragging all your backups back to the calculations. However, with Manta, this validation test will be very simple, you only need to start the calculation on the backup (they only exist a few subtle).

Manta allows you to perform a number of computational tasks, including log analysis, search index generation, financial analysis, and other data-intensive tasks without the need to move data or set up compute clusters and processing software. Cantrill explains that the code is introduced in parallel to the physical servers within the security container, while the data is automatically merged through industry-standard mapreduce patterns.

No need to replicate data from storage to compute clusters

Konstantin Gredeskoul, chief technology officer for online shopping community Wanelo, says it can take several hours to copy data from storage to a compute cluster.

Gredeskoul says: "Joyent Manta storage services allow businesses to perform near-instantaneous ad hoc queries and analysis without the need to move data, which is seamless and cost-effective." We are now able to perform complex queue analysis and build retention reports on hundreds of GB of data within minutes. When you compare this to the traditional methods of data warehousing, this is very much more of a reform. ”

"50% of the world's smartphone traffic through Ericsson, we are constantly evaluating new technologies to improve the ability of the network to manage growing data while ensuring security, confidentiality, and cost-effectiveness," said Vish Nandlall, head and CEO of Ericsson Strategy and marketing. Joyent Company New Computational storage innovation is a fundamental paradigm shift that changes the economics and practicality of object storage and high-performance large data analysis. ”

The Joyent Manta Storage Service provides the following features:

Multi-Datacenter object storage with fine-grained replication control there is no object size limit very consistent write and highly available read each object replication policy file system style namespace, including directory query Manta functionality originating from operating system-level virtualization

Cantrill points out that joyent implements these functions primarily by focusing on OS-level virtualization rather than focusing on hardware virtualization. Operating system virtualization allows Joyent to start calculations on the object's Internet-facing object storage.

"If you need to support traditional operating systems, virtual hardware is very powerful," he says, "but if you want to provide customers with the highest level of performance experience, you can't virtualize hardware, you should virtualize the entire operating system." The application runs directly on the hardware and is in a secure and sealed manner. ”

"You can effectively bring your analytics tools into the cloud," he adds, "You could run any program you want on your data: Java, Python, Perl, or just a Unix Shell." If you have your own analysis tools or other tools, or if you have any analysis software, you can push them into the cloud and analyze the target data. ”

Joyent has now established a partnership with data storage management company Panzura to help customers safely migrate their data from existing NAS, backup, and archive storage to Manta.

Related Article

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.