Home > Internet > Online Trends

Deferred deserialization: A way to improve the performance of MapReduce programs

Source: Internet
Author: User
Keywords Deserialization parallel computing extra
Tags computing cost data data type framework hadoop high integrated
Developer on Alibaba Coud: Build your first app with APIs, SDKs, and tutorials on the Alibaba Cloud. Read more ＞

Deferred deserialization: A way to improve the performance of MapReduce programs

Jia

Based on the MapReduce parallel Computing framework provided by Hadoop, the user can realize parallel computation conveniently. Typically, the user resolves the input data into a string delimited by a particular delimiter in the MapReduce program, and the cost of deserialization and serialization is too high, and the conversion of the data type during the calculation can incur additional overhead. In this paper, a delay deserialization technology is integrated into the MapReduce program, and the performance of the MapReduce program is improved obviously. The core of this technique is to deserialize a specific field in a record into a corresponding Java object only when necessary.


Deferred deserialization: A way to improve the performance of MapReduce programs

This article is an English version of an article which is originally in the Chinese language on aliyun.com and is provided for information purposes only. This website makes no representation or warranty of any kind, either expressed or implied, as to the accuracy, completeness ownership or reliability of the article or any translations thereof. If you have any concerns or complaints relating to the article, please send an email, providing a detailed description of the concern or complaint, to info-contact@alibabacloud.com. A staff member will contact you within 5 working days. Once verified, infringing content will be removed immediately.

Related Keywords:
how to improve the sql query performance how to improve performance of views in sql server how to improve performance of java web application how to improve java performance how to improve android performance how to improve sql performance how to improve server performance
Related Article
Getting Started with CDN
Front-end Must Learn: CDN Acceleration Principle
Elements of CDN Network
Cloud Security Issues Derived from the Development of Cloud C...

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

Hot Article
Hot Tags
computing conference access forum computer class data get http html applications
Popular Keywords
about the cloud a forums a http and sign a websites am i black listed a firewall a dota a application an express

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

Get Started for Free

  • Sales Support

    1 on 1 presale consultation

    Chat Contact Sales

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

    Open a Ticket

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.

    Learn More