Big Data

The Juniper Network introduces a new architecture: Metafabric, which combines exchange, routing, and software to build a comprehensive approach to data centers and cloud networks. Http://www.aliyun.com/zixun/aggregation/13534.html, senior analyst Andre Kindness of >forrester Research, says the new data Center architecture is no longer limited to the network industry's " Short-sighted "approach," All programs are ...

The small Mac mini computing performance can exceed the 1636-node http://www.aliyun.com/zixun/aggregation/14119.html ">hadoop cluster, Even in some use cases it sounds more like an Arabian tale, but Graphchi recently claimed to have done it. 　　To make a long story short, before we look at this feat, we need to understand Graphlab's Graphchi. Graphchi ...

Hadoop serialization and Writable Interface (i) introduced the Hadoop serialization, the Hadoop writable interface and how to customize your own writable class, and in this article we continue to introduce the Hadoop writable class, 　　This time we are concerned about the length of bytes occupied after the writable instance was serialized, and the composition of the sequence of bytes after the writable instance was serialized. Why to consider the byte length of the writable class large data program ...

For the open source technology community, the role of committer is very important. Committer can modify a piece of source code for a particular open source software. According to Baidu Encyclopedia explanation, committer mechanism refers to a group of systems and code is very familiar with the technical experts (committer), personally complete the core module and system architecture development, and lead the system Non-core part of the design and development, and the only access to code into the quality assurance mechanism. Its objectives are: expert responsibility, strict control of the combination, to ensure quality, improve the ability of developers. ...

Serialization serialization (serialization) is the process of converting a structured object into a byte stream so that it can be transmitted over a network or written to a hard disk for permanent storage, and a relative deserialization (deserialization) refers to the flow of bytes back to the structured object. In a distributed system, the process serializes objects into a byte stream, travels over the network to another process, and another process receives a stream of bytes, which, by deserializing, returns to the structured object to achieve interprocess communication. In Hadoop, Mapper,combi ...

Figure 5. Biginsights Web Management interface in the Biginsights Web management interface Click on the "Cluster Status" page, you can implement the http://www.aliyun.com/zixun/aggregation/13713. 　　HTML ">hbase, zookeeper, and other module status monitoring, starting and stopping. Top left of Cluster Status page ...

In the large data age, the Hadoop distributed processing architecture brings new life and challenges to it, data management, and data analysis teams. 　　With the development and expansion of Hadoop ecosystem, enterprises need to be ready for the rapid upgrading of technology. Last week, the Apache Software Foundation just announced a formal GA for Hadoop 2.0, a new version of Hadoop that will bring a lot of change. With HDFs and java-based MapReduce as core components, the early adopters of Hadoop ...

In http://www.aliyun.com/zixun/aggregation/13713.html ">hbase:the definitive Guide, Lars George introduced a new feature of HBase Counter Increment, which uses a column as a Counter, makes it easy to provide real-time statistical functionality for some online applications. PS: For example, post ...

HBase as an open source implementation of BigTable, with the popularization of its application, more and more enterprises are applied to mass data system. This article will brief readers on the basics of Apache HBase and expand on IBM's HBase enhancements and extensions, HBase Master Multi-node high-availability support, and how to leverage IBM Biginsights for HBase in the IBM Hadoop cluster Service and job submission for monitoring and management. This article ...

Data Warehouse software and hardware provider Teradata released the third-quarter earnings, the quarter Teradata profit of 98 million U.S. dollars, or 59 cents per share, a total income of 666 million U.S. dollars, a 3% increase year-on-year. 　　Teradata has previously issued a warning that its sales and profitability will be lower than expected. Teradata said Hadoop had little impact on its business Teradata chief executive Mike Koehler said Teradata would continue to invest in large data analysis and integrated marketing tools, but ...

[Recommended] Open Source ETL Tools Kettle Kettle is a foreign open source of ETL tools, pure Java writing, green without installation, data extraction efficient and stable data ... Recommended] MySQL Workbench MySQL Workbench is a er/database modeling tool designed for MySQL. 　　It is a famous database Designer ... [Recommended] Database management tools Navicat Lite Navicattm is a fast, reliable and affordable ...

Tuning experience for Hadoop virtualization (1) Planned initial scale: clustering is associated with data center infrastructure and configuration, and it is recommended that users start small clusters, such as 5 or 6 servers, to deploy Hadoop in the first place when it is difficult to predict the environment. Then run the standard Hadoop benchmarks to understand the characteristics of your data center. 　　Then incrementally add resources such as servers and storage as needed. (2) Select server: CPU recommended not less than 2 * Quad-core and activate HT (Hyper-http ...)

Cloudera's idea of Hadoop as an enterprise data hub is bold, but the reality is quite different. 　　The Hadoop distance has a long way to go before other big data solutions are eclipsed. When you have a hammer big enough, everything looks like nails. This is one of the many potential problems that Hadoop 2.0 faces. For now, the biggest concern for developers and end-users is that Hadoop 2.0 has massively modified the framework for large data processing. Cloudera plans to build Hadoop 2.0 ...

The author Marc Fasel is a senior advisor, architect, http://www.aliyun.com/zixun/aggregation/6434.html > software developer. He has 18 years of experience building large, high-performance enterprise apps. In this article, he node.js the test process, the results, the conclusions, and the performance difference between the two by doing a test (performance test on the app and Java Server app).

Hadoop and other applications that consume different types of resources deploy http://www.aliyun.com/zixun/aggregation/6267.html "> Shared data Center can improve overall resource utilization; 　　Flexible virtual machine operations enable users to dynamically create, expand their own Hadoop clusters based on datacenter resources, or reduce current clusters and release resources to support other applications if needed; With the HA, FT integration provided with the virtualization architecture, avoid ...

This is from the Ali technology Carnival of a share, because in Baidu also considered similar things, so listen to more sentiment, here the relevant content to tidy up.　　First respect the copyright, or the original link and the author affixed: Http://adc.alibabatech.org/carnival/history/schedule/2013/detail/main/286?video=0 From the Ali Wuwei engineers to share first need to illustrate a point, across the engine room Hadoop can ...

October 30, 2013, SAP announced that http://www.aliyun.com/zixun/aggregation/13659.html ">hana memory database added four new applications for customer capacity collection, 　　The other is a rogue management application. 　　SAP said that the software can be applied to production-oriented or direct-deployment enterprises, to Hana Enterprise Cloud Service model to the SAP HANA Market, free trial for 30 days. The news is that ...

The procedure is actually very simple, but the document is not very detailed, leading to the whole process of exploration, to organize a share for everyone. 　　1, download URL: HTTP://GIT.APACHE.ORG/2, the necessary software maven this need to note, do not download the latest 3.1.1, but download the 3.0.5, because 3.1.1 a bug can cause trouble. 　　This is the Red Hat, IBM does not use the latest version of the reason, known as stable in fact there are major bugs. Http://ji ...

In software engineering, the term refactoring code usually refers to modifying the source code without altering the external behavior of the code. Software refactoring needs to be done with tools, and refactoring tools can modify the code and modify all the places that reference the code. 　　This article collects five excellent PHP code refactoring tools to help you improve your project. 　　1. Rephactor Rephactor is a command-line refactoring tool, an automated tool that allows developers to modify the source code in a different codebase in a concise way. Main function: ...

Http://www.aliyun.com/zixun/aggregation/13461.html ">mongodb also has many areas to improve, such as global write locks (now just a database-level write lock). 　　This article focuses on how to scale to cope with large data, where the volume of large data is 100GB. It will be more meaningful when you look at the implementation of the underlying storage. Basically, MongoDB consists of a bunch of Bson document MMAP (Memory-mapped) lists, which ...