Scaling Python For Big Data

As global corporate and personal data explode, data itself is replacing software and hardware as the next big "oil field" driving the information technology industry and the global economy. Compared with the fault-type information technology revolution such as PC and Web, the biggest difference of large data is that it is a revolution driven by "open source software". From giants such as IBM and Oracle to big data start-ups, the combination of open source software and big data has produced astonishing industrial subversion, and even VMware's past reliance on proprietary software has embraced big Open-source data ...

"Editor's note" Shopify is a provider of online shop solutions company, the number of shops currently serving more than 100,000 (Tesla is also its users). The main frame of the website is Ruby on rails,1700 kernel and 6TB RAM, which can respond to 8,000 user requests per second. In order to expand and manage the business more easily, Shopify began to use Docker and CoreOS technology, Shopify software engineer Graeme Johnson will write a series of articles to share their experience, this article is the department ...

Now almost any application, such as a website, a web app and a mobile app, needs a picture display function, which is very important for the picture function from the bottom up. Must have a forward-looking planning picture server, picture upload and download speed is of crucial importance, of course, this is not to say that it is to engage in a very NB architecture, at least with some scalability and stability. Although all kinds of architecture design, I am here to talk about some of my personal ideas. For the picture server IO is undoubtedly the most serious resource consumption, for web applications need to picture service ...

Initially, the platform, the service vendor, establishes its own market differences based on the language it supports, such as Java or. NET, but in the end they continue to evolve to support multiple languages and, ultimately, the infrastructure that serves to support data storage, messaging, application services, and mobility. The market provides a variety of PAAs for developers. Although it seems that PAAs vendors are very similar, but there are many differences. Consider the types that can be controlled, and if so, developers can configure them on the infrastructure. Ideally, PAAs vendors manage all of the implementation ...

PaaS (Platform-as-a-service) is a kind of cloud service, the service provider not only provides on-demand hardware and operating system services, but also provides the application platform and solution stack. For developers, PAAs greatly reduces the cost and pain of it deployments, providing resources for applications to scale more easily as needed. JVMs, application servers, and deployment packages (for example, war and ear) provide natural isolation for Java applications, allowing different developers to deploy applications in the same infrastructure, so JAV ...

Many business owners with only more than 10 to dozens of employees ask if they don't want to spend thousands or even million to buy a database software and ask if there are any free database software available. In fact, there are a lot of small business owners in this type of enterprise, their company needs a small database software to statistics the company's some product data and the information of the storage, the amount of data is really small. As I've seen before, some small businesses use office-brought access small databases, but still feel less convenient. Here, the editor recommends several open source databases for small business use ...

We strive to innovate and provide developers with a diverse platform to build the best cloud applications and provide them to customers around the world at the first time. Many new applications are "modern applications" that are always web-based and can be accessed through a variety of mobile devices.  Today, with the official release of the Windows Azure Mobile service and the Windows Azure Web site (GA), we have taken a big step towards that goal. Windows Azure Mobile Service mobile service accelerates and simplifies ...

These companies from a variety of angles, multi-form development of cloud computing software is a stage for developers to build a cloud strategy that provides cloud-based development and application scaling, or infrastructure management, to deploy and manage applications, or provide an open source software and hardware-integrated application development platform. 　　There are many ways to build a cloud-computing platform, and here are some of the most compelling vendors. 　　Let's focus on the world's top 20 most cool cloud computing platform vendors! 1, ActiveState Activestat ...

I had a great conversation with Frans Bouma on Twitter, and he asked me a series of questions about the price of the cloud, but it was hard to answer it within 140 words. The pricing of the cloud is not very clear and difficult to figure out, because it's a complicated wife. Frans wants to transfer the site of their products to Microsoft and computing platform Azure, but he thinks it's too expensive for a website. That's a good question. This is my own questions and answers about Azure sites and pricing, and I often get emails from everyone about similar puzzles ...

VMware suddenly released its first open source Paas--cloudfoundry this April. In the months since its release, the author has been concerned about its evolution and benefited from its architectural design, and felt the need to write to share it with you. This article will be divided into two parts: the first part mainly introduces the architecture design of Cloudfoundry, from the module that it contains, to the information flow of each part, how the modules coordinate and cooperate; The second part will be based on the first part, how to use Clou in your data center ...