Cloud Informations

Alibaba Group Computing Conference 2017 focuses on cloud computing, artificial intelligence and more. Alibaba upgrades its operating system strategy to focus investment on the burgeoning Internet-of-Things (IoT) sector.

That's a scene displayed at the Computing Conference 2017, held in east China's Hangzhou City and hosted by Alibaba Group, a Chinese e-commerce giant.

Nearly 50,000 visitors are expected at a computing conference 2017 is hosted by Alibaba Group, a Chinese e-commerce giant, which is held in East China's Hangzhou city.

Minikube use go language writing, stand-alone version of the Kubernetes cluster, installation Minikube toss for 2 days, various errors. Installation steps: 1. Download Minikube and set #curl-lo minikubehttps://storage.googleapis.com/minikube/releases/v0.7.0/ minikube-linux-amd64&& chmod +x Minik ...

1. Single-node running bin/spark-sql--master spark://bigdata01.hzjs.co:7077--executor-memory 40g--total-executor-cores Spark.sql.warehouse.dir=hdfs://bigdata01.hzjs.co:8020/user/sparksql--conf Spark ...

1. Prepare to work, after installing good habse, execute hbase Shell create ' table name ', ' column name 1 ', ' Column Name 2 ', ' Column name n ' create ' table name ', ' column family name ' in HBase column can be dynamically added, only need to have a row family on it Create ' Test_lcc_person ', ' Lcc_liezu ' and then add some data key the same is a piece of data, a total of 6 data put ' table name ', ' Rowk ...

Starting the Spark application Bin/spark-submit script with Spark-submit is responsible for building the CLASSPATH (classpath) that contains spark and its dependencies, which supports different cluster managers and the load modes supported by Spark. /bin/spark-submit \--class--master \--deploy-mode \--conf = \ ... # Other options \ [Applic ...

1. Submit task instructions (I have configured the SPARK-SUBMIT environment variable) spark-submit--class org.apache.spark.examples.SparkPi--master spark:// 192.168.12.233:7077--executor-memory 10G--total-executor-cores Fielname explained as follows: (1) –cla ...

General procedures have problems can be through the log or thrown out of the anomaly to find the reason, but today encountered this problem let me this novice feel very tricky, because the program did not complain, the log did not show errors, the card died, finally in the teacher's help to solve the problem. I built the distributed hbase, not the pseudo distributed, and the problem is in the Java program I use the same as the pseudo distributed configuration method configuration distributed, the code is as follows: Conf.set ("Hbase.zookeeper.quorum", ...

This algorithm is used for clustering to give you some data, their properties have been digitized, you do so to them clustering? K is doing this. In fact, as long as a piece of data is digitized, you can think of them as a point. We look at these records as a point group. We classify some things, in fact, to see their distance, is the so-called birds of a feather flock together. For example, we want to cluster them into 3 categories, we can randomly select three different points, and then each test data with the three points of distance, this test data and three points at which distance recently ...

Docker study notes one. Update kernel, upgrade kernel to 3.x two. Install docker:rpm--import/etc/pki/rpm-gpg/rpm-gpg-key-epel-6 yum-y install Docker-io three. Start Docker:service Docker start Chkconfig Docker on four. Download base Mirror: Docker Pull Centos:lat ...

1. Neural network This is a common neural network diagram: This is a common three-layer neural network of the basic composition, Layer L1 is the input layer, Layer L2 is the hidden layer, Layer L3 is the hidden layer, when we enter data such as X1,X2,X3, through the hidden layer of calculation, conversion, Output your expectations, when your input and output are the same, become the encoding Model (Auto-encoder), and when you input and output is inconsistent, that is, we often say the artificial neural network. 2. How to calculate the transmission ...

Reducebykeyandwindow This operator is also lazy, it is used to calculate the data in an interval, the following figure: screenshots from the official website, for example, each square represents 5 seconds, the above dotted box is 3 windows is 15 seconds, here 15 seconds is the length of the window, Where the dash to the solid line moved 2 squares for 10 seconds, here 10 seconds for every 10 seconds to calculate the window length of the data for example: The following figure I understand this: if this is the use of window function calculation WordCount ...

fatal error: json-c / json.h: No such file or directory --- Solution: sudo apt-get install libjson-c-dev Then re-run. / Autoconf. / Configure make

Hadoop Archives Guide Overview Hadoop archives is an archive. According to the official website, a Hadoop archive corresponds to a file system directory. So why do we need Hadoop Archives? Because hdfs is not good at storing small files, files are stored as blocks on hdfs, which store their metadata and other metadata in the namenode, which is loaded into memory after the namenode is started. if it exists...

Overview 2.1.1 Why a Workflow Dispatching System A complete data analysis system is usually composed of a large number of task units: shell scripts, java programs, mapreduce programs, hive scripts, etc. There is a time-dependent contextual dependency between task units In order to organize such a complex execution plan well, a workflow scheduling system is needed to schedule execution; for example, we might have a requirement that a business system produce 20G raw data a day and we process it every day, Processing steps are as follows: ...

Azkaba built-in task types support command, java Command type single job example 1, create a job description file vi command.job command.job type = command command = echo 'hello 2, the job resource file is packaged into a zip file zip command.job 3, through the azkaban web management platform to create a project and upload the job archive first create pr ...

Recently, the second China Cloud computing user Congress nationwide roving seminar held in Nanjing, a number of industry experts to explore the cloud and large data based on urban management. 　　Reporter learned from the meeting, Nanjing in the traffic management, urban security and other fields have with cloud computing and large data depth integration, intelligence level is located in the forefront of the country. "The current city-wide traffic supervision, security surveillance camera generated video data stream all concentrated in the wisdom of the Nanjing Data Center." "China Cloud computing Experts Advisory Committee Secretary General Peng told reporters that the use of cloud computing technology, can achieve the precision of the number of cars ...

Absrtact: Today's network game market is booming, showing a flourishing momentum. In the first quarter of 2013 China's online gaming market reached 18.59 billion yuan, an increase of 21.7%, which allows a large number of developers to the game industry. The vast money also let today's network game market, showing a booming momentum. In the first quarter of 2013 China's online gaming market reached 18.59 billion yuan, an increase of 21.7%, which allows a large number of developers to the game industry. The broad "money" also let the game industry fight more ...

Absrtact: After the industry has repeatedly Jin Shanyun a round of financing news finally settled, today Jin Shanyun officially released news, said that has been obtained from well-known Internet investors Yuri Milner received a 20 million dollar a round of investment. This is so far in the field of domestic cloud computing before the industry many times Jin Shanyun a round of financing news finally settled, today Jin Shanyun officially released news, said that has been obtained from well-known Internet investors Yuri Milner received a 20 million dollar a round of investment. This is the domestic cloud computing field to date ...