Read Apache Log

Flume-based Log collection system (i) architecture and Design Issues Guide: 1. Flume-ng and scribe contrast, flume-ng advantage in where? 2. What questions should be considered in architecture design? 3.Agent crash how to solve? Does 4.Collector crash affect? What are the 5.flume-ng reliability (reliability) measures? The log collection system in the United States is responsible for the collection of all business logs from the United States Regiment and to the Hadoop platform respectively ...

Apache Hadoop and MapReduce attract a large number of large data analysis experts and business intelligence experts. However, a wide range of Hadoop decentralized file systems, or the ability to write or execute mapreduce in the Java language, requires truly rigorous software development techniques. Apache Hive will be the only solution. The Apache Software Foundation Engineering Hive's database component, is also based on the cloud Hadoop ecosystem, provides the context based query statement called Hive query statement. This set of ...

By default, you need to create the directory public_Html in your user's home directory, then put all your web files in this directory, type in http: // servername / ~ username, but please pay attention to the following Point: 1. Login as root, modify the user home directory permissions (# chmod 705 / home / username), so that other people have the right to enter the directory browsing. 2. Login with your own username, create a public_html directory, to ensure that the ...

By default, you need to create the directory public_Html in your user's home directory, then put all your web files in this directory, type in http: // servername / ~ username, but please pay attention to the following Point: 1. Login as root, modify the user home directory permissions (# chmod 705 / home / username), so that other people have the right to enter the directory browsing. 2. Login with your own username, create a public_html directory, to ensure that the ...

Apache Cassandra is a highly performance, scalable, distributed NoSQL database with a flexible, simple partitioned row storage data model that can be used to deal with commercial servers and massive data storage across data centers without a single point of failure. It was originally developed by Avinash Lakshman (Amazon Dynamo developer) and Prashant Malik on Facebook to address their inbox-search problems, then officially open source in July 2008, and since then ...

The intermediary transaction SEO diagnose Taobao guest Cloud host Technology Hall search engine can bring a considerable antecedents to the website, so the search engine is very important to a website's collection, this does not need to say more. 　　But we are generally not quite sure when the search engine spiders first came to our website, it is not clear that the first time after the spider followed the frequency and so on. From the front end of the search engine, you can see through the snapshot (cache) search engine on the site of a certain page of the time, but this search engine for the whole station crawl situation can not be very good statistical understanding. ...

Apache Pig, a high-level query language for large-scale data processing, works with Hadoop to achieve a multiplier effect when processing large amounts of data, up to N times less than it is to write large-scale data processing programs in languages ​​such as Java and C ++ The same effect of the code is also small N times. Apache Pig provides a higher level of abstraction for processing large datasets, implementing a set of shell scripts for the mapreduce algorithm (framework) that handle SQL-like data-processing scripting languages ​​in Pig ...

Summary Today we only talk about the code to read the method, do not carry out those complicated technical implementation in Spark. Surely we all know that Spark was developed using scala, but because of the large number of syntactic sugars in scala, code often follows and discovers clues. Second, Spark interacts with Akka based on how to know who Recipient it? new Throwable (). printStackTrace In the code following, we often rely on the log, and ...

The Web server encountered a strange problem, in the running of many apache2 processes, there will be a process, slowly fill the full memory, and then the machine is like dead, write an automatic check script, check and kill the problem of the apache2 process, the issue is mitigated, but not resolved, Because it slowly fills up the memory, Linux releases the HDD cache and periodically has performance degradation. Using RLIMITMEM parameters to limit memory, also does not work, bw_mod limit traffic also does not work today modified the script, ...

The .htaccess file allows us to modify some server settings for a particular directory and its subdirectories. Although this type of configuration is best handled in the section of the server's own configuration file, sometimes we do not have permission to access this configuration file at all, especially when We are on a shared hosting host, and most shared hosting providers only allow us to change server behavior in .htaccess. .htaccess file is a simple text file, note the "." before the file name is very important, we can use your favorite text editor ...