2014 Summary of C#web to the big data Hadoop platform

The floating is the water, the rise and Fall is the life.

Smoking a cigarette First ~ ~ (all the students know I do not smoke ha, this, haha, thinking of life or will take root) just and the students after dinner from the Riverside Road back, I and he are generally talking about their own situation. I live with him not far away from work very close, but also do not often meet, but need the other side of the time to make a phone call, always in a phone after a timely appearance in front of you (like the base of friends, sin, sin). This is necessary, I and he is also a kind of past life to repair the fate of it, know immediately nearly 10 years, college students, I was his only here, he is my only here, perhaps the rest of my life still have to go down, The frustrations of life we witnessed each other (how does this TM write more like a love letter that can't be sent out?) Stop, too sensational!!! ）。 In 2014 he did not arrive at his expectations, thinking he was loser. Each person at the end of the year more or less will give their own in the past a cent. I, no exception, also want to review my past year.

The plan for 2014 was to learn a driver's license and what it was (self-brain). But the plan of life will never catch up with change. Finally completed in 2014 is the examination of the driver's license and job adjustments.

When it comes to driving licences, I feel like I'm a genius.-~~ (pretending to be a b won't be hacked?) At the end of 2014, the driver's license was obtained by lightning-alarm. Took 3 months time, reported a VIP, spent 8K, all one shot, no retake. (a bull's fork?) In my mantra, these are scum.

And speaking of my work, I can say a few days and nights.

       before the Chinese New Year, the leadership at the end of the year to find all the staff to talk, I was on the web side walked for 4 years, feel that they really do not have any motivation to move forward, I feel that all the things on the web side have mastered , I think it is very good (in fact, TM I just a do not know the HTTP protocol, do not understand the socket protocol, do not understand the principle of operating systems, do not understand the principles of the database, do not understand the algorithm of a parallel code farming, how much water, there is more water, the real level of the fighter, not modesty), So the leader said to the bottom of the structure to do data mining or big data platform maintenance and development, then the leadership gave me to the application system layer (in fact, I think they were thinking from a web to the bottom, whether from the language (development language), platform (operating system) or thinking (programming ideas) or anything else, To tell the truth is really not a level, because companies need to spend energy and money to accompany, this in any company is not willing, unless you are a graduate). So after the conversation, I was the first feeling is that the rest of my youth can only be in this street can find a substitute for your position to grind down? Jump bad, in fact, in the Web, you are in Chongqing or any other city, it has a ceiling, there is a hurdle, although I have 4 years of work experience, development barrier-free (I can solve any problem), but I jumped out, I really do not necessarily find all aspects can reach my requirements, So I was thinking is to take a step to see a step, while doing while looking for it, this is the helplessness of life AH!!! After I was 2013 tired of being a dog, I wanted to relax myself in 2014 and let myself do something else in 2014. Therefore, the plan is to learn a driver's license, buy a car open play, find a sister, talk about life, talk about the ideal ~ ~ Cough, I like to talk about life and ideals, do not feel very tall on it? But after the end of the year, unexpected things happen, the company outside the recruitment of the two bottom data architect is outside the peer-to-peer platform high salary dig away (peer-to-peer platform to play the students carefully ah, a lot of running bosses). The company is urgent, the leadership is urgent, no one? More money than the company can not afford, less money than others do not come. What to do? Hey, I think it's the thought of me as a very good little character, well, it's my debut. One day suddenly found me to talk, said: "XXX ah, you want to go to product design, or to the underlying architecture?" "Oh, my mother, chance ah, this opportunity can let go?" Definitely not! I do not think, decisive choice to the architecture group, also want to play big data processing platform Ah, rich way ~ ~ wrong, there is a future AH!! Product this thing, in our company really is not me such a person can play, not to say how complicated it is, but I think this thing is not suitable for me to play. To make a few years, do not move the development, I will be the product design to rely on. And then, go on,Went, everything is new, everything is from the zero start, the real from the zero, but the salary of this post actually to me to adjust to this price?? Hey think about the TM of the uncomfortable, OK, I admit that my strength is not good, I endure, I must study hard, let oneself on this price, even to exceed this price. Language uses Java, in fact, and C # is based on virtual machines, but the design of the language than C # is much worse (do not discuss the language of the theory, lest anyone hit me). My heart, spent more than 100, bought a set of basic books, called What things, forget, really too basic, I think there is a C # foundation, you can directly buy the Bible in Java-"Java programming ideas." Speaking of this Bible book, Brother will not be spit bad, his ignorance ah, this book of the Bible, my brother was in college at the time of the look, there was no development experience, so looks very tired, the effect is not ideal, so after the net development, it sent a classmate, at that time or SB's said: " You take it, I will never want it, I will never use the Java language. "This is how many young and childish words. Think that having a C # has the world. You can think of how horrible it is to be guided without a predecessor. Operation is Linux, ah, completely inexperienced, is a variety of Baidu, Baidu .... Baidu this rubbish, see just want to kill. Google this thing is ZF (sorry, I can only use pinyin first letter instead, I fear across the province, so declined all cross-provincial behavior) shielding, no way ah, basically the common use of some of the Linux command familiar with the basic problem-free work, and then learn shell script, ah, This is also a painful process ah, analysis of learning hadoop,impala,zookeeper and so a lot of listening to the installation of the platform to use, you have to understand the scripting language, otherwise, you know what the directory it needs, which environment variables? Then is the use of constant installation, hey, this process, True TM is not the average person to do, may be I am more stupid, anyway, it is too painful, only a simple to you, the rest of you have to do, if all let others engage, you still have the need to exist? Just like how we set up a former web-side colleague to the architecture group (it is said to be outside the Recruit ~ I go, I think the manpower should be enough, there are 5 people, which have more than 3-5 years of Java service development experience? Web layer on the end of the free, come also not much use, outside the recruit people must be right away, not like our tune let you take time to learn. Many things are just tell him what to do, as to how to do, let his own Baidu go, brother also has a lot of things to do!!!

My main task was to select a impala real-time data analytics platform to be built as a web-side log store and analysis. I CA, this thing is still very new (leadership chose this thing, actually also not familiar with), the actual use is very few, like me this kind of experience has no person's much less to do, in that a person slowly groping, install, test, also have to write the Java Service program to provide the serial port, ah, that process ah, But it's okay Impala platform August is on time online (all the configuration is the official standard, 10 physical machines, 128G of memory, good cool), during the biggest one of the pit dad thing is because the cluster internal firewall does not shut down, so often caused in updating metadata when the communication interrupted, It was a long time to find the problem. So for those who use Impala to wake up, of course, I do not know if there is any secret switch, if any, please also tell. In fact, the daily data volume is not very large, probably around 220W, a year about 800 million data, compared to the real big data processing, this data is slag.

In fact, the middle of the sad is not really not the words can express, for 2014 of achievements, I am still more satisfied, life career planning is again spent two years, no!! One year, one year time once again to ascend oneself, since gave me this opportunity, why not grasp? 2015 New Year, not long ago, I also wrote a simple plan in the company, Research mhout algorithm framework, can be based on historical data to carry out the basic user personality push, further study Impala platform (seems to have been replaced by spark, but instead, Impala is the C + + Write, really hurt, want to debug too difficult!! It's hard to look at it, study and learn about the Hadoop platform (which has not yet seen the source code), the HBase database study and use. That Flume might also have to see if we need to replace our existing log-recording process.

2015, the day arch a stroke, always grow up. Life, but also want to make their own more rich, more friends to play tricks, more go out to walk, not old house at home. Lest you become more and more lonely.

Well, that who is married, that who again conceived, that who is ready to knot, those who I do not call, nnd, in the moment I hit the word, incredibly someone still throw red bomb come ~ ~ Injured AH!!!!!

C#web to the Big Data Hadoop platform 2014 summary