Before, later

Graduated more than three years, look back to think of the road, twists, written code, fragmented, know people, all kinds.

Born in communication and machinery, a year later half a monk, the brain Fever chose the software development, at the beginning of the passion, like the students, their own planning, self-supervision, self-study, a short time to understand the development process, but also some simple development. However, perhaps for the haste, did not consider a good career planning, always feel that the company's technical strength is not possible, the land has continued to change several companies. Looking back, I still feel that some of the colleagues and leaders have owed, that period of time they took care of a lot, so that they have a short six months of time peacefully to learn, to progress, but they have just been able to deal with the company's project development, in their watch under the choice to leave. At that time, I was also inexperienced, blindly follow the technology, always thought that the company's technical strength is deep, always think that they need to learn and grow, always think they need Daniel guidance, in the final analysis is not confident and too naïve.

Technology and code this piece, a little miscellaneous also a bit of slag. 2014 began to contact the telecommunications of the system, non-internet projects, mainly internal operations use, so the difficulty is not the amount of traffic concurrency, but the amount of data and task scheduling. Due to the Shanghai tens of millions of users, including SMS, traffic volume, broadband, and every month basically will send SMS and voice. Scheduling system for Oracle stored procedures and quartz.

That period of time the Internet is very hot, their mood is uncertain, feel too conservative, and the telecommunications at that time also pushed "to the IoE", I think close to the mass users, to the T company. Mainly mobile and online video business, and Youku a bit like, just not so big user volume only. I am mainly responsible for the backend services, reviews, auctions, merchant management These, the project structure is basically general, is spring+mybatis/hibernate+redis+mysql. With the big data burning, and the predecessor looking for another job, the leader let me start to research and promote Kafka, while I also learn storm. Fortunately fulfill, one months or so time, self-study documents, build environment, performance testing, project on-line, mainly to the log centralized management, and carry out some key statistics. Not good, or lonely too long, do not want to just get the message queue this piece, restless I went to the company. Yes, an H company that is mainly engaged in big data.

At H, the company began to engage in data analysis and processing, and various frameworks continued to be approached and used. Commonly used such as hadoop,spark,storm,hbase,hive and Kafka. Project framework basically with the trend, real-time system using Kafka+strom, near real-time data or offline data using spark or directly with hive SQL processing, structured data into hive, unstructured data into hbase. That period of time good valuable, know a lot of friends, we seriously write code, serious work, always feel that their value has been reflected, but also eat and drink, very happy!

Now, in order to work closer, in order to secure the point, LZ to the P company, mainly responsible for the analysis and processing of massive data, the new beginning, their efforts.

In recent years, the contact surface is very broad, but not well-summed up, has not yet formed a complete knowledge system, it is time to tidy up, otherwise too chaotic too miscellaneous, like hot pot, delicious but not exquisite.

Used to be too messy, after the special!

　　

Before, later