Freewheel Big Data Small partner

Infrastructure Department-platform Development team

Lead software Engineer

Description of responsibilities :

1. Enterprise-class Big Data platform architecture planning and design, to improve the storage and computing capacity of the platform, lead the team to complete technical solutions;

2. Large data base component Kafka/hbase/yarn/spark Two development and performance optimization;

3. Provide the business unit with technical architecture support of big data platform to solve its technical problems and performance bottleneck;

4. Research the advanced technology direction of big data industry and apply to the actual production system;

5. Establish efficient research and development processes and specifications, and continuously improve the efficiency and quality of the platform.

Requirements for Employment :

1. More than five years experience in Hadoop and big data ecosystem products, such as Kafka/hbase/presto/yarn/spark;

2. In-depth understanding of distributed systems, big data platform, Message Queuing and other highly available high-elasticity architecture;

3. To establish a large-scale low-latency data processing system to solve real business problems;

4. Have the ability to learn and solve problems quickly;

5. Strong sense of responsibility and self-drive;

6. Good team work spirit and communication skills.

Add sub-item :

1. have Golang development experience;

2. Have AWS development experience;

3. Have practical experience in performance optimization and patch tracking of hdfs/yarn/hbase/hive/spark/presto related components.

Pictures from the simple book app