Web Crawler-code for crawling school recruitment information

Source: Internet
Author: User

I remember that at that time in March, it was the peak of school recruitment. There were a lot of school recruitment information on beiyou and shuimu, and various enterprises were frantically refreshing their screens.

Therefore, I often open the recruitment information section of beiyou and shuimu every day, and screen the school recruitment information of the companies and positions I care about on one page, however, some important school recruitment information is still missing.

After repeating things for a long time, we have the idea of automation.

So I wrote a small crawler for myself and chose to crawl the recruitment information section of beiyou and shuimu, crawlers first filter school recruitment information based on custom keywords (such as "Recent", "school recruitment", and "google") and store the information in the local redis. If the local machine has a lamp environment, you can directly read information from redis to the web page.

The purpose of this small crawler is to aggregate school recruitment information and filter out school recruitment information that you are interested in, such as Google school recruitment and Baidu school recruitment.

In addition, this gadget also helped me a lot. During the 13-year Alibaba makeup, I was able to see the recruitment information within the unit time, quickly submit my resume and finally seize the opportunity.

As far as I know, the resumes of new graduates are too late.

The world's martial arts, only fast.

This little crawler has been running on my machine for almost a year. Although it has feelings for it, it is useless for me now. A new school recruit is coming soon. I decided to share it with you. If you have any children's shoes, you can use them directly. If you are interested, you can easily expand it, meet your personalized needs.

For more information, see blog

Crawlers that crawl information about the beiyou forum and yunmu community school recruitment can directly run main. py to access the local machine (http: // 127.0.0.1: 8888), which is simple and scalable.

In addition, the SMS notification function has been added, which can be used by China Mobile, China Unicom, and China Telecom.

Talk is cheap, show you the code: https://github.com/lizherui/spider_python.

Enjoy it.



Talk is cheap, show you the code.

Code hosted on GitHub: https://github.com/lizherui/spider_python

: Http://download.csdn.net/detail/gshengod/5999879


Thanks for @ mmoonzhu's patch.

PS: the SMS notification function has been added. Mobile Unicom and China Telecom can use the 139 mail SMS notification principle.

Enjoy it.

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.