Web Crawler-code for crawling school recruitment information

I remember that at that time in March, it was the peak of school recruitment. There were a lot of school recruitment information on beiyou and shuimu, and various enterprises were frantically refreshing their screens.

Therefore, I often open the recruitment information section of beiyou and shuimu every day, and screen the school recruitment information of the companies and positions I care about on one page, however, some important school recruitment information is still missing.

After repeating things for a long time, we have the idea of automation.

So I wrote a small crawler for myself and chose to crawl the recruitment information section of beiyou and shuimu, crawlers first filter school recruitment information based on custom keywords (such as "Recent", "school recruitment", and "google") and store the information in the local redis. If the local machine has a lamp environment, you can directly read information from redis to the web page.

The purpose of this small crawler is to aggregate school recruitment information and filter out school recruitment information that you are interested in, such as Google school recruitment and Baidu school recruitment.

In addition, this gadget also helped me a lot. During the 13-year Alibaba makeup, I was able to see the recruitment information within the unit time, quickly submit my resume and finally seize the opportunity.

As far as I know, the resumes of new graduates are too late.

The world's martial arts, only fast.

This little crawler has been running on my machine for almost a year. Although it has feelings for it, it is useless for me now. A new school recruit is coming soon. I decided to share it with you. If you have any children's shoes, you can use them directly. If you are interested, you can easily expand it, meet your personalized needs.

For more information, see blog

Crawlers that crawl information about the beiyou forum and yunmu community school recruitment can directly run main. py to access the local machine (http: // 127.0.0.1: 8888), which is simple and scalable.

In addition, the SMS notification function has been added, which can be used by China Mobile, China Unicom, and China Telecom.

Talk is cheap, show you the code: https://github.com/lizherui/spider_python.

Enjoy it.

Talk is cheap, show you the code.

Code hosted on GitHub: https://github.com/lizherui/spider_python

: Http://download.csdn.net/detail/gshengod/5999879

Thanks for @ mmoonzhu's patch.

PS: the SMS notification function has been added. Mobile Unicom and China Telecom can use the 139 mail SMS notification principle.

Enjoy it.