WeChat friend Circle turns Crazy (Golang write small reptile crawl Friend Circle article)

This is a creation in Article, where the information may have evolved or changed.

A lot of people in the circle of friends to forward some articles, the title is what Go crazy, and so on, although most of them are also ads, I think it is quite boring, but indeed there are some articles are very well worth collecting, such as the wife will often collect some health and beauty articles in the look.

Today is a whim, instead of using the search engine to classify the articles of the Circle of friends (of course, the type of interest of the wife) to crawl out, and then put down the picture, to generate a website for friends to see it is not good? Say do just do, so there is this website: Friends Circle turned Crazy (http://www.meijia0.com) domain name is not very good, make use of Bai. (In fact, was prepared to make Nail Pictures station, and then shelved.) Because the wife really does not have the time to run such things at home.

Since said to do, first of all to benefit its device, the ash go again picked up, by the way to learn the seven Qiniu Storage API (have to say really is very useful), wrote a Spider (Gocrawl/goquery).

There was a little something about a joke crawl that changed a bit before. Added incremental fetch (using Redis as cache), MongoDB as storage, front-end, Magnum Jquery+bootstrap, commenting system used to say more. Server put in Ali go, now is really good time, do anything is complete.

According to the key words crawling, 24 hours constantly updated Friends Circle article, what can be pursued? Maybe next time you can do Chinese word segmentation and full-text search it.

All day, done. During the course of downloading pictures and watermarks, and uploading to seven cattle this piece wasted too much time. Anyway, it's on the line. Let's see!

Http://www.meijia0.com

Here is the code snippet:

Golang a watermark to a picture

Golang Generating thumbnails

Golang uploading files to seven kn

Today read a Xu Zhiwei classmate's report, very admire.