"First, take a look at CSDN's recommended experts page"
"And then look at the main page."
Ready to use crawlers to get a few variables
1. Name
2. Number of Visits
3. Points
4. Level
5. Ranking
6. Original
7. Reprint
8. Translation
9. Comments
10. Links
11. Photos
"Project" because the main use of webmagic, all the jar package at webmagic git address, download it by itself.
"User.java" is easy to display, or later stored in the database
Packagecom.cnblogs.test; Public classUser {PrivateStringname;//name PrivateStringFangwen;//Number of visits PrivateStringJifen;//points PrivateStringDengji;//level PrivateStringpaiming;//ranking PrivateStringYuanchuang;//Original PrivateStringZhuanzai;//reproduced PrivateStringYiwen;//translation PrivateStringPinglun;//Reviews PrivateStringLink;//links PrivateStringPhoto;//Photos@Override PublicString toString () {return "\n========================= \ n" + "name =" + name + "\ n traffic =" + fangwen + "\ n integrals =" + jifen + "\ n level =" + dengji + "\ n rank =" + paiming + "\ n original =" + yuanchuang + "\ n reprint =" + " Span style= "color: #ff0000;" >zhuanzai + \ n = "+ yiwen +" \ n Comment = "+ pinglun + \ n link = "+ link +" \ n photo = "+ photo + "\n==========================\n" ; }
/******* omit Get/set method ******/}
"Csdnspider.java"
02_ use WebMagic to get CSDN referral expert's personal blog information