New features of Atitit atiplat_reader based on URL reader

new features of Atitit Atiplat_reader based on URL Reader

1.1. feature functional characteristics 1

1.2. Note1

1.1. feature functional characteristics

support The URL data source, is actually only supports one layer to crawl the crawler.

Data source management uses explore+notepad++ management, grouping using a single file. The files are URLs .

The timed task is implemented by using the Ping tool:

crawl directly with the bat file:

Batch Batch Crawl

Cloud reading crawler implementation, using FTP distributed remote can. Ha ha.

1.2. Note

When saving HTML , you should use binary mode to avoid encoding selection.

1.3. call C:\0workspace\atiplat_spider\reader.bat

Public Static void Main(String[] args) {

string   url   =   args [ 0 "

string   savedir   =   args [ 1 "

if (System.GetProperty("mode") != NULL && System.GetProperty("mode").equals("Batch")) {

New Reader().Rssdirmode(System.GetProperty("Feeddir"),Savedir);

} Else

New Reader().Rsssingle(URL,Savedir);

System . out . println ("-------------fini") ;

}

author :: nickname : Old Wow's paw claw of Eagle Idol wreck Iconoclast Image-smasher

King of Bird Catcher King of Kings devout pious religious defender Defender of /c6> the Faith caracalla red cloak Caracalla red cloak

abbreviation:: Emir attilax Akbar Emile Atiraca

Full Name::Emir attilax Akbar bin Mahmud bin Attila bin Solomon bin Adam Al Rapanui  Emir Attilax Akbar ben Mahmud   ben Attila Solomon Ben Adam   al  Rapa Nui

Common name: Etila (Ayron), email:[email protected]

title:Head of Uke headquarters, founder of Global Grid project,

Uke, Minister of Religious and Cultural Integration Affairs, Vice-Chairman of the Uke Reformation Commission

, Chief chieftain of the Uke tribe,

Uke system and chairman of the major conference committee, Uke Security Department Chief Brigade, Uke System Inspection Committee vice President,

CTO of Cow Technology , director, Research and Development director, Chief CTO Technical Director , uke

uke Polynesia District chain Head Regional head of the Kingdom of Tonga.

uke Kerr Glen Islands chain Head, Line Is. district chain Head,

uke Bouvet and South Georgia and South Sandwich Is. regional chain head

Uke, chairman of the Association of Software Standardization Uke, vice President of lifelong Education School

Uke, vice president of the Association of Database and Storage standardization, editor of Uke Publishing house

Uke Hospital and medical school founder of the field

reprint Please indicate source:Attilax's column? http://www.cnblogs.com/attilax/

--atiend

New features of Atitit atiplat_reader based on URL reader