Crawler 3: pdf page + javasminer module + demo

This document describes how to crawl a pdf page. The crawler miner module is required.

General demo process:

1) set URL

Url = 'HTTP: // www. ------ '+'. pdf'

2) The requests module obtains the URL

Import requests
R = requests. Get (inner_url)

3rd: Write the data file

Myfile = open ("pdf/" + I [U 'associateannouncement '] + 'authorization', "WB") myfile. Write (R. Content) myfile. Close ()

4) introduce the miner Module

Import into miner

5) beautifulsoup parsing HTML

From bs4 import beautifulsouphtml = open ('pdf/1202268749.html '). Read ()

To continue, go to bed first, parse miner parses the pdf page into an HTML page, and then beautifulsoap parses the HTML page.

 

Crawler 3: pdf page + javasminer module + demo