Python crawler program (July online)

Ax Tamping Foundation
1th Lesson Environment Preparation and introduction
Knowledge point 1: Environment ready, install Virtual box with Ubuntu system
Knowledge point 2:python and installation configuration for Pyenv and Pip
Knowledge Point 3:mysql installation configuration
Knowledge Point 4:apache installation configuration
Introduction to Knowledge point 5:python/html
2nd Lesson Introduction to Python programming
Knowledge point 1: Basic syntax
Knowledge point 2: Containers
Knowledge point 3: Functions
Knowledge point 4: Object-oriented
Knowledge Point 5: File Read and write
The installation of Knowledge point 6:python Common Library
Write your own crawler, get the e-commerce website and the data you know
The basic knowledge of the 3rd crawler and the realization of the simple crawler
Knowledge Point 1:html basic knowledge
Knowledge Point 2:xml and JSON basics
Knowledge Point 3:CSS basic knowledge
Knowledge points 4:xpath and CSS selectors
Introduction and configuration of Knowledge point 5:selenium
Actual project: Get the data of an e-commerce website
Lesson 4th related Library use and login issues
Getting Started with knowledge Point 1:request/beautifulsoup Library
Knowledge point 2: Crawler Landing problems related solutions
Knowledge Point 3:python Database programming
Use the Scrapy framework for commercially available crawlers
The 5th lesson scrapy and related application
Knowledge point 1: Create a project
Knowledge point 2: Crawler writing
Knowledge point 3: Pipelines
Knowledge point 4: Data retention
Knowledge Point 5: Command line tools/terminal
Knowledge Point 6: Selector
The 6th Lesson Crawler design Actual Combat
Actual combat project: based on the scrapy framework to obtain an e-commerce website data
Learn how to improve crawler efficiency and understand the scrapy framework
7th Lesson Advanced Content-Concurrent programming
Knowledge point 1: Multi-process
Knowledge Point 2: Multithreading
Knowledge point 3: Asynchronous IO
Knowledge point 4: Thread pool
Knowledge point 5:twisted and asynchronous programming
Actual combat project: concurrent Grab Combat
8th Lesson Distributed Crawler Framework Design
Knowledge Point 1:scrapy Architecture analysis
Knowledge point 2: How to design a distributed crawler
Knowledge point 3:RABBITMQ processing distributed messages
Actual Combat Project: Introduction and application of Bron filter


：

Baidu Network Disk Download

Python crawler program (July online)