Big Data Combat Course first quarter Python basics and web crawler data analysis

Big Data Combat Course first quarter Python basics and web crawler data analysis
Network address: Https://pan.baidu.com/s/1qYdWERU Password: yegz

Course 10 chapters, 66 bars

This course is intended for students who have never been in touch with Python, starting with the most basic grammar and gradually moving into popular applications. The whole course is divided into two units of foundation and actual combat.

The basic part includes Python syntax and object-oriented, functional programming paradigms, the basic part of the Python language in the various characteristics of the data structure, how to use packages and functions, to help students quickly through the grammar.

In the actual combat part of the selection of web crawler, database development, Web site 3 of the most basic types of applications, detailed introduction of its principles, and through the case of Python to explain the implementation of the program, so that students really achieve mastery, extrapolate effect. and apply it to your work environment.

1.Python Language Development Essentials Detailed
First, the concept of the module. The difference between the main module and the non-master module. Define code templates in Pycharm
Second, install PIP multiple virtual Python environment
III. syntax. variable. Built-in type. operator
Iv. If.for.while.else
V. Data structures-lists-tuples-dictionaries-collections
Vi. functions. class. Exceptions

2.Python Data types
Vii. list and List resolution
VIII. Filter and map
Nine, generator expression is
Ten, the tuple
Xi. string
12. Chinese processing of strings
13. Dictionaries
14. Collection

3. Functional and functional programming
XV, function parameters and variable-length parameter lists
16. function return value. Variable scope. and Function __doc__ Properties
17. Nested definition of functions and description of closures and adorners
18, decorator example (log decorator and identity authentication adorner)
19, iterators and generators 1
20. Generator Example

4. Object-Oriented Programming
21. Recognize Classic and new types
22. Public properties and private property properties
23. Access properties. Property Adorner. Descriptor
24. Descriptors
25. Methods-instance methods-static methods-class methods
26. Special methods. Operator overloading
27. Inheritance. Multiple inheritance. Super

5. Web crawler (single thread, save to text file)
28, Crawler Introduction
29, Kit Introduction
30. Request Use Demo
31. XPath Introduction
32. XPath Use Demo
33. News Crawler
34. Page Bar Crawler
35, Watercress Crawler

6.mysql Database
36, overview. The difference between SQL database and NoSQL database
37. Environment preparation. Introduction of driver Package
38, the use of Mysqlconnector
39, MySQLdb use
40, SQLAlchemy Introduction. Introduction to the advantages of ORM
41. SQLAlchemy Development process
42, SQLAlchemy code demonstration. 1
43. SQLAlchemy Code Demo 2

7.mongodb Database
44. MongoDB Introduction
45. Install the. Command line. Mongovue Demo
46. Inserting records in Python
47. Querying records in Python
48. Update records in Python
49. Delete Records in Python
50. Aggregation operation

8. Multithreading and multi-process
51. Overview
52. Multithreaded Programming
53. Multi-Process programming
54. Comprehensive case-web crawler 3

9.scrapy Combat
55, Scrapy Introduction and installation
56. Scrapy Project Framework
57. Scrapy Framework and Case requirements analysis
58. Actual combat

10.django Combat
59. Django Architecture Introduction
60. Stage 1. Install. Create the project. Create an app. Initial configuration
61. Stage 1. Configure URL mappings. View functions
62. Phase 2. Define ORM and register to the backend management module
63. Stage 3. Inheritance of templates-use of forms-presentation of data
64. Stage 4. Multi-app URL configuration. DML Operations for data
65. Introduction to Deployment Knowledge

Big Data Combat Course first quarter Python basics and web crawler data analysis