Use python to crawl the photos in the douyu app,
Preface
I didn't expect python to be so powerful and fascinating. I used to see a picture as a copy and paste. Now, I can use a program to save a picture after learning python.
I recently saw that the pictures in douyu were good. I decided to use the latest
1. Build the Apache server (1). Download Httpd and Dependencies-Apr, Apr-utilhttpd:http://httpd.apache.org/Apr apr-util:https://apr.apache.org/(2). Compile Apr:$./configure--prefix=/usr/local/makesudomakeinstallApr-util:./configure--prefix=/usr/local/apr-util--with-apr=/usr/local/Aprmakesudomake InstallHTTPD:$./configure--prefix=/usr/local/--with-apr=/usr/local/--with-apr-util=/usr/local/apr- --sysconfdir=/etc/--enable-modules=--enable-mpms-shared=makesudo makeinstall2. Configuring the WSGI
How many xib and js scripts (python) and xibpython are used in the app?Checks how many xib and js scripts are used by the app (python) by Wu xueying#! /Usr/bin/env python# Coding = UTF-8Importos, sysDefcountTargetFile (targetDir ):ResultStr =''TargetTypes = ['. nib','. M', '
/blogviview.pyfromdjango.httpimporthttpresponsedefindex (req): Returnhttpresponse (' [[email protected] cvst01]# lsblog cvst01 manage.py[[email protected] cvst01]# python manage.py runservervalidating mode Ls... 0 Errors Founddjango version 1.4.5, using Settings ' cvst01.settings ' development server is running at http://127.0.0.1:8000 /quit the server with Control-c.[07/apr/2016 22:08:57] "get/http/1.1" 404 1900[07/apr/2016 22:09:10] "get/blog/index
Directly on dry goods!!Using Python 2.7.5-windowsOpen http://www.apple.com/cn/itunes/charts/free-apps/As can be seen using the UTF-8 encodingAfter some ideological struggle coded as follows (shoot bricks don't face)#coding =utf-8import urllib2 import urllib import re import thread import time #------- ----APP Store leaderboard----------- class Spider_model: def __init__ (s
Most apps return JSON-formatted data, or a bunch of encrypted data. Take the Super Curriculum app as an example to grab the user's topic in the Super curriculum.
1. Crawl the app data package
For more information, refer to this blog post: Fiddler How to crawl mobile app packets
Get the Super Curriculum login address: http://120.55.151.61/V2/StudentSkip/loginChec
input NPM--registry http://registry.cnpmjs.org install-g appiumNote:-G is a global parameter(3) command line input Appium detect if installation is successful(4) command line input appium-doctor detection environment(5) command line input pip install appium-python-client install appium-python-client6. Download the compressed package directly to Appium website(1) Website: Http://appium.io(2) Domestic (also
Crawl app photos using python,First download a douyu (you can do it without downloading it. The URLs are all here, right)
Capture a json data packet and get the following address.
According to the test results, modifying the offset value is equivalent to page flip of the app.
Access this url and return a large dictionary with two indexes, one error and one data
On the basis of the HelloWorld project, we are going to create the first web-based Django application, name the app the demo first, how to create the application package, of course, the first choice we can go into the cmd, execute the following command
python manage.py startapp demo
If you want to do it in Pycharm: or to go into the edit configuration in the inside to configure: To change the
The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion;
products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the
content of the page makes you feel confusing, please write us an email, we will handle the problem
within 5 days after receiving your email.
If you find any instances of plagiarism from the community, please send an email to:
info-contact@alibabacloud.com
and provide relevant evidence. A staff member will contact you within 5 working days.