selenium data scraping

):#Iterate 1 to MaxRowsrows.append (List (sheet.row_values (row_idx, 0, Sheet.ncols) )returnROWS@DDTclassSEARCHEXCLEDDT (unittest. TestCase):defsetUp (self): Self.driver=Webdriver. Chrome () self.driver.implicitly_wait (30) Self.driver.maximize_window () Self.driver.get ("https://www.baidu.com") #get test data from specified excle spreadsheet by using the Get_data funcion@data (*get_data ('testdata.xlsx'

1. Read txtRead () reads the entire file.ReadLine () reads a row of Data.ReadLines () reads all rows of Data. Example: #coding =utf-8from Selenium Import WebdriverUser_file = open (' user_info.txt ', ' r ')Values = User_file.readlines ()User_file.close ()For Serch in Values:Username = serch.split (', ') [0]Print username Password = serch.split (', ') [1] Print Password2. Read CSV#coding =utf-8Import C

Crawl Activity Tree Site meeting activity data (http://www.huodongshu.com/html/index.html)The specific idea is [Python crawler] in the Xi. crawl activity line site similar, are used multi-threaded to crawl, but because of the active tree site, each keyword search page ur is fixed, such as the search "number" results have 470 results, no page 10 records, the second page of the URL and the first page of the The URL is the same.Therefore, a single thread

#!/usr/bin/python #-*-Coding:utf-8-*-"Created on 2015-04-27@author:beyondzhou@name:logintest.py" ' Import Unittestfrom DDT import DDT, data, Unpackfrom Selenium import webdriverimport osimport timefrom selenium.common.exception S import nosuchelementexceptionfrom selenium.webdriver.common.by import By@ddtclass logintest (unittest. TestCase): @classmethod def setUp (CLS): # Get The driver of chrome chromedri

on the IFRAME name//Here we use the name switchItargetlocator Tagetlocator =driver. SwitchTo (); //tagetlocator.frame (1); //Frame index.Tagetlocator.frame ("Login_frame");//frame frame name. varUserName = driver. Findelementbyxpath ("//*[@id = ' u ')"); //the username here is the text box for the user name.//set the value of the user nameUsername.sendkeys ("123456"); varPWD = driver. Findelementbyxpath ("//*[@id = ' P ']"); Pwd. SendKeys ("********"); varBtnlogin

1. Introduce the JAVA+SELENIUM+POM Automatic test framework, the first to realize the separation of code and account URL and other information. The 2nd supports cross-browser implementation by reading the configuration file.1) Add information such as account URL to the properties file and read2) write the browser class by fetching the configuration file to achieve browser switching3) Test Browser classProject structure:1. Create a new folder place the

input box, the data is passed into Send_keys (Hzy). This is called by loop until all the contents of the file are read.Second, login parameterizationNow according to the above ideas, the Automation script user, the name of the password parameterized, through the Python document we found that Python read the file: The entire file read, read-line, fixed byte read.Did not find a good way to read two data at a

Background: In the testing process, in order to achieve the implementation of the different test data batch cycle input, consider the need to read the CSV file by the way of parameterization of the steps to further parameterization, the sample code is as follows:Import CSV...Data_set = R ' C:\\test.csv 'data = Csv.reader (file (Data_set, ' RB '))def test_insert (self):...# A total of four fields for each

Installing DDT pip Install DDTDirectly on the code:1 #Coding:utf-82 ImportDDT3 Import Time4 ImportExcelunit5 ImportUnitTest6 fromSeleniumImportWebdriver7 8 #test Data9data = Excelunit. Excelutil ("test.xlsx","Sheet1")TenTestData =Data.dict_data () One PrintTestData A - - @ddt. DDT the classBolg (unittest. TestCase): - """Login Blog""" - defsetUp (self): -Self.driver =Webdriver. Firefox () +URL ="Https://passport.cnblogs.com/user/signin" - self.driver.get (URL) +Self.driver.implicit

() throws IOException {Return Gettestdata ("D:\\testdata.csv");}@Test (dataprovider= "TestData")public void Testsearch (string searchWord1, String searchWord2,String SearchResult) {Driver.manage (). Timeouts (). implicitlywait (Timeunit.seconds);String baseUrl = "http://www.baidu.com/";Navigation Navigation = Driver.navigate ();Navigation.to ("http://www.baidu.com");Driver.findelement (By.id ("kw")). SendKeys (SearchWord1 + "" + SearchWord2);Driver.findelement (By.id ("su")). Click ();(New webd

://attachments.tower.im/tower/ B1bcc47d835c45d892d2ce25d14e6eaf?version=autofilename=clipboard%20image.png "width=" 338 "height=" 354 "style= "Margin:.2em 0px;padding:0px;border:1px solid RGB (217,217,217); font-size:15px;vertical-align:middle;width:auto; Height:auto;color:rgb (51,51,51); font-family:arial, Sans-serif;white-space:normal;background-color:rgb ( 255,255,255); "/>This article comes from "No idea, no achievement!" "Blog, be sure to keep this provenance http://kemixing.blog.51cto.com/

from http://www.pm25.com/shenzhen.html crawl Beijing, Shenzhen, Shanghai, Guangzhou, Chengdu PM2.5 Index, and according to the air quality favorably to the difference sort, saved in txt document#coding =UTF-8FROMNBSP;SELENIUMNBSP;IMPORTNBSP;WEBDRIVERFROMNBSP;TIMENBSP;IMPORTNBSP;SLEEPCLASSNBSP;PM: Def__init__ (self): Self.dr=webdriver. Chrome () Self.pm25_info=self.get_pm25_info () Defget_pm25_info (self): city_list=[' Beijing ', ' Shenzhen ', ' Shanghai ', ' Guangzhou ', ' Chengdu ']pm_info_list