Describe
Column calculation summary statistics for Series or DF
Min, max
Minimum and maximum
Argmin, argmax
Index location of the minimum and maximum values (integer)
Idxmin, idxmax
Index value of the minimum and maximum values
Quantile
Sample quantile (0 to 1)
Sum
Sum
Mean
Mean Value
Median
Median
Mad
Calculate the mean absolute deviation based on the mean value.
Var
Variance
browsing data. The default value is 5.
Df. sample (n): Randomly browses n rows of data. The default value is 5 rows.
Df. shape: the number of rows and columns of the tuple type)
Df. describe (): Calculate the evaluation data Trend
Df.info (): memory and Data Type
3. It is easy to add columns to DataFrame in DataFrame. The following describes several methods.
Simple Method
Directly add new columns and assign values
Df ['new _ column'] = 1
Calculation Method
Df ['temp _
SVN diff uses Vimdiff as an article description of the comparison diff tool referenceOne of the Vim's nice features are a powerful diff tool that can being used to easily tell the differences between multiple differ ent files. This can is called up at any time by issuing the following:
Vimdiff file1.xxx file2.xxx
Subversion ' s default
Recently, I started to touch git. Learning to Git diff is always confusing. Git diff compares the difference between the two files. After searching the net on the net, finally found Le answer.
There are two cases, one is when there are files in staging area, and the other is no files in staging area.
(1) When there are no files in staging area, git diff compare
This article mainly introduces you to the pandas in Python. Dataframe to exclude specific lines of the method, the text gives a detailed example code, I believe that everyone's understanding and learning has a certain reference value, the need for friends to see together below. When you use Python for data analysis, one of the most frequently used structures is the dataframe of pandas, about
In practice, by using Git diff to calculate the number of code changes, there is a need to just count certain types of files (files with special suffix names/extensions), such as: Only the variables for files in the current git repo. java,. xml,. c,. cpp. There are two ways to make git count according to the file suffix name and to count the eligible files in each subdirectory. 1. Use the ' *.java ' and ' *.xml ' directly, if your git version is new
Python traversal pandas data method summary, python traversal pandas
Preface
Pandas is a python data analysis package that provides a large number of functions and methods for fast and convenient data processing. Pandas defines two data types: Series and DataFrame, which makes data operations easier. Series is a one-di
Teach you how to use Pandas pivot tables to process data (with learning materials) and pandas learning materials
Source: bole online-PyPer
Total2203 words,Read5Minutes.This article mainly explains pandas's pivot_table function and teaches you how to use it for data analysis.
Introduction
Most people may have experience using pivot tables in Excel. In fact, Pandas
Pandas Quick Start (3) and pandas Quick Start
This section mainly introduces the Pandas data structure, this article cited URL: https://www.dataquest.io/mission/146/pandas-internals-series
The data used in this article comes from: https://github.com/fivethirtyeight/data/tree/master/fandango
This data mainly describes
[Data cleansing]-clean "dirty" data in Pandas (3) and clean pandasPreview Data
This time, we use Artworks.csv, And we select 100 rows of data to complete this content. Procedure:
DataFrame is the built-in data display structure of Pandas, and the display speed is very fast. With DataFrame, we can quickly preview and analyze data. The Code is as follows:
import pandas
, how to do? For more information please go to other blogs, where more detailed instructions are available .Pandas import time data for format conversion Draw multiple graphs on one canvas and add legends1 fromMatplotlib.font_managerImportfontproperties2Font = fontproperties (fname=r"C:\windows\fonts\STKAITI. TTF", size=14)3colors = ["Red","Green"]#the color used to specify the line4Labels = ["Jingdong","12306"]#used to specify the legend5Plt.plot (
Pandas data analysis (data structure) and pandas Data Analysis
This article mainly expands pandas data structures in the following two directions: Series and DataFrame (corresponding to one-dimensional arrays and two-dimensional arrays in Series and numpy)
1. First, we will introduce how to create a Series.
1) A sequence can be created using an array.
For example
Data analysis and presentation-Pandas data feature analysis and data analysis pandasSequence of Pandas data feature analysis data
The basic statistics (including sorting), distribution/accumulative statistics, and data features (correlation, periodicity, etc.) can be obtained through summarization (lossy process of extracting data features), data mining (Knowledge formation ).
The. sort_index () method so
The previous Pandas array (Pandas Series)-(3) Vectorization, said that when the two Pandas series were vectorized, if a key index was only in one of the series , the result of the calculation is nan , so what is the way to deal with nan ?1. Dropna () method:This method discards all values that are the result of NaN , which is equivalent to calculating only the va
("My Everything") ....
Show ()
+-+--------+-------+-------------+
| A|my first|my last|my everything|
+-+--------+-------+-------------+
|1| 4| 4| 4|
| 2| 5| 5| 5|
| 3| 6| 6| 6|
+-+--------+-------+-------------+
Complex Operations Windows
Now that Spark 1.4 are out, the Dataframe API provides a efficient and easy to use window-based framework–this single FE Ature is what makes any Pan
Sometimes you need to do some work on the values in the Pandas series , but without the built-in functions, you can write a function yourself, using the Pandas series 's apply method, You can call this function on each value inside, and then return a new SeriesImport= PD. Series ([1, 2, 3, 4, 5])def add_one (x): return x + 1print s.apply ( Add_one)# results:0 6dtype:int64A chestnut:Names =PD. Serie
Data conversionDelete duplicate elements The duplicated () function of the Dataframe object can be used to detect duplicate rows and return a series object with the Boolean type. Each element pairsshould be a row, if the row repeats with other rows (that is, the row is not the first occurrence), the element is true, and if it is not repeated with the preceding, the metaThe vegetarian is false.A Series object that returns an element as a Boolean is of great use and is particularly useful for fil
This article describes how the pandas series with the index index is vectorized:1. Index indexed arrays are the same:S1 = PD. Series ([1, 2, 3, 4], index=['a','b','C','D']) S2= PD. Series ([ten, +, +], index=['a','b','C','D'])PrintS1 +s2a11b22C33D44Dtype:int64Add the values corresponding to each index directly2. Index indexed array values are the same, in different order:S1 = PD. Series ([1, 2, 3, 4], index=['a','b','C','D']) S2= PD. Series ([ten, +,
The pandas Series is much more powerful than the numpy array , in many waysFirst, the pandas Series has some methods, such as:The describe method can give some analysis data of Series :Import= PD. Series ([1,2,3,4]) d = s.describe ()Print (d)Count 4.000000mean 2.500000std 1.290994min 1.00000025% 1.75000050% 2.50000075% 3.250000max 4.000000dtype:float64Second, the bigges
The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion;
products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the
content of the page makes you feel confusing, please write us an email, we will handle the problem
within 5 days after receiving your email.
If you find any instances of plagiarism from the community, please send an email to:
info-contact@alibabacloud.com
and provide relevant evidence. A staff member will contact you within 5 working days.