ID name sexa lm 0 lxh 0b- ly 1 Xiao 1 using full outer connection age CP ID name sexa lm 0 lxh 0b- ly 1 Xiao 1c 4 yry 2 hua NaNd all 3 be NaNe nan nan nan nan 2There is another way to connect: concatThe Concat method is equivalent to the full connection in the database (UNION all), you can specify whether to connect by an axis, or you can specify joins in the same way (Outer,inner only these two
1 concat
The Concat function is a method underneath the pandas that allows for a simple fusion of data based on different axes.
Pd.concat (Objs, axis=0, join= ' outer ', Join_axes=none, Ignore_index=false, Keys=none, Levels=none, Names=None,
Verify_integrity=false)1 2 1 2 1 2
Parameter descriptionObjs:series,dataframe or a sequence of panel compositions
At the time of data processing, especially in the big data contest, often encounter a problem is that multiple forms of merging problems, such as a form has user_id and age two fields, another form has user_id and sex two fields, to merge these two tables into only user_id, Age, sex three fields of the table what to do, the ordinary stitching is not possible, because user_id each row is not the corresponding, like the building blocks of horizontal stitching is certainly not. There is a merge fun
This article mainly introduces you to the pandas in Python. Dataframe to exclude specific lines of the method, the text gives a detailed example code, I believe that everyone's understanding and learning has a certain reference value, the need for friends to see together below. When you use Python for data analysis, one of the most frequently used structures is the dataframe of pandas, about
Python traversal pandas data method summary, python traversal pandas
Preface
Pandas is a python data analysis package that provides a large number of functions and methods for fast and convenient data processing. Pandas defines two data types: Series and DataFrame, which makes data operations easier. Series is a one-di
Teach you how to use Pandas pivot tables to process data (with learning materials) and pandas learning materials
Source: bole online-PyPer
Total2203 words,Read5Minutes.This article mainly explains pandas's pivot_table function and teaches you how to use it for data analysis.
Introduction
Most people may have experience using pivot tables in Excel. In fact, Pandas
Pandas basics, pandas
Pandas is a data analysis package built based on Numpy that contains more advanced data structures and tools.
Similar to Numpy, the core is ndarray, and pandas is centered around the two core data structures of Series and DataFrame. Series and DataFrame correspond to one-dimensional sequences and
[Data analysis tool] Pandas function introduction (I), data analysis pandas
If you are using Pandas (Python Data Analysis Library), the following will certainly help you.
First, we will introduce some simple concepts.
DataFrame: row and column data, similar to sheet in Excel or a relational database table
Series: Single Column data
Axis: 0: Row, 1: Column
Pandas Quick Start (3) and pandas Quick Start
This section mainly introduces the Pandas data structure, this article cited URL: https://www.dataquest.io/mission/146/pandas-internals-series
The data used in this article comes from: https://github.com/fivethirtyeight/data/tree/master/fandango
This data mainly describes
[Data cleansing]-clean "dirty" data in Pandas (3) and clean pandasPreview Data
This time, we use Artworks.csv, And we select 100 rows of data to complete this content. Procedure:
DataFrame is the built-in data display structure of Pandas, and the display speed is very fast. With DataFrame, we can quickly preview and analyze data. The Code is as follows:
import pandas
Pandas data analysis (data structure) and pandas Data Analysis
This article mainly expands pandas data structures in the following two directions: Series and DataFrame (corresponding to one-dimensional arrays and two-dimensional arrays in Series and numpy)
1. First, we will introduce how to create a Series.
1) A sequence can be created using an array.
For example
Data analysis and presentation-Pandas data feature analysis and data analysis pandasSequence of Pandas data feature analysis data
The basic statistics (including sorting), distribution/accumulative statistics, and data features (correlation, periodicity, etc.) can be obtained through summarization (lossy process of extracting data features), data mining (Knowledge formation ).
The. sort_index () method so
, how to do? For more information please go to other blogs, where more detailed instructions are available .Pandas import time data for format conversion Draw multiple graphs on one canvas and add legends1 fromMatplotlib.font_managerImportfontproperties2Font = fontproperties (fname=r"C:\windows\fonts\STKAITI. TTF", size=14)3colors = ["Red","Green"]#the color used to specify the line4Labels = ["Jingdong","12306"]#used to specify the legend5Plt.plot (
The previous Pandas array (Pandas Series)-(3) Vectorization, said that when the two Pandas series were vectorized, if a key index was only in one of the series , the result of the calculation is nan , so what is the way to deal with nan ?1. Dropna () method:This method discards all values that are the result of NaN , which is equivalent to calculating only the va
attach data rows. We'll use the Dataframe in the previous section to practice concatenation and additional operations on data rowsfunction concat () is a concatenation dataframe, such as a dataframe consisting of 3 rows of data can be concatenated with other data rows in order to reconstruct the original dataframe:Print ("Concat back together\n", Pd.concat ([df[:3],df[3:]]))To append data rows, you can use
The pandas Series is much more powerful than the numpy array , in many waysFirst, the pandas Series has some methods, such as:The describe method can give some analysis data of Series :Import= PD. Series ([1,2,3,4]) d = s.describe ()Print (d)Count 4.000000mean 2.500000std 1.290994min 1.00000025% 1.75000050% 2.50000075% 3.250000max 4.000000dtype:float64Second, the bigges
Sometimes you need to do some work on the values in the Pandas series , but without the built-in functions, you can write a function yourself, using the Pandas series 's apply method, You can call this function on each value inside, and then return a new SeriesImport= PD. Series ([1, 2, 3, 4, 5])def add_one (x): return x + 1print s.apply ( Add_one)# results:0 6dtype:int64A chestnut:Names =PD. Serie
Data conversionDelete duplicate elements The duplicated () function of the Dataframe object can be used to detect duplicate rows and return a series object with the Boolean type. Each element pairsshould be a row, if the row repeats with other rows (that is, the row is not the first occurrence), the element is true, and if it is not repeated with the preceding, the metaThe vegetarian is false.A Series object that returns an element as a Boolean is of great use and is particularly useful for fil
This article describes how the pandas series with the index index is vectorized:1. Index indexed arrays are the same:S1 = PD. Series ([1, 2, 3, 4], index=['a','b','C','D']) S2= PD. Series ([ten, +, +], index=['a','b','C','D'])PrintS1 +s2a11b22C33D44Dtype:int64Add the values corresponding to each index directly2. Index indexed array values are the same, in different order:S1 = PD. Series ([1, 2, 3, 4], index=['a','b','C','D']) S2= PD. Series ([ten, +,
This article describes how to use the pandas library in Python to analyze cdn logs. It also describes the complete sample code of pandas for cdn log analysis, then we will introduce in detail the relevant content of the pandas library. if you need it, you can refer to it for reference. let's take a look at it.
Preface
A requirement encountered in recent work is
The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion;
products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the
content of the page makes you feel confusing, please write us an email, we will handle the problem
within 5 days after receiving your email.
If you find any instances of plagiarism from the community, please send an email to:
info-contact@alibabacloud.com
and provide relevant evidence. A staff member will contact you within 5 working days.