Append Data Frame in Python

Question

I have multiple sheets that are identical in column headers but not in terms of the number of rows. I want to combine the sheets to make one master sheet.

At the moment this is the code that I get, for which the output is blank and I end up with data = to that in the last sheet.

I decided to utilise a for loop iterated through data_sheetnames which is a list.

Below is the code I have utilised

combineddata = pd.DataFrame()
for club in data_sheetnames:
    data = pd.read_excel(r'''C:\Users\me\Desktop\Data.xlsx''', header = 1, index_col = 2, sheet_name = club)
    combineddata.append(data)

If I were to change combineddata to a blank list then I get a dictionary of dataframes.

Possible duplicate of Pandas/Python: How to concatenate two dataframes without duplicates? — jar
– jar, Commented Oct 17, 2018 at 11:38

DiCaprio · Accepted Answer · 2018-10-17 11:42:39Z

1

The solution is that append does not work in place. It returns the appended DataFrame. Therefore

combineddata = pd.DataFrame()
for club in data_sheetnames:
    data = pd.read_excel(r'''C:\Users\me\Desktop\Data.xlsx''', header = 1, index_col = 2, sheet_name = club)
    combineddata = combineddata.append(data)

should solve the issue

answered Oct 17, 2018 at 11:42

DiCaprio

8331 gold badge7 silver badges24 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

Luke Simpson Over a year ago

Thanks, this has solved the query. I can only accept in 5 minutes.

iDrwish · Accepted Answer · 2018-10-17 11:44:09Z

0

An easier way is just to do this:

combined_data = pd.concat([pd.read_excel(sheet_name) for sheet_name in data_sheetnames])

answered Oct 17, 2018 at 11:44

iDrwish

3,1131 gold badge18 silver badges24 bronze badges

Collectives™ on Stack Overflow

Append Data Frame in Python

2 Answers 2

1 Comment

Comments

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

1 Comment

Comments

Linked

Related