Merge multiple csv files in python

Question

Need help with merging multiple csv file

import pandas as pd
import glob
import csv
r1=glob.glob("path/*.csv")
wr1 = csv.writer(open("path/merge.csv",'wb'),delimiter = ',')
for files in r1:
    rd=csv.reader(open(files,'r'), delimiter=',')
    for row in rd:
    print(row)
    wr1.writerow(row)

I am getting a type error TypeError: a bytes-like object is required, not 'str' not sure how to resolve this

I guess you need to open the file in w mode only not wb mode — A l w a y s S u n n y
– A l w a y s S u n n y, Commented Dec 5, 2018 at 15:43
Thanks curious mind for the reply...i got the below error when i changed it to w TypeError: '_csv.writer' object is not subscriptable — Gautham N K
– Gautham N K, Commented Dec 5, 2018 at 16:38
What is the line with the _csv.writer error? By the way there is an indent error in the last 2 lines. — Leonid Mednikov
– Leonid Mednikov, Commented Dec 5, 2018 at 16:42

zipa · Accepted Answer · 2018-12-05 16:49:47Z

1

Using pandas you can do it like this:

dfs = glob.glob('path/*.csv')

result = pd.concat([pd.read_csv(df) for df in dfs], ignore_index=True)

result.to_csv('path/merge.csv', ignore_index=True)

answered Dec 5, 2018 at 16:49

zipa

28k6 gold badges45 silver badges62 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Merge multiple csv files in python

1 Answer 1

Comments

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Related