How to write specific columns of a dataframe to a CSV?

Question

I'm writing a script to reduce a large .xlsx file with headers into a CSV, and then write a new CSV file with only the required columns based on the header names.

import pandas
import csv

df = pandas.read_csv('C:\\Python27\\Work\\spoofing.csv')

time = df["InviteTime (Oracle)"]
orignum = df["Orig Number"]
origip = df["Orig IP Address"]
destnum = df["Dest Number"]

df.to_csv('output.csv', header=[time,orignum,origip,destnum])

The error I'm getting is with that last bit of code, and it says

ValueError: Writing 102 cols but got 4 aliases

I'm sure I'm overlooking something stupid, but I've read over the to_csv documentation on the pandas website and I'm still at a loss. I know I'm misusing the to_csv parameters but I can't seem to get my head around the documentation.

Any help is appreciated, thanks!

Nikita Pestrov · Accepted Answer · 2015-04-25 13:05:24Z

124

The way to select specific columns is this -

header = ["InviteTime (Oracle)", "Orig Number", "Orig IP Address", "Dest Number"]
df.to_csv('output.csv', columns = header)

edited Apr 25, 2015 at 13:05

Nikita Pestrov

5,9864 gold badges34 silver badges68 bronze badges

answered Feb 25, 2014 at 16:11

user1827356

7,0122 gold badges25 silver badges30 bronze badges

Sign up to request clarification or add additional context in comments.

5 Comments

user1346477 Over a year ago

Here is information from the documentation on the parameters.

user1827356 Over a year ago

Seems to be a mismatch in column names. You can check your columns with df.columns

user1827356 Over a year ago

Only if one unreasonably repeats it :)

Hamed Baziyad Over a year ago

Is append feature in df.to_csv?

user1827356 Over a year ago

Refer to this - stackoverflow.com/questions/17530542/…

Konstantinos Roditakis · Accepted Answer · 2022-04-06 12:43:04Z

3

column_list=["column_name1", "column_name2", "column_name3", "column_name4"]

#filter the dataframe beforehand
ds[column_list].to_csv('output.csv',index=False)

#or use columns arg
ds.to_csv('output.csv', columns = column_list,index=False)

I provide index=False arg in order to write only column values

answered Apr 6, 2022 at 12:43

Konstantinos Roditakis

6156 silver badges6 bronze badges

Collectives™ on Stack Overflow

How to write specific columns of a dataframe to a CSV?

2 Answers 2

5 Comments

Comments

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

5 Comments

Comments

Linked

Related