Create pandas dataframe from string (in csv format)

Question

I have a string in this format:

"A1","B1","C1","D1","E1","F1","G1","H1"\n"A2","B2","C2","D2","E2","F2" etc

where A to H are columns and the numbers refer to the rows.

I'm looking for the quickest way to create a pandas dataframe.

A long (in time to complete) approach I tried is to use:

df = pd.DataFrame()
for row in data:
    reader = csv.reader(row)
    mylist = []
    for element in reader:
        if element!=['','']:
            mylist.append(element[0])
    df2 = pd.DataFrame([mylist])
    df = df.append(df2)

I'm looking for a quicker way.

jezrael · Accepted Answer · 2018-10-24 10:13:40Z

20

I believe you need StringIO with read_csv:

import pandas as pd

data = '"A1","B1","C1","D1","E1","F1","G1","H1"\n"A2","B2","C2","D2","E2","F2"'
df = pd.read_csv(pd.compat.StringIO(data), header=None)

print (df)


    0   1   2   3   4   5    6    7
0  A1  B1  C1  D1  E1  F1   G1   H1
1  A2  B2  C2  D2  E2  F2  NaN  NaN

answered Oct 24, 2018 at 10:13

jezrael

868k103 gold badges1.4k silver badges1.3k bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

magiclantern Over a year ago

pd.compat.StringIO() was removed from Pandas some time ago (github.com/pandas-dev/pandas/pull/25954). Newer Pandas versions with Python 3 require from io import StringIO

Pfalbaum Over a year ago

So, it would look like: df = pd.read_csv(StringIO(data), header=None)

Collectives™ on Stack Overflow

Create pandas dataframe from string (in csv format)

1 Answer 1

2 Comments

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Related