Reading JSON file using python produces spurious data

Question

I am trying to parse this json file: http://pastebin.com/VcVR0ue0

While using these modules

from pprint import pprint
import codecs
import json

file = 'Desktop10000_760_CurtSacks.json'

I've tried these methods

a)

data = data = json.load(open(file))

b)

data = json.load(codecs.open(file, encoding='utf_8_sig'))

In both cases the output has a u inserted in front of each key-value:

{u'document_tone': {u'tone_categories': [{u'category_id': u'emotion_tone',
                                          u'category_name': u'Emotion Tone',
                                          u'tones': [{u'score': 0.111838,
                                                      u'tone_id': u'anger',
                                                      u'tone_name': u'Anger'},
                                                     {u'score': 0.159831,
                                                      u'tone_id': u'disgust',
                                                      u'tone_name': u'Disgust'},
                                                     {u'score': 0.17082,
                                                      u'tone_id': u'fear',
                                                      u'tone_name': u'Fear'},
                                                     {u'score': 0.507748,
                                                      u'tone_id': u'joy',
                                                      u'tone_name': u'Joy'},
                                                     {u'score': 0.520722,
                                                      u'tone_id': u'sadness',
                                                      u'tone_name': u'Sadness'}]},

How do I read the file correctly?

thank you. now i feel this question wasn't an important one at all. but i'm glad i learned something basic. — samkhan13
– samkhan13, Commented Mar 11, 2017 at 3:22

user94559 · Accepted Answer · 2017-03-10 22:54:08Z

1

It looks like everything's being parsed properly.

Python's syntax for a unicode string is:

u'Here is the string.'

So the Python equivalent of this JSON:

{"foo": "bar"}

is this:

{u'foo': u'bar'}

If you just print out the Python representation of the data, you'll see the Python syntax.

answered Mar 10, 2017 at 22:54

user94559

60.3k6 gold badges108 silver badges107 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Community · Accepted Answer · 2017-05-23 12:25:20Z

0

The 'u' indicates a python unicode string - this is normal. The json library by nature returns unicode strings, so it looks like your data is being parsed properly.

If for whatever reason you don't want unicode strings in your JSON you can use yaml

import yaml
data = yaml.safe_load(open(file))
print( data )

So you'd get

{'key':'item'}

Instead of

{u'key':'item'}

Although I don't see a reason not to use unicode, as for most purposes it won't affect much. (see Python str vs unicode types)

edited May 23, 2017 at 12:25

CommunityBot

11 silver badge

answered Mar 10, 2017 at 23:21

Bob Person

812 silver badges6 bronze badges

Collectives™ on Stack Overflow

Reading JSON file using python produces spurious data

2 Answers 2

Comments

Comments

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Linked

Related