json.load changing the string that is input

Question

Hi I am working on a simple program that takes data from a json file (input through an html form with flask handling the data) and uses this data to make calls to an API.

So I have some JSON like this:

[{"id": "ßLÙ", "server": "NA"}]

and I want to send the id to an api call like this example:

http://apicallnamewhatever+id=ßLÙ

however when i load the json file into my app.py with the following command

ids = json.load(open('../names.json'))

json.load seems to alter the id from 'ßLÙ' to 'ÃŸLÃ™'

im not sure why this happens during json.load, but i need to find a way to get 'ßLÙ' into the api call instead of the deformed 'ÃŸLÃ™'

Are you using Python 2 or Python 3? If Python 3, what is your locale set to when you call open()? — jwodder
– jwodder, Commented Sep 29, 2018 at 21:38
Your encoding might be windows-1252. "ßLÙ".encode("utf8").decode("windows-1252") --> 'ÃŸLÃ™' — jDo
– jDo, Commented Sep 29, 2018 at 21:46

Andrey Tyukin · Accepted Answer · 2018-09-29 21:52:07Z

4

It looks as if your names.json is encoded in "utf-8", but you are opening it as "windows-1252" [*] or something like that. Try

json.load(open('names.json', encoding="utf-8"))

and you probably should also URL-encode the id instead of concatenating it directly with that server address, something along these lines:

urllib2.quote(idExtractedFromJson.encode("utf-8")

[*] Thanks @jDo for pointing that out, I initially guessed the wrong codepage.

edited Sep 29, 2018 at 21:52

answered Sep 29, 2018 at 21:39

Andrey Tyukin

45.1k4 gold badges65 silver badges103 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

json.load changing the string that is input

1 Answer 1

Comments

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Related