10

I'm aware of the fact that for Python < 3, unicode encoding for the string 'Plants vs. Zombies䋢 2' is as below:

u"Plants vs. Zombies䋢 2".encode("utf-8")

What if I have an variable (say appName) instead of a string can I do it like this:

  appName = "Plants vs. Zombies䋢 2"
 u+appName.encode("utf-8")

For:

 appName = appName.encode('utf-8');


 'ascii' codec can't decode byte 0xe4 in position 18: ordinal not in range(128)
12
  • 1
    Sure, if it has .encode method. Commented Nov 25, 2013 at 21:05
  • 1
    Why don't you just try and see what happens? Commented Nov 25, 2013 at 21:06
  • If appName is a unicode string then you can just use appName.encode(). If that doesn't work you don't have a unicode string perhaps. Commented Nov 25, 2013 at 21:06
  • @freakish: No, not with that u business. Commented Nov 25, 2013 at 21:09
  • @BrenBarn Surely, if he defined u variable. Commented Nov 25, 2013 at 21:09

3 Answers 3

13

No. The u notation is only for string literals. Variables containing string data don't need the u, because the variable contains an object that is either a unicode string or a byte string. (I'm assuming here that appName contains string data; if it doesn't, it doesn't make sense to try to encode it. Convert it to a bytestring or unicode first.)

So your variable either contains a unicode string or a byte string. If it is a unicode string you can just do appName.encode("utf-8").

If it is a byte string then it is already encoded with some encoding. If it's already encoded as UTF-8, then it's already how you want it and you don't need to do anything. If it's in some other encoding and you want to get it into UTF-8, you can do appName.decode('the-existing-encoding').encode("utf-8").

Note that if you do what you show in your edited, question, the result might not be what you expect. You have:

appName = "Plants vs. Zombies䋢 2"

Without the u on the string literal, you have created a bytestring in some encoding, namely the encoding of your source file. If your source file isn't in UTF-8, then you're in the last situation I described above. There is no way to "just make a string unicode" after you have created it as non-unicode. When you create it as non-unicode, you are creating it in a particular encoding, and you have to know what encoding that is in order to decode it to unicode (so you can then encode it to another encoding if you want).

Sign up to request clarification or add additional context in comments.

2 Comments

Your variable either contains a unicode string or a byte string Where is that stated?
@freakish: It doesn't say it, but it's implied by the way he's using u and by his example with a string literal. I clarified my answer to say I'm assuming appName contains string data.
2

No. the u prefix modifies the meaning of a string constant (making it a unicode constant). It is not an operator (which could be applied to any expression).

Comments

0

I think you can try below line:

s = "Plants vs. Zombies䋢 2" unicode(s, errors='ignore').encode('ascii')

It can translate any string variable to unicode type, default is using 'ascii', then you can encode it with 'ascii' which will make the type become normal string type.

Update for Python 3:

s.decode('ascii', 'ignore').encode('ascii')

https://docs.python.org/2/howto/unicode.html

Best way to convert string to bytes in Python 3?

Comments

Start asking to get answers

Find the answer to your question by asking.

Ask question

Explore related questions

See similar questions with these tags.