Selenium webdriver and unicode

Question

It's my 2nd day with Selenium 2 library and the pain with Unicode never seem to subside.

I'm just doing the most basic operation, want to print the page source:

from selenium import webdriver


driver = webdriver.Firefox()
driver.get("http://google.com")

print driver.page_source

Sure enough, I get an error:

UnicodeEncodeError: 'ascii' codec can't encode character u'\u0119' in position 62045:  
ordinal not in range(128)

How can I please encode this to utf-8 ?

Community · Accepted Answer · 2017-05-23 11:54:51Z

30

You have options, based on this similar question.

You can either convert the source to all ascii losing the Unicode characters in the process.

(driver.page_source).encode('ascii', 'ignore')

Or, and I think you'll prefer this, you can encode it to utf-8 like this: (driver.page_source).encode('utf-8').

CommunityBot

11 silver badge

answered May 29, 2013 at 20:31

jaynp

3,3354 gold badges34 silver badges45 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

ron_g · Accepted Answer · 2018-10-31 11:07:02Z

1

Instead of print(string), use print(repr(string)) to return a printable representation of the object.

answered Oct 31, 2018 at 11:07

ron_g

1,7232 gold badges25 silver badges43 bronze badges