python 3.2 html parser

Question

Im relative new python im trying the html.parser as fallow:

from html.parser import HTMLParser
import urllib.request


class TestParser(HTMLParser):
    def handle_starttag(self, tag, attrs):
        print("Start Tag: ", tag, attrs)
    def handle_endtag(self, tag):
        print("End Tag: ", tag)
    def handle_data(self, data):
        print("Data: ", data)
    def handle_startendtag(self,tag,attrs):
        print("StarEnd Tag: ", tag, attrs)

class DanParser(HTMLParser):
    def __init__(self):
        super(DanParser, self).__init__(strict = False)
        self.in_select = False


    def handle_starttag(self, tag, attrs):
        print("Start Tag: ", tag, attrs)
        if tag == "select":
            self.in_select = True
            print("Start Tag: ", tag, attrs)


    def handle_endtag(self, tag):
        print("EndTag: ", tag)
        if tag == "select" and self.in_select:
            self.in_select = False
            print("EndTag: ", tag)


    def handle_data(self, data):
        print("Data: ", data)
        if self.in_select:
            print("Data: ", data)


    def handle_startendtag(self,tag,attrs):
        print("StarEnd Tag: ", tag, attrs)

When i do in the interpreter

t = new DanParser()
t.feed("<select>test</select>")

im getting:

Data:  <select>
Data:  test
EndTag:  select

the method handle_starttag is not been called, but when i do it using the TestParser its behaving correctly. Can anyone tell me what im doing wrong!!! thanks

What does string=False mean? According to the docs HTMLParser doesn't take arguments. Also t = new DanParser() is a syntax error and your indentation is incorrect. Fixing these and your example works for me. — aquavitae
– aquavitae, Commented Mar 16, 2012 at 10:13
BTW if this is real code and not just practice you should consider using lxml python lib for the html parsing.. and requests library instead of urllib — alonisser
– alonisser, Commented Mar 16, 2012 at 10:52
@aquavitae: HTMLParser() has strict argument since Python3.2 — jfs
– jfs, Commented Mar 16, 2012 at 19:52
i just check it your link, quite interesting that its working, but i can ensure you that its not working on my computer. could be this a problem with my interpreter or source code file text encoding — yehezkel
– yehezkel, Commented Mar 17, 2012 at 12:40

lajos_molnar · Accepted Answer · 2012-11-12 16:30:45Z

2

This is due to the strict=False. When strict=False, start handlers are not called. They are called when strict=True. This may be a bug in python's HTMLParser. moul's example works as he uses the default True value for strict.

answered Nov 12, 2012 at 16:30

lajos_molnar

213 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

moul · Accepted Answer · 2012-03-16 10:38:06Z

The following code works for me :

from HTMLParser import HTMLParser

class DanParser(HTMLParser):
    def __init__(self):
        HTMLParser.__init__(self)
        self.in_select = False

    def handle_starttag(self, tag, attrs):
        print("Start Tag: ", tag, attrs)
        if tag == "select":
            self.in_select = True
            print("Start Tag: ", tag, attrs)

    def handle_endtag(self, tag):
        print("EndTag: ", tag)
        if tag == "select" and self.in_select:
            self.in_select = False
            print("EndTag: ", tag)

    def handle_data(self, data):
        print("Data: ", data)
        if self.in_select:
            print("Data: ", data)

    def handle_startendtag(self,tag,attrs):
        print("StarEnd Tag: ", tag, attrs)

t = DanParser()
t.feed("<select>test</select>")

i changed the implementation of DanParser with out implementing the constructor and it works as expected, any way i will try your solution. I can't explain way this problem calling the base class. Thank you very much to all of you

Steven · Accepted Answer · 2012-03-16 19:13:08Z

1

Tip: make it easy for yourself and do not use this. Try lxml.html, html5lib or BeautifulSoup

answered Mar 16, 2012 at 19:13

Steven

28.9k6 gold badges63 silver badges51 bronze badges

Collectives™ on Stack Overflow

python 3.2 html parser

3 Answers 3

Comments

1 Comment

Comments

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

Comments

1 Comment

Comments

Related