PHP: Converting from UTF-8 HTML

Question

I have a French site that I want to parse, but am running into problems converting the (uft-8) html to latin-1.

The problem is shown in the following phpunit test case:

class Test extends PHPUnit_Framework_TestCase {

    private static function fromHTML($str){
        return html_entity_decode($str, ENT_QUOTES, 'UTF-8');
    }

    public function test1(){

        //REMOVE THE SPACE between the '&' and 'nbsp'. SO won't
        //let me write it without the space
        $strFrom    = 'Wanted& nbsp;: les Chasseurs de Tamriel';
        $strTo  = 'Wanted : les Chasseurs de Tamriel';
        $strFrom = self::fromHTML($strFrom);
        $this->assertEquals($strTo, $strFrom);
    }

    public function test2(){
        $strFrom    = 'Remplacement d&#8217;Almalexia';
        $strTo      = 'Remplacement d’Almalexia';
        $strFrom = self::fromHTML($strFrom);
        $this->assertEquals($strTo, $strFrom);
    }

    }

test2 completes fine. test1 seems to fail as the space isn't correct, so when converted to ascii it ends up as a unknown character (�).

How would I ensure both tests pass?

Why is there a space between the '&' and 'nbsp;'? Is that what you are trying to fix? — Nate
– Nate, Commented Aug 7, 2009 at 13:57
Because I can't write it without the space as SO converts it into a space if I don't — Yacoby
– Yacoby, Commented Aug 7, 2009 at 14:01

Community · Accepted Answer · 2017-05-23 12:13:35Z

2

test1 does not fail, its answer is correct. The strings you compare are not the same. “ ” is not decoded to a space (0x20). It’s a non-breaking space character and as such gets decoded to 0xa0. When you change strTo to contain that character before the colon the assertEquals will return true. Of course you have to make sure that your file is saved with the UTF-8 encoding, just as PERR0_HUNTER mentioned but seeing that you use the “’” character you are probably already doing that. :)

edited May 23, 2017 at 12:13

CommunityBot

11 silver badge

answered Aug 7, 2009 at 15:00

Bombe

84.3k20 gold badges127 silver badges127 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

perrohunter · Accepted Answer · 2009-08-07 13:48:57Z

2

Just as a small suggestion, make sure that your .php file encoding is set to utf8, you don't know how many people miss that.

answered Aug 7, 2009 at 13:48

perrohunter

3,5468 gold badges41 silver badges58 bronze badges

Collectives™ on Stack Overflow

PHP: Converting from UTF-8 HTML

2 Answers 2

Comments

Comments

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Related