GNU sed solution:
sed -E '/^([^,]+,)\1/d' input.csv
The output:
text1,text2,string1,string2
text4,text5,string1,string2
GNU sed solution:
sed -E '/^([^,]+,)\1/d' input.csv
The output:
text1,text2,string1,string2
text4,text5,string1,string2