The Wayback Machine - https://web.archive.org/web/20240713084231/https://techcrunch.com/2024/07/12/more-bad-news-for-elon-musk-after-x-users-legal-challenge-to-shadowban-prevails/
Social

More bad news for Elon Musk after X user’s legal challenge to shadowban prevails

Comment

X logo impaling twitter bird logo
Image Credits: Bryce Durbin / TechCrunch

It’s shaping up to be a terrible, no good, really bad news month for the company formerly known as Twitter. Elon Musk’s X has just been hit with a first clutch of grievances by the European Union for suspected breaches of the bloc’s Digital Services Act — an online governance and content moderation rulebook that features penalties of up to 6% of global annual turnover for confirmed violations.

But that’s not the only high-level decision that hasn’t gone Musk’s way lately. TechCrunch has learned that earlier this month X was found to have violated a number of provisions of the DSA and the bloc’s General Data Protection Regulation (GDPR), a pan-EU privacy framework where fines can reach 4% of annual turnover, following legal challenges brought by an individual after X shadowbanned his account.

X has long been accused of arbitrary shadowbanning — a particular egregious charge for a platform that claims to champion free speech.

PhD student Danny Mekić took action after he discovered X had applied visibility restrictions to his account in October last year. The company applied restrictions after he had shared a news article about an area of law he was researching, related to the bloc’s proposal to scan citizens’ private messages for child sexual abuse material (CSAM). X did not notify it had shadowbanned his account — which is one of the issues the litigation focused on.

Mekić only noticed his account had been impacted with restrictions when third parties contacted him to say they could no longer see his replies or find his account in search suggestions.

After his attempts to contact X directly to rectify the issue proved fruitless, Mekić filed a series of legal claims against X in the Netherlands under the EU Small Claims process, alleging the company had infringed key elements of the DSA, including failing to provide him with a point of contact (Article 12) to deal with his complaints; and failing to provide a statement of reasons (Article 17) for the restrictions applied to his account.

Mekić is a premium subscriber to X so he also sued the company for breach of contract.

On top of all that, after realizing he had been shadowbanned Mekić sought information from X about how it had processed his personal data — relying on the GDPR to make these data access requests. The regulation gives people in the EU a right to request a copy of information held on them, so when X failed to provide the personal information requested he had grounds for his second case: filing claims for breach of the bloc’s data protection rules.

In the DSA case, in a ruling on July 5 the court found X’s Irish subsidiary (which is actually still called Twitter) to be in breach of contract and ordered it to pay compensation for the period Mekić was deprived of the service he had paid for (just $1.87 — but the principle is priceless).

The court also ordered X to provide Mekić with a point of contact so he could communicate his complaints to the company within two weeks or face a fine of €100 per day.

On the DSA Article 17 complaint, Mekić also prevailed as the court agreed X should have sent him a statement of reasons when it shadowbanned his account. Instead he had to take the company to court to learn that an automated system had restricted his account after he shared a news article.

“I’m happy about that,” Mekić told TechCrunch. “There was a huge debate in the courtroom. Twitter said the DSA is not proportional and that shadowbans of complete accounts do not fall under DSA obligations.”

As a further kicker, the court deemed X’s general terms and conditions to be in breach of the EU’s Unfair Terms in Consumer Contracts Directive.

In the GDPR case, which the court ruled on on July 4, Mekić chalked up another series of wins. This case concerned the aforementioned data access rights but also Article 22 (automated decision making) — which states data subjects should not be subject to decisions based solely on automated processing where they have legal or significant effect.

The court agreed that the impact of X’s shadowban on Mekić was significant, finding it affected his professional visibility and potentially his employment prospects. The court therefore ordered X to provide him with meaningful information about the automated decision-making as required by the law within one month, along with the other personal information X has so far withheld, which Mekić had requested under GDPR data access rights.

If X continues to violate these data protection rules, the company is on the hook for fines of up to €4,000 per day.

X was also ordered to pay Mekić’s costs for both cases.

While the pair of rulings only concern individual complaints, they could have wider implications for enforcement of the DSA and the GDPR against X. The former is — as we’ve seen today — only just gearing up, as X gets stung with a first step of preliminary breach findings. But privacy campaigners have spent years warning the GDPR is being under-enforced against major platforms. And the strategic role core data protections should play in driving platform accountability remains far weaker than it could and should be.

“Bringing the claims was a final attempt to clarify my unjustified shadowban and get it removed,” Mekić told TechCrunch. “And, of course, I hope Twitter’s compliance with legal transparency obligations and low-threshold contact will improve to make it even better.”

“The European Commission seems to be very busy with investigations under the DSA. So far, regarding Twitter, the Commission seems to focus mainly on stricter content moderation. My appeal to the Commission is also to be mindful of the flip side: platforms should not overreach in their non-transparent content moderation practices,” he also told us.

“If you ask me, there is a simpler solution, namely, to curb algorithms on social media such as on Twitter, which are designed to maximise engagement and revenue and to bring back the chronological timelines of the heyday of Twitter and other social media platforms as standard.”

While the EU itself has a key role in enforcing the DSA’s rules on X, as is designated as a very large online platform (VLOP), its compliance with the wider general rules falls to a European member state-level oversight body: Ireland’s media regulator, Coimisiún na Meán.

Enforcement of the EU’s flagship data protection regime on Twitter/X typically falls to another Irish body, the Data Protection Commission (DPC), which is routinely accused of dragging its feet on investigating complaints about Big Tech.

Asked for information about its enforcement of various long-standing GDPR complaints against X, a spokesperson for the DPC said it could not provide a response by the time of publication.

Individuals bringing small claims against major platforms to try to get them to abide by pan-EU law is clearly suboptimal; there’s supposed to be a whole system of regulatory supervision to ensure compliance.

“On a side note, I did experience how much time and effort it takes to litigate in court,” said Mekić. “Despite the fact that in principle it can be done without a lawyer. Even so, you spend almost a year on it while the other party can outsource it to a battery of lawyers with near-infinite budgets and just ignore it in the meantime: indeed, I have never had direct contact with anyone from Twitter, they only communicate with me through lawyers.”

Asked whether he’s hopeful the outcome of his two cases will bring an end to X’s arbitrary shadowbanning for all EU users, Mekić said he doesn’t think his own success will be enough — regulatory enforcement is going to be needed for that.

“I hope so, but I’m afraid not,” he said. “There is little focus on the commercial motives behind shadowbans. If a user breaks a rule, you could temporarily block their account. That is transparent. But that also removes that user’s ad revenue for the platform. Shadowbans are a solution for that: the user is unaware of anything and continues to engage with and generate advertising revenue for the platform.”

“It would be a brave decision by social media platforms to stop applying shadow bans and only impose transparent, contestable restrictions on users. But that will presumably lead to loss of revenue. I hope Twitter will set other platforms a good example and inform users transparently about account restrictions, as required by the DSA. To do so, platforms do need to put their commercial intentions second,” said Mekić.

“It does surprise me that the Commission has not identified anything about the large-scale shadowbanning practices that users do not receive notifications about,” he added. “It happens daily on a large scale and is easier to prove than what they are focusing on now.”

X has been contacted for a response to the rulings.

More TechCrunch

Meta announced former President Donald Trump’s Facebook and Instagram accounts will no longer be subject to heightened suspension penalties, according to an updated blog post on Friday. The company says…

Meta removes special restrictions for Trump’s account ahead of 2024 elections

A Castro Valley resident was charged Thursday for allegedly slashing the tires of 17 Waymo robotaxis in San Francisco between June 24 and June 26, according to the city’s district…

Waymo cameras capture footage of person charged in alleged robotaxi tire slashings

Welcome to Startups Weekly — your weekly recap of everything you can’t miss from the world of startups. Sign up here to get it in your inbox every Friday. This…

Defending Russia’s EU neighbors

Cat-Wells said she started this platform because traditional hiring processes are exclusionary and often overlook skilled, talented disabled people.

A VC told Keely Cat-Wells to get a male, non-disabled co-founder — she balked, nabbed a $2M pre-seed round

A new study examines whether AI could be an automated helpmeet in creative tasks, with mixed results: It appeared to help less naturally creative people write more original short stories…

Experiment finds AI boosts creativity individually — but lowers it collectively

Featured Article

HeadSpin, whose founder is in prison for fraud, sold to PE firm in fire sale, sources say

In total, HeadSpin raised $117 million since its 2015 inception and was last valued at $1.1 billion in 2020.

HeadSpin, whose founder is in prison for fraud, sold to PE firm in fire sale, sources say

A bipartisan group of senators has introduced a new bill that seeks to protect artists, songwriters and journalists from having their content used to train AI models or generate AI…

New Senate bill seeks to protect artists’ and journalists’ content from AI use

When Keith Rabois announced he was leaving Founders Fund to return to Khosla Ventures in January, it came as a shock to many in the venture capital ecosystem — and…

From Ethan Choi to Spencer Peterson, venture capitalists continue to play musical chairs

Archer Aviation and Southwest Airlines are teaming up to figure out what it will take to build out a network of electric air taxis at California airports. Southwest’s customer data…

Archer’s vision of an air taxi network could benefit from Southwest customer data

If you visited the Wikipedia website on mobile this week, you might have seen a pop-up indicating that dark mode is ready for prime time.

Wikipedia’s mobile website finally gets a dark mode — here’s how to turn it on

Featured Article

What the AT&T phone records data breach means for you

The giant U.S. telco lost the information of around 110 million customers. Here’s what you need to know.

What the AT&T phone records data breach means for you

The error brings to a close SpaceX’s incredible streak of 335 flawless launches across the company’s Falcon family of rockets, which also includes the more powerful Falcon Heavy.

SpaceX Falcon 9 suffers rare failure on orbit during Starlink deployment

The AI chatbot has been trained on Amazon’s product catalog, customer reviews, community Q&As, and other public information found around the web.

Amazon AI chatbot Rufus is now live for all US customers

If X continues to violate Europe’s data protection rules, the company is on the hook for fines of up to €4,000 per day.

More bad news for Elon Musk after X user’s legal challenge to shadowban prevails
Image Credits: Bryce Durbin / TechCrunch

HERO Software has closed a €40 million Series B financing round, and plans to expand across Europe. 

A startup set out to fight climate change — it did it by helping plumbers

Fusion power may still be a few years away, but one startup is laying the groundwork for what it hopes will become a bustling sector of the economy.

Fusion pioneer Commonwealth Fusion Systems is selling core magnet tech to the University of Wisconsin

For months, rumors persisted that Google, and perhaps others, were interested in buying HubSpot, a Boston-based CRM and marketing software company. HubSpot’s market cap ballooned as the rumors persisted, eventually…

Boston VCs are pleased that HubSpot will remain an independent company

ByteDance’s video editing app CapCut will stop offering free cloud storage to host creative assets starting August 5. In the past few days, users have received notifications about CapCut changing…

CapCut will stop offering free cloud storage from August 5

The platform formerly known as Twitter has earned the dubious honor of being the first very large online platform (VLOP) to face a preliminary finding of breaching the European Union’s…

Europe confirms first clutch of DSA grievances on Elon Musk’s X

Featured Article

AT&T says criminals stole phone records of ‘nearly all’ customers in new data breach

The stolen data includes 110 million AT&T customer phone numbers, calling and text records, and some location-related data.

AT&T says criminals stole phone records of ‘nearly all’ customers in new data breach

The full and final text of the EU AI Act, the European Union’s landmark risk-based regulation for applications of artificial intelligence, has been published in the bloc’s Official Journal. In…

EU’s AI Act gets published in bloc’s Official Journal, starting clock on legal deadlines

Featured Article

SoftBank acquires UK AI chipmaker Graphcore

While the figure of $500 million has been bandied around in various reports for months, in a press briefing early Thursday morning, Graphcore co-founder and CEO Nigel Toon remained coy on the details.

SoftBank acquires UK AI chipmaker Graphcore

Elon Musk’s X, formerly Twitter, is continuing to develop a downvoting feature that will be used to improve how replies are ranked. Although the company has not yet officially announced…

X is building a ‘dislike’ button for downvoting replies

Featured Article

Data breach exposes millions of mSpy spyware customers

A huge batch of mSpy customer service emails dating back to 2014 were stolen in a May data breach.

Data breach exposes millions of mSpy spyware customers

Kudos founder says her company makes a disposable diaper lined with 100% cotton, unlike the major competitors.

Shark Tank-backed Kudos raises another $3M for healthier, cotton-based disposable diapers

Astra CEO Chris Kemp is already pulling out of a parking spot when he warns the person in the passenger seat that he doesn’t have a valid driver’s license. “And…

‘Wild Wild Space’ doc captures the risks and rivalries of the new space race

Although these companies’ claims are artfully couched, it’s clear that they want to express that the model sees in some sense of the word.

‘Visual’ AI models might not see anything at all

Welcome back to TechCrunch Mobility — your central hub for news and insights on the future of transportation. Sign up here for free — just click TechCrunch Mobility! Did you…

Lucid revs up sales, Fisker makes a deal and Uber reignites an old fight

Retro CEO Nathan Sharp isn’t worrying just yet about Google’s plan to copy his app’s experience, despite the numerous similarities.

Photo-sharing startup Retro spots Google Photos copying its idea and design

Tesla had internally planned to build the dedicated robotaxi and the $25,000 car, often referred to as the Model 2, on the same platform.

Tesla reportedly delays ‘robotaxi’ event to October