ComputeSDK (@computesdk) / X

ComputeSDK

302 posts

ComputeSDK

@computesdk

Independent benchmarks for compute

Joined February 2025

Pinned
ComputeSDK
@computesdk
Jun 19
🚨 Benchmark Friday 🚨 After weeks of work from us and the participants, today we are excited to release the results of the 2026 100k Scale Invitational. Over the next hour we'll be releasing each set of results. Huge shoutout to @namespacelabs for powering our benchmarks!
ComputeSDK
@computesdk
15h
We're back with another addition of Benchmark Friday. It's been about 3 or 4 weeks since we switched to weekly runs and things seem to be progressing nicely. In the next few weeks we'll be rolling out daily test runs to the providers to help them build.
00:00
ComputeSDK
@computesdk
Jul 31
We just did a re-run of our AI Gateway benchmarks for ALL participants. We found some issues in our AI Gateway benchmark specifically with our implementation in tracking tokens per second on @concentrateai. 10% of the composite score is weighted for tokens per second so this
ComputeSDK
@computesdk
Jul 31
Results are just in from this weeks benchmarks. Find them in the thread below!
00:00
ComputeSDK
@computesdk
Jul 29
Claude is down. It's time to tune in to compute.fm.
With Or Without You by U2 — compute.fm
From compute.fm