SWE-bench Verified is a human-filtered subset of 500 instances; use the Agent dropdown to compare LMs with mini-SWE-agent or view all agents [Post]. SWE-bench Multilingual features 300 tasks across 9 programming languages [Post]. SWE-bench Lite is a subset curated for less costly evaluation [Post]. SWE-bench Multimodal features issues with visual elements [Post]. Each entry reports the % Resolved
Aider LLM Leaderboards Aider excels with LLMs skilled at writing and editing code, and uses benchmarks to evaluate an LLM’s ability to follow instructions and edit code successfully without human intervention. Aider’s polyglot benchmark tests LLMs on 225 challenging Exercism coding exercises across C++, Go, Java, JavaScript, Python, and Rust. Aider polyglot coding leaderboard
JSer.info #684 - Tailwind CSS v4.0 alphaがリリースされました。 Open-sourcing our progress on Tailwind CSS v4.0 - Tailwind CSS OxideというRustで書かれたエンジンを追加、Lightning CSSを組み込むように変更することでパフォーマンスやビルドトインでサポートする構文が改善されています。また、記事ではv4のロードマップについても触れられています。 TypeScript 5.4がリリースされました。 Announcing TypeScript 5.4 - TypeScript BetaやRCからの大きな機能的な追加などはありません。 クロージャーにおけるNarrowing結果の改善、NoInfer Utility Typeの追加、 --module preserveの追加が行われ
As announced on browserbench.org today, in collaboration with other browser engine developers, Apple’s WebKit team is excited to introduce Speedometer 3.0, a major update that better reflects the Web of today. It’s built together by the developers of all major browser engines: Blink, Gecko, and WebKit with hundreds of contributions from companies like Apple, Google, Intel, Microsoft, and Mozilla.
Using libsodium in a web browser has been possible since 2013, thanks to the excellent Emscripten project. Since then, WebAssembly was introduced. A more efficient way to run code not originally written in JavaScript in a web browser. And libsodium added first-class support for WebAssembly in 2017. On web browsers supporting it, and in allowed contexts allowing it, that gave a nice speed boost. Li
Deploying to the edge is becoming more common, with multiple services that offer serverless edge computing. One of the most important factors is speed of deployment, since context switching and waiting for code to build and deploy can halt momentum, flow state, and developer productivity. So, which serverless edge compute platform handles deployments the fastest? I decided to setup a micro app to
import { Bench } from 'tinybench' const bench = new Bench({ name: 'simple benchmark', time: 100 }) bench .add('faster task', () => { console.log('I am faster') }) .add('slower task', async () => { await new Promise(resolve => setTimeout(resolve, 1)) // we wait 1ms :) console.log('I am slower') }) await bench.run() console.log(bench.name) console.table(bench.table()) // Output: // simple benchmark
Huge thanks to Jarred Sumner for reviewing this post. It wouldn’t have been possible without his help. Bun is a new and ambitious JavaScript toolset and runtime. Early adopters have been reporting that Bun JavaScript is incredibly fast. So fast that it has been touted by some as a Node.js killer. Curious, I decided to check out Bun for myself and benchmark it against the competition. Is it as fast
You’re seeing information for Japan . To see local features and services for another location, select a different city. Show more Introduction Shadower is a load testing tool that allows us to provide load testing as a service to any microservice at Uber. Shadower started as a command line application that allowed us to read a local file to load test a local application. At the time, Maps PEs were
25 October 2020 On Javascript Performance 1. Techempower Rankings by billwhizz Why is Javascript in the top 2 of techempower? This question was recently asked on github, prompted by the arrival of a new javascript platform near the summit of the intermediate techempower rankings. This platform, Just(js), is something I have been hacking on as a side-project for some time now. Here I will attempt t
All slide content and descriptions are owned by their creators.