Skip to content

Commit f59bf8e

Browse files
ClickBench/bqn: drop the in-memory tag
index.html:1096 filters out anything tagged "in-memory" from the combined/cold/load metrics, so BQN was missing from those views on benchmark.clickhouse.com. The exclusion exists so dataframe- style systems that load the whole dataset into RAM during ./load (Pandas, Polars DataFrame, DuckDB DataFrame/memory, chDB DataFrame, Daft, …) don't compete in metrics where they have no cold path. BQN doesn't work that way. prep.py writes 118 GB of per-column files under ./cols/ and every query reads the columns it needs from disk via •FBytes; nothing stays resident between queries. The hot/cold gap in BQN's results is the OS file cache, exactly like DuckDB embedded (tagged just ["C++","column-oriented", "DuckDB derivative","embedded"], no "in-memory"). The remaining tags ["C","embedded","array language"] describe the entry accurately and let BQN appear in combined. Apply to bqn/template.json, the 5 per-machine result JSONs already committed for 2026-05-29, and the matching rows in data.generated.js so the website reflects the change immediately without waiting for the next [bot] Build the website run.
1 parent 70babb7 commit f59bf8e

7 files changed

Lines changed: 10 additions & 11 deletions

File tree

bqn/results/20260529/c6a.4xlarge.json

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@
66
"proprietary": "no",
77
"hardware": "cpu",
88
"tuned": "no",
9-
"tags": ["C","embedded","in-memory","array language"],
9+
"tags": ["C","embedded","array language"],
1010
"load_time": 526,
1111
"data_size": 118169498884,
1212
"concurrent_qps": 0.042,

bqn/results/20260529/c6a.metal.json

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@
66
"proprietary": "no",
77
"hardware": "cpu",
88
"tuned": "no",
9-
"tags": ["C","embedded","in-memory","array language"],
9+
"tags": ["C","embedded","array language"],
1010
"load_time": 472,
1111
"data_size": 118169498884,
1212
"concurrent_qps": 0.223,

bqn/results/20260529/c7a.metal-48xl.json

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@
66
"proprietary": "no",
77
"hardware": "cpu",
88
"tuned": "no",
9-
"tags": ["C","embedded","in-memory","array language"],
9+
"tags": ["C","embedded","array language"],
1010
"load_time": 473,
1111
"data_size": 118169498884,
1212
"concurrent_qps": 0.235,

bqn/results/20260529/c8g.4xlarge.json

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@
66
"proprietary": "no",
77
"hardware": "cpu",
88
"tuned": "no",
9-
"tags": ["C","embedded","in-memory","array language"],
9+
"tags": ["C","embedded","array language"],
1010
"load_time": 518,
1111
"data_size": 118169498884,
1212
"concurrent_qps": 0.042,

bqn/results/20260529/c8g.metal-48xl.json

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@
66
"proprietary": "no",
77
"hardware": "cpu",
88
"tuned": "no",
9-
"tags": ["C","embedded","in-memory","array language"],
9+
"tags": ["C","embedded","array language"],
1010
"load_time": 472,
1111
"data_size": 118169498884,
1212
"concurrent_qps": 0.237,

bqn/template.json

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,6 @@
66
"tags": [
77
"C",
88
"embedded",
9-
"in-memory",
109
"array language"
1110
]
1211
}

data.generated.js

Lines changed: 5 additions & 5 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

0 commit comments

Comments
 (0)