ToplingDB vs RocksDB bench results
dcompact bench →
— offloads most CPU and memory cost.
Updated (UTC): 2026-10-08 09:56:31+00:00
Latest: plain
run_id=37752667561 |
result table |
2026-10-08 09:56:30+00:00
raw logs: ToplingDB zipkeyonly | ToplingDB zipkeyvalue | RocksDB v8.10 | RocksDB master (dec67990) | DB INFO LOGs + bench yamls (Actions artifact)
ToplingDB bench yaml: zipkeyonly db_bench-fillrandom.yaml | zipkeyonly db_bench-fillseq.yaml | zipkeyonly db_bench-fillseq-cspp.yaml | zipkeyvalue db_bench-fillrandom.yaml | zipkeyvalue db_bench-fillseq.yaml | zipkeyvalue db_bench-fillseq-cspp.yaml
Runner hardware/software
| OS | Ubuntu 24.04.5 LTS |
| Kernel | 6.17.0-1022-azure |
| CPU | AMD EPYC 7763 64-Core Processor |
| Logical CPUs | 4 |
| Memory | 15.6GiB |
| /dev/shm | 11.7GiB |
| RocksDB block cache | 7.8GiB |
num=50000000 | key_size=8 | value_size=50
On-disk DB size (1.9GiB) ≤ block cache (7.8GiB) — the dataset fits in cache, so this bench is a CPU and memory comparison.
/dev/shm usage (disk space; after db_bench)
Allocated disk usage (IEC blocks). zipkeyonly does not compress values (speed-optimized). RocksDB uses per-level compression (L0 none, L1-L5 Snappy, L6 Zstd), corresponding to the ToplingDB zipkeyvalue variant's level_writers (lightweight upper levels, heavyweight L6). Space ratio = engine / v8.10. color sign: ToplingDB is Better/Worse.
| workload | ToplingDB zipkeyonly | ToplingDB zipkeyvalue | RocksDB v8.10 | RocksDB master (dec67990) | zipkeyonly / v8.10 (space) | zipkeyvalue / v8.10 (space) |
| fillrandom suite | 2.0GiB | 736.0MiB | 1.9GiB | 1.9GiB | 1.07x | 0.39x |
| fillseq suite | 3.2GiB | 1.4GiB | 1.6GiB | 1.6GiB | 1.98x | 0.87x |
| fillseq suite (CSPP) | 2.9GiB | 1.1GiB | n/a | n/a | — | — |
Peak RSS (RAM; during db_bench)
RSS is Resident Set Size. RocksDB block cache = half physical memory (7.8GiB). Ratio = engine / v8.10. color sign: ToplingDB is Better/Worse. RocksDB omit cells are =readseq (same scan; no omit). scan-omit-value: restart process, reuse fill* data, scan without access value, benefited by lazy load value (ToplingDB feature).
| workload | ToplingDB zipkeyonly | ToplingDB zipkeyvalue | RocksDB v8.10 | RocksDB master (dec67990) | zipkeyonly / v8.10 (RSS) | zipkeyvalue / v8.10 (RSS) |
| fillrandom suite peak | 2.3GiB | 2.5GiB | 2.1GiB | 2.1GiB | 1.11x | 1.18x |
| fillrandom suite readrandompeak RSS during the readrandom stage of the fillrandom suite | 138.7MiBNot include (value's) shared RSS — mmap slice as source → direct → user slice as target ^^^^^^^^^^ ^^^^^^ not zipped not touched not bring to shared RSS | 391.8MiBInclude (value's) shared RSS — mmap slice as source → decompress → user slice as target ^^^^^^^^^^ ^^^^^^^^^^ zipped read source bring mmap to shared RSS | 2.1GiBmainly block cache;
file page cache is not counted in shared/RSS, so actual RAM is larger, as the chart below shows | 2.1GiBmainly block cache;
file page cache is not counted in shared/RSS, so actual RAM is larger, as the chart below shows | 0.07x | 0.19x |
| fillrandom scan-omit-valuerestart process with reuse db data of fillrandom, scan without access value, benefited by lazy load value (ToplingDB feature) | 127.7MiB | 139.5MiB | 2.1GiB (=readseq) | 2.1GiB (=readseq) | 0.06x | 0.06x |
| fillseq suite peak | 1.9GiB | 1.9GiB | 3.2GiB | 3.3GiB | 0.59x | 0.60x |
| fillseq suite readrandompeak RSS during the readrandom stage of the fillseq suite | 140.9MiBNot include (value's) shared RSS — mmap slice as source → direct → user slice as target ^^^^^^^^^^ ^^^^^^ not zipped not touched not bring to shared RSS | 751.6MiBInclude (value's) shared RSS — mmap slice as source → decompress → user slice as target ^^^^^^^^^^ ^^^^^^^^^^ zipped read source bring mmap to shared RSS | 3.2GiBmainly block cache;
file page cache is not counted in shared/RSS, so actual RAM is larger, as the chart below shows | 3.3GiBmainly block cache;
file page cache is not counted in shared/RSS, so actual RAM is larger, as the chart below shows | 0.04x | 0.23x |
| fillseq scan-omit-valuerestart process with reuse db data of fillseq, scan without access value, benefited by lazy load value (ToplingDB feature) | 119.7MiB | 142.7MiB | 3.2GiB (=readseq) | 3.3GiB (=readseq) | 0.04x | 0.04x |
| fillseq suite (CSPP) peak | 2.1GiB | 2.6GiB | n/a | n/a | — | — |
| fillseq suite (CSPP) readrandompeak RSS during the readrandom stage of the fillseq suite (CSPP) | 147.3MiBNot include (value's) shared RSS — mmap slice as source → direct → user slice as target ^^^^^^^^^^ ^^^^^^ not zipped not touched not bring to shared RSS | 707.0MiBInclude (value's) shared RSS — mmap slice as source → decompress → user slice as target ^^^^^^^^^^ ^^^^^^^^^^ zipped read source bring mmap to shared RSS | n/amainly block cache;
file page cache is not counted in shared/RSS, so actual RAM is larger, as the chart below shows | n/amainly block cache;
file page cache is not counted in shared/RSS, so actual RAM is larger, as the chart below shows | — | — |
| fillseq scan-omit-value (CSPP)restart process with reuse db data of fillseq (CSPP), scan without access value, benefited by lazy load value (ToplingDB feature) | 119.9MiB | 143.2MiB | n/a | n/a | — | — |
RAM usage over time
Sampled once per second from /proc/statm plus open-file page cache. The bar below each plot shows stage name + duration (consecutive repeats merge, e.g. readseq×3); colored bands mark the same intervals. Stage names may overflow into a neighbor cell; a label under the bar is used only when names would overlap.
Comparison: db_bench fillrandom suite (perf)
Benchmarks: fillrandom, flush, compact, readseq×3, readrandom. RocksDB uses per-level compression (L0 none, L1-L5 Snappy, L6 Zstd), corresponding to the ToplingDB zipkeyvalue variant's level_writers (lightweight upper levels, heavyweight L6). compact row shows operations/time. color sign: ToplingDB is Better/Worse.
| benchmark | ToplingDB zipkeyonly ops/sec | ToplingDB zipkeyvalue ops/sec | RocksDB v8.10 ops/sec | RocksDB master (dec67990) ops/sec | zipkeyonly / zipkeyvalue | zipkeyonly / v8.10 | zipkeyonly / master (dec67990) | zipkeyvalue / v8.10 | zipkeyvalue / master (dec67990) |
| fillrandom | 1789140 | 1869543 | 801313 | 700054 | 0.96x | 2.23x | 2.56x | 2.33x | 2.67x |
| compact | 1/26.0s | 1/34.9s | 1/30.2s | 1/37.4s | 1.34x | 1.16x | 1.44x | 0.87x | 1.07x |
| readseq | 25635898 | 17115386 | 10751547 | 6729048 | 1.50x | 2.38x | 3.81x | 1.59x | 2.54x |
| readrandom | 5830006 | 2399984 | 400316 | 338891 | 2.43x | 14.56x | 17.20x | 6.00x | 7.08x |
Comparison: db_bench fillseq suite (perf)
Same as fillrandom, except ToplingDB fillseq uses OffsetSkipList (fillrandom still uses CSPP). RocksDB fillseq benefits from shortcuts: trivial_move on non-overlapping SSTs; refit level skips zstd on L6: faster, larger size. Seqno-zeroing compact still runs.
| benchmark | ToplingDB zipkeyonly ops/sec | ToplingDB zipkeyvalue ops/sec | RocksDB v8.10 ops/sec | RocksDB master (dec67990) ops/sec | zipkeyonly / zipkeyvalue | zipkeyonly / v8.10 | zipkeyonly / master (dec67990) | zipkeyvalue / v8.10 | zipkeyvalue / master (dec67990) |
| fillseq | 3678852 | 3810866 | 2542208 | 2537613 | 0.97x | 1.45x | 1.45x | 1.50x | 1.50x |
| compact | 1/21.1s | 1/63.4s | 1/19.0s | 1/21.1s | 3.00x | 0.90x | 1.00x | 0.30x | 0.33x |
| readseq | 30530398 | 20379681 | 10719933 | 6754525 | 1.50x | 2.85x | 4.52x | 1.90x | 3.02x |
| readrandom | 6210253 | 1751546 | 370559 | 359095 | 3.55x | 16.76x | 17.29x | 4.73x | 4.88x |
Comparison: db_bench fillseq suite (CSPP) (perf)
Same as fillrandom, except ToplingDB fillseq uses CSPP. RocksDB fillseq benefits from shortcuts: trivial_move on non-overlapping SSTs; refit level skips zstd on L6: faster, larger size. Seqno-zeroing compact still runs.
| benchmark | ToplingDB zipkeyonly ops/sec | ToplingDB zipkeyvalue ops/sec | RocksDB v8.10 ops/sec | RocksDB master (dec67990) ops/sec | zipkeyonly / zipkeyvalue | zipkeyonly / v8.10 | zipkeyonly / master (dec67990) | zipkeyvalue / v8.10 | zipkeyvalue / master (dec67990) |
| fillseq | 3325109 | 3447608 | 2542208 | 2537613 | 0.96x | 1.31x | 1.31x | 1.36x | 1.36x |
| compact | 1/19.8s | 1/62.0s | 1/19.0s | 1/21.1s | 3.13x | 0.96x | 1.06x | 0.31x | 0.34x |
| readseq | 30673943 | 20602745 | 10719933 | 6754525 | 1.49x | 2.86x | 4.54x | 1.92x | 3.05x |
| readrandom | 6135299 | 1764109 | 370559 | 359095 | 3.48x | 16.56x | 17.09x | 4.76x | 4.91x |
Lazy load demo (scan; RocksDB v8.10 baseline)
zipkey* needs an extra omit pass: scan_omit_key/value enables lazy value load (no real value load). RocksDB has no lazy load, so the baseline is readseq×3 already present in the main fill* suite (no extra pass). RocksDB nextwithkey cells are =readseq. master omitted here (v8.10 is the stronger RocksDB baseline). color sign: ToplingDB is Better/Worse.
scan-omit-value on data from fillrandom
| benchmark | ToplingDB zipkeyonly ops/sec | ToplingDB zipkeyvalue ops/sec | RocksDB v8.10 ops/sec | zipkeyonly / v8.10 | zipkeyvalue / v8.10 |
| readseq | 37803724 | 38606878 | 10751547 | 3.52x | 3.59x |
| nextwithkey | 39746544 | 39921434 | 10751547 (=readseq) | 3.70x | 3.71x |
scan-omit-value on data from fillseq
| benchmark | ToplingDB zipkeyonly ops/sec | ToplingDB zipkeyvalue ops/sec | RocksDB v8.10 ops/sec | zipkeyonly / v8.10 | zipkeyvalue / v8.10 |
| readseq | 51338233 | 50831553 | 10719933 | 4.79x | 4.74x |
| nextwithkey | 52316578 | 51527693 | 10719933 (=readseq) | 4.88x | 4.81x |
scan-omit-value on data from fillseq (CSPP)
| benchmark | ToplingDB zipkeyonly ops/sec | ToplingDB zipkeyvalue ops/sec | RocksDB v8.10 ops/sec | zipkeyonly / v8.10 | zipkeyvalue / v8.10 |
| readseq | 50781734 | 50779258 | 10719933 | 4.74x | 4.74x |
| nextwithkey | 52157277 | 51726421 | 10719933 (=readseq) | 4.87x | 4.83x |
memtablerep_bench: OffsetSkipList and CSPP vs skiplist
Focus: OffsetSkipList / CSPP (ToplingDB) vs skiplist. Baseline = RocksDB v8.10 skiplist. color sign: ToplingDB is Better/Worse.
| benchmark | metric | OffsetSkipList (ToplingDB) | CSPP (ToplingDB) | skiplist (ToplingDB) | skiplist (RocksDB v8.10) | OffsetSkipList / v8.10 | CSPP / v8.10 |
| fillrandom | Elapsed time | 243443593 us (2.43444 us/op) | 25159609 us (0.251596 us/op) | 274530713 us (2.74531 us/op) | 300764319 us (3.00764 us/op) | 0.81x | 0.08x |
| fillrandom | Write throughput | 6.65964 MiB/s | 64.4385 MiB/s | 5.90552 MiB/s | 5.39042 MiB/s | 1.24x | 11.95x |
| readrandom | Elapsed time | 263408026 us (2.63408 us/op) | 33533229 us (0.335332 us/op) | 325868860 us (3.25869 us/op) | 325682295 us (3.25682 us/op) | 0.81x | 0.10x |
| readrandom | Read throughput | 6.15489 MiB/s | 48.3475 MiB/s | 4.97515 MiB/s | 4.978 MiB/s | 1.24x | 9.71x |
History
- 2026-10-08 09:56:30+00:00 — plain run_id=37752667561 — result table
- 2026-10-06 13:42:56+00:00 — plain run_id=37461951055 — result table
- 2026-09-15 07:18:23+00:00 — plain run_id=34935695406 — result table
- 2026-09-14 06:56:05+00:00 — plain run_id=34809394323 — result table
- 2026-09-13 18:28:04+00:00 — plain run_id=34770497158 — result table
- 2026-09-13 00:02:25+00:00 — plain run_id=34722719277 — result table
- 2026-09-12 19:11:46+00:00 — plain run_id=34708681171 — result table
- 2026-09-12 15:43:43+00:00 — plain run_id=34698861539 — result table
- 2026-08-31 15:48:30+00:00 — plain run_id=33404363930 — result table
- 2026-08-30 11:14:25+00:00 — plain run_id=33306036311 — result table
- 2026-08-23 16:20:05+00:00 — plain run_id=32643128750 — result table
- 2026-08-18 15:53:23+00:00 — plain run_id=32148249444 — result table
- 2026-08-16 17:28:08+00:00 — plain run_id=31957895530 — result table
- 2026-08-16 04:43:40+00:00 — plain run_id=31921183844 — result table
- 2026-08-16 03:27:00+00:00 — plain run_id=31918647193 — result table
- 2026-08-16 02:07:06+00:00 — plain run_id=31914258669 — result table
- 2026-08-16 00:41:41+00:00 — plain run_id=31914256719 — result table
- 2026-08-15 18:00:11+00:00 — plain run_id=31896896755 — result table
- 2026-08-15 14:01:09+00:00 — plain run_id=31884049900 — result table
- 2026-08-15 13:08:09+00:00 — dcompact run_id=31880805602 — result table
- 2026-08-15 11:25:39+00:00 — plain run_id=31873946138 — result table
- 2026-08-15 10:07:47+00:00 — dcompact run_id=31873910431 — result table
- 2026-08-15 06:19:56+00:00 — plain run_id=31866312589 — result table
- 2026-08-14 15:45:19+00:00 — dcompact run_id=31800981467 — result table
- 2026-08-14 14:00:45+00:00 — plain run_id=31800922314 — result table
- 2026-08-14 12:01:06+00:00 — dcompact run_id=31787128815 — result table
- 2026-08-14 10:14:47+00:00 — plain run_id=31787125871 — result table
- 2026-08-09 17:28:01+00:00 — dcompact run_id=31324418704 — result table
- 2026-08-09 10:21:07+00:00 — dcompact run_id=31303589765 — result table
- 2026-08-09 09:29:35+00:00 — dcompact run_id=31298143542 — result table
- 2026-08-09 07:40:13+00:00 — plain run_id=31298142068 — result table
- 2026-08-08 13:03:29+00:00 — plain run_id=31252003395 — result table
- 2026-08-08 11:48:09+00:00 — dcompact run_id=31251963803 — result table
- 2026-08-08 09:12:52+00:00 — plain run_id=31247301157 — result table
- 2026-08-08 03:43:31+00:00 — plain run_id=31234948599 — result table
- 2026-08-07 23:42:24+00:00 — plain run_id=31220758079 — result table
- 2026-08-07 22:21:52+00:00 — plain run_id=31218150702 — result table
- 2026-08-07 17:54:24+00:00 — plain run_id=31199586368 — result table
- 2026-08-07 16:10:39+00:00 — plain run_id=31191036555 — result table