Bench run: dcompact / 31787128815

← plain home | ← dcompact

generated (UTC): 2026-08-14T12:01:06.157643+00:00

ToplingDB zipkeyonly db_bench | ToplingDB zipkeyvalue db_bench | RocksDB v8.10 db_bench | RocksDB master (5fe22535) db_bench | DB INFO LOGs (Actions artifact) — ToplingDB zipkeyonly LOG-fillrandom, ToplingDB zipkeyonly LOG-fillseq, ToplingDB zipkeyvalue LOG-fillrandom, ToplingDB zipkeyvalue LOG-fillseq, RocksDB v8.10 LOG-fillrandom, RocksDB v8.10 LOG-fillseq, RocksDB master (5fe22535) LOG-fillrandom, RocksDB master (5fe22535) LOG-fillseq

ToplingDB bench yaml (runtime graft): ToplingDB zipkeyonly db_bench-fillrandom.yaml | ToplingDB zipkeyonly db_bench-fillseq.yaml | ToplingDB zipkeyvalue db_bench-fillrandom.yaml | ToplingDB zipkeyvalue db_bench-fillseq.yaml

Bench configuration (dcompact)

Write-side db_bench CPU quota: 50% (from runner_env.txt cpu_quota_write). Topling compact: dcompact_worker — dcompact_worker runs outside the write cgroup and uses remaining CPU cores. RocksDB compact: compaction_service_spool — CompactionService spool + out-of-cgroup broker/worker on remaining cores.

Runner hardware/software

On-disk DB size (3.7GiB) ≤ block cache (7.8GiB) — cache can hold the entire dataset. So this benchmark mainly shows CPU and memory cost.

/dev/shm usage (disk space; after db_bench)

Allocated disk usage (IEC blocks). RocksDB uses default Snappy compression. Space ratio = engine / v8.10; <1 = less space than RocksDB, >1 = larger.

Peak RSS (RAM; during db_bench)

RSS is Resident Set Size. RocksDB block cache = half physical memory (7.8GiB). Ratio = engine / v8.10; <1 = less RSS, >1 = more RSS.

RAM usage over time

Sampled once per second from /proc/statm plus open-file page cache. The bar below each plot shows stage name + duration (consecutive repeats merge, e.g. readseq×3); colored bands mark the same intervals. Stage names may overflow into a neighbor cell; a label under the bar is used only when names would overlap.

• rss: resident set size (pages currently in RAM for the process); rss = shared + anony.
• shared: shared resident pages; mostly readonly (cheap; OS prefers reclaiming these, no swap needed).
• anony: rss - shared; mostly readwrite anonymous pages (costly, needs swap).
• pagecache: kernel file page cache for regular files the process currently has open (cachestat(2) on /proc/pid/fd, deduped by inode; covers buffered readwrite and mmap). Pages brought in only via buffered I/O are not charged to process RSS; mmap'd file pages can appear in both pagecache and RSS/shared, so series may overlap.
• anony+pc: anony+pagecache (sum of process anonymous RSS and open-file page cache; not a disjoint partition).

Comparison: db_bench fillrandom suite (perf)

Benchmarks: fillrandom, flush, compact, readseq×3, readrandom. RocksDB uses default Snappy compression. compact row shows operations/seconds. RocksDB time / zipkey*: >1 = that zipkey* engine faster. Values show ops/sec.

Comparison: db_bench fillseq suite (perf)

Same as fillrandom. Watch compact / readseq / readrandom cost for minDictZip=10 vs space savings above.

Per-engine details

ToplingDB zipkeyonly

db_bench (fillrandom+compact+readseq/readrandom)

db_bench (fillseq suite)

ToplingDB zipkeyvalue

db_bench (fillrandom+compact+readseq/readrandom)

db_bench (fillseq suite)

RocksDB v8.10

db_bench (fillrandom+compact+readseq/readrandom)

db_bench (fillseq suite)

RocksDB master (5fe22535)

db_bench (fillrandom+compact+readseq/readrandom)

db_bench (fillseq suite)