Compaction / Versions

Code

be/src/storage/rowset_builder.cpp:

• version_count > max_version_config → Status::Error<TOO_MANY_VERSION>(...)
• Suggests reduce load frequency or raise max_tablet_version_num / time_series_max_tablet_version_num in be.conf
• Near limit triggers cumulative compaction submit

Defaults (config.cpp): max_tablet_version_num=2000, time_series_max_tablet_version_num=20000.

Causes

Actions

1. Confirm with ./scripts/doris-debug log-grep be/log --pack versions
2. Check compaction throughput: ./scripts/doris-debug be-metrics --be http://$BE:8040 --grep compaction
3. Check disk IO: iostat -x 1
4. Slow ingest / enlarge group commit batches
5. Raising max_tablet_version_num is a temporary valve — fix ingest vs compaction balance

./scripts/doris-debug be-metrics --be http://$BE:8040 --grep compaction

Compaction knobs

# be.conf
max_tablet_version_num = 2000               # hard cap, raise only as stopgap
time_series_max_tablet_version_num = 20000   # separate cap for time-series tables
max_cumulative_compaction_threads = -1       # -1 = auto based on CPU cores
compaction_task_num_per_disk = 4             # per-disk concurrent compaction tasks
compaction_tablet_size_threshold = 107374182400  # 100GB — above this, skip base compaction

Source

• be/src/storage/rowset_builder.cpp — -235 error
• be/src/common/config.cpp — all compaction config defaults
• be/src/olap/cumulative_compaction_policy.cpp — score calculation