forks/go-ethereum
1
0
Fork 1
mirror of https://github.com/ethereum/go-ethereum.git synced 2026-08-18 18:02:24 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 1

ethdb/pebble: lower compaction concurrency

Browse source
This commit is contained in:
Gary Rong 2024-12-06 15:42:41 +08:00
parent 67a3b08795
commit 96b1998e78
1 changed files with 13 additions and 3 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

16
ethdb/pebble/pebble.go
View file

@ -205,9 +205,19 @@ func New(file string, cache int, handles int, namespace string, readonly bool) (
// and to https://github.com/cockroachdb/pebble/blob/master/db.go#L1892-L1903.
MemTableStopWritesThreshold: memTableLimit,
// The default compaction concurrency(1 thread),
// Here use all available CPUs for faster compaction.
MaxConcurrentCompactions: runtime.NumCPU,
// MaxConcurrentCompactions specifies the number of concurrent compaction.
// Pebble may run multiple compactions concurrently in different parts of
// the LSM (ie, different levels or non-overlapping key spaces of the same
// levels). Each one of these compactions by default can make use of up to
// 2 threads. One thread reads and performs most of the CPU work of the
// compaction, and the other thread performs the write syscalls to write
// output sstables.
//
// In order to not significantly affect the other parts of system, at most
// 3/4 available CPUs can be granted for compactions.
MaxConcurrentCompactions: func() int {
return 3 * runtime.NumCPU() / 8
},
// Per-level options. Options for at least one level must be specified. The
// options for the last level are used for all subsequent levels.