[WarpStream co-founder] WarpStream doesn't implement compacted topics today. It ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		ryanworl on Oct 11, 2023 \| parent \| context \| favorite \| on: Minimizing S3 API costs with distributed MMAP [WarpStream co-founder] WarpStream doesn't implement compacted topics today. It is on our roadmap, though. Compacted topics are typically not used in high-throughput workloads, so our plan is to delay compactions for longer than a disk-based system would to trade space amplification for write amplification.

refset on Oct 11, 2023 [–]

Thanks for clarifying.

> Compacted topics are typically not used in high-throughput workloads

TIL, but it makes sense. Compaction/retention policies certainly introduce a lot of extra tradeoffs dimensions.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact