Skip to content

perf(rollout): reduce and trace writer flushes#30668

Draft
apanasenko-oai wants to merge 1 commit into
mainfrom
apanasenko/ttft-rollout-writer
Draft

perf(rollout): reduce and trace writer flushes#30668
apanasenko-oai wants to merge 1 commit into
mainfrom
apanasenko/ttft-rollout-writer

Conversation

@apanasenko-oai

Copy link
Copy Markdown
Collaborator

Summary

Reduce redundant rollout writer flushes and make persistence latency attributable.

  • Skip clean-writer filesystem flushes.
  • Remove the redundant batch-level flush from the thread-store append path.
  • Add queue, writer, recovery, serialization, and filesystem timing spans.
  • Preserve retry and flush-materialization behavior.

This is the rollout-writer slice split out of #30632.

Validation

  • just test -p codex-rollout passed 80 tests.
  • just test -p codex-thread-store passed 89 tests.
  • just fmt passed, with an unrelated justfile rewrite discarded.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

1 participant