Skip to content

increase chunk size from 512 bytes to 64 KB for HTTP response reading #1511

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
YasirAlibrahem wants to merge 1 commit into
base: main
Choose a base branch
from
Open

increase chunk size from 512 bytes to 64 KB for HTTP response reading #1511

YasirAlibrahem wants to merge 1 commit into from

Conversation

@YasirAlibrahem
Copy link

@YasirAlibrahem YasirAlibrahem commented Dec 18, 2025

Objective

Enhance performance when reading HTTP response content chunks.

Changes

  • A minor performance enhancement to the HTTP response content read loop in the convert_response method, that increases the chunk size from 512 bytes to 64KB.
  • 64 KB aligns with industry best practices as a common chunk size in computer networking protocols, balancing memory usage and throughput.
  • 64 KB is consistent with the chunk size proposed in Perf: Optimize non-seekable stream buffering using shutil.copyfileobj #1510
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

1 participant

@YasirAlibrahem