Skip to content

Honor CloudFetch download settings on kernel connections - #1060

Open
aakash-saravanan-db wants to merge 3 commits into
mainfrom
aakash-saravanan_data/feat/cloudfetch-download-settings-20261114
Open

aakash-saravanan-db wants to merge 3 commits into
mainfrom
aakash-saravanan_data/feat/cloudfetch-download-settings-20261114

Conversation

@aakash-saravanan-db

@aakash-saravanan-db aakash-saravanan-db commented Nov 14, 2026 •

Copy link
Copy Markdown
Collaborator

Feature or gap

Python applications could set max_download_threads on Thrift connections, but kernel connections ignored it.

What this PR addresses

Forward the existing setting to the kernel download window, default 10 (previously 16). Non-positive or non-integer values, including booleans, raise ValueError when connecting with use_kernel=True. Preserve explicit raw chunk overrides and document connection-time configuration, the 256 ceiling and the distinction from a byte limit.

Dependencies

Existing native kernel APIs; no native dependency bump is required.

Tests and validation

349 focused tests pass; built-wheel checks verify controls, invalids, precedence, complete results and constrained consumption. With a native built from kernel a488a05, after equal warmups and five alternating runs per side, DBSQL medians from submission through complete drain of 3M ordered rows: Thrift 10.36 s → kernel 8.86 s (-14.4%); kernel window 16 → 10: 9.04 s → 9.00 s (-0.5%).

@peco-review-bot peco-review-bot Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

✅ No issues identified by the review bot.

This branch was previously deployed

1 inactive deployment
azure-prod — a8fb2980 Deployed Nov 14, 2026 by aakash-saravanan-db via review #735
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant