feat: Add ArrivalOrder to ArrowScan for bounded-memory concurrent reads#3046

Open

sumedhsakdeo wants to merge 32 commits intoapache:mainfrom

sumedhsakdeo:fix/arrow-scan-benchmark-3036

Commits on Feb 15, 2026

feat: forward batch_size parameter to PyArrow Scanner

sumedhsakdeo
and
claude
committed
style: fix ruff formatting in residual_evaluator lambda

sumedhsakdeo
and
claude
committed
chore: remove unintended vendor directory changes

sumedhsakdeo
and
claude
committed

Commits on Feb 17, 2026

feat: add ScanOrder enum to ArrowScan.to_record_batches

sumedhsakdeo
and
claude
committed
feat: add concurrent_files flag for bounded concurrent streaming

sumedhsakdeo
and
claude
committed
fix: remove unused imports in test_bounded_concurrent_batches

sumedhsakdeo
and
claude
committed
refactor: simplify _bounded_concurrent_batches with per-scan executor

sumedhsakdeo
and
claude
committed
refactor: replace streaming param with order=ScanOrder in concurrent tests and docs

sumedhsakdeo
and
claude
committed
feat: add read throughput micro-benchmark for ArrowScan configurations
sumedhsakdeo
committed
fix: remove extraneous f-string prefix in benchmark

sumedhsakdeo
and
claude
committed
fix: properly reset mock call_count in test_hive_wait_for_lock

sumedhsakdeo
and
claude
committed
feat: add default-4threads benchmark and time-to-first-record metric

sumedhsakdeo
and
claude
committed
chore: remove default-4threads benchmark configuration

sumedhsakdeo
and
claude
committed
docs: add configuration guidance table to streaming API docs

sumedhsakdeo
and
claude
committed
chore: remove benchmark marker so tests run in CI

sumedhsakdeo
and
claude
committed
refactor: replace streaming param with order=ScanOrder in benchmarks and docs

sumedhsakdeo
and
claude
committed

Commits on Feb 19, 2026

Commits on Feb 20, 2026

fix: drain until sentinel to prevent deadlock on early generator close

sumedhsakdeo
and
claude
committed

Commits on Feb 28, 2026