Issues

• AQE job hangs when a stage's tasks report different numbers of operator metrics

  apache/datafusion-ballista#2827 · Filter by author abstractdog opened on Nov 9, 2026

• Refresh the executor's default spill limit from live work dir free space

  enhancement
  apache/datafusion-ballista#2820 · Filter by author andygrove opened on Nov 8, 2026

• Flight SQL can report an intermediate stage's schema for adaptive jobs

  bugcorrectness
  apache/datafusion-ballista#2817 · Filter by author andygrove opened on Nov 8, 2026

• Research: evaluate one spill file per spill event for sort-based shuffle

  apache/datafusion-ballista#2810 · Filter by author andygrove opened on Nov 8, 2026
  1

• The scheduler's gRPC listener sets no TCP keepalive (axum path)

  apache/datafusion-ballista#2808 · Filter by author andygrove opened on Nov 7, 2026

• Store shuffle string offsets as lengths before zstd compression

  enhancementperformance
  apache/datafusion-ballista#2804 · Filter by author andygrove opened on Nov 7, 2026
  

• See if Ballista depend on Apache DataSketches (datasketches-rust) for shuffle column sketches?

  enhancement
  apache/datafusion-ballista#2783 · Filter by author coderfender opened on Nov 5, 2026
  3

  

• Python client: known gaps compared to DataFusion

  python
  apache/datafusion-ballista#2781 · Filter by author milenkovicm opened on Nov 5, 2026

• Executor's default work dir is deleted at startup and recreated without TempDir's permissions

  bug
  apache/datafusion-ballista#2767 · Filter by author andygrove opened on Nov 3, 2026

• AQE research: use exact stage row counts to simplify downstream operators (EliminateLimits / OptimizeOneRowPlan analog)

  enhancement
  apache/datafusion-ballista#2761 · Filter by author andygrove opened on Nov 3, 2026

• AQE research: size output files for writes with a rebalance step (REBALANCE analog)

  enhancement
  apache/datafusion-ballista#2760 · Filter by author andygrove opened on Nov 3, 2026

• AQE research: broaden skew-join applicability (dynamic filters, multi-join stages, default-on criteria)

  enhancement
  apache/datafusion-ballista#2759 · Filter by author andygrove opened on Nov 3, 2026

• AQE research: guard replans with a cost check (SimpleCostEvaluator analog)

  enhancement
  apache/datafusion-ballista#2758 · Filter by author andygrove opened on Nov 3, 2026

• AQE research: parallelism-aware coalesce policy and default-on criteria (parallelismFirst, min size, initial partition count)

  enhancement
  apache/datafusion-ballista#2757 · Filter by author andygrove opened on Nov 3, 2026

• Don't serve the unauthenticated REST API, including job cancel, on the scheduler's gRPC port by default

  enhancement
  apache/datafusion-ballista#2746 · Filter by author andygrove opened on Nov 2, 2026

• Compile the scheduler's event-log writer without the REST API

  enhancement
  apache/datafusion-ballista#2745 · Filter by author andygrove opened on Nov 2, 2026

• Add a typed SessionConfigExt setter for ballista.execution.mode

  apache/datafusion-ballista#2729 · Filter by author andygrove opened on Oct 31, 2026
  1

• Let custom operators declare that they tolerate a coalesced partition count

  enhancement
  apache/datafusion-ballista#2728 · Filter by author andygrove opened on Oct 31, 2026
  

• Run a stage once when several stages read it

  enhancement
  apache/datafusion-ballista#2727 · Filter by author andygrove opened on Oct 31, 2026
  

• Remove NormalizeInterleaveRule once DataFusion tolerates non-interleavable InterleaveExec children

  apache/datafusion-ballista#2719 · Filter by author andygrove opened on Oct 30, 2026

• Cancel jobs whose client process has gone away

  apache/datafusion-ballista#2717 · Filter by author andygrove opened on Oct 30, 2026

• Fair admission for pipelined jobs

  apache/datafusion-ballista#2716 · Filter by author andygrove opened on Oct 30, 2026

• Nightly Docker image build failed

  apache/datafusion-ballista#2712 · Filter by author github-actions opened on Oct 30, 2026

• [Roadmap] Distributed Runtime Filter Hub

  apache/datafusion-ballista#2700 · Filter by author wirybeaver opened on Oct 30, 2026

• Tasks bound in launch_tasks are orphaned when the executor metadata lookup fails

  apache/datafusion-ballista#2691 · Filter by author andygrove opened on Oct 29, 2026