ADR 0003: Stages and aggregations outside the graph - #245

Draft

SimonHeybrock wants to merge 31 commits into

mainfrom

map-reduce-outside-the-graph

Commits on Sep 10, 2026

Propose map and reduce outside the graph: Stage and Fold
SimonHeybrock
committed
84e44d1

Commits on Sep 11, 2026

Compose stages with connectors; Fold becomes a driver with settable members

SimonHeybrock
and
claude
committed
ddd7012
Strip Fold to two stages and the combine functions

SimonHeybrock
and
claude
committed
0bdbaa3
Add ADR 0003 proposing stages composed outside the graph

SimonHeybrock
and
claude
committed
77f718f
Add a handoff for detailed review and rollout planning

SimonHeybrock
and
claude
committed
0462309
Place Fold in sciline and correct ADR 0003 after review
SimonHeybrock
committed
8078854
Settle combine protocol, names, and parallelism; Fold becomes Aggregation
SimonHeybrock
committed
60d2fec
Move Stage and Aggregation into sciline; add the rollout plan
SimonHeybrock
committed
965221e
Stage.keys excludes ancestors cut off by an intermediate input
SimonHeybrock
committed
92dc2c9
Add user guide on stages and aggregations
SimonHeybrock
committed
f73af4e
Drop the session handoff note
SimonHeybrock
committed
77153ac
Fix mypy under the pinned version
SimonHeybrock
committed
8e0f2da
Document why Aggregation takes accumulator factories
SimonHeybrock
committed
2cf5349
Use builtin keys in the Stage scheduler test
SimonHeybrock
committed
010ca83

Commits on Sep 14, 2026

Add Reduced, an accumulator with a running result of a binary function

SimonHeybrock
and
claude
committed
6160302
State what combining combined values asks of an accumulator; lock Stage.static

SimonHeybrock
and
claude
committed
b11c688
Correct three docstring statements about Stage, warm, and Aggregation

SimonHeybrock
and
claude
committed
f1aae50
Restructure ADR 0003 to explain before it specifies

SimonHeybrock
and
claude
committed
72970b1
Rewrite the map/reduce design document as one coherent text

SimonHeybrock
and
claude
committed
dca4e26
Correct the essapps section and reduce the rollout plan to its order

SimonHeybrock
and
claude
committed
26d2f33

Commits on Sep 15, 2026

Restore content lost in the rewrite of the map/reduce documents

SimonHeybrock
and
claude
committed
488ce08
Rename Stage.__call__ to Stage.compute

SimonHeybrock
and
claude
committed
4896a44
Make Stage.static a method and lock stages in warm

SimonHeybrock
and
claude
committed
6d6bd7d
Remove confusing reference
SimonHeybrock
committed
ad3f97d

Commits on Sep 21, 2026

Build SansReduction from a configured pipeline, without __setitem__

SimonHeybrock
and
claude
committed
617be61

Commits on Sep 28, 2026

Drop what only a cut-off input provider needed from a Stage

SimonHeybrock
and
claude
committed
187687e
Add Stage.visualize and Aggregation.visualize, address review wording

SimonHeybrock
and
claude
committed
80a5015
Add public visualize_stages for drawing parts of stages

SimonHeybrock
and
claude
committed
2cb256a
Reject stages that compute a shared key differently in warm

SimonHeybrock
and
claude
committed
757691f
Describe runs times banks as a driver over a per-run stage

SimonHeybrock
and
claude
committed
bbf7491
Describe essapps as it is in the map/reduce design doc

SimonHeybrock
and
claude
committed
e09d3b2