Summary
Daily digest generation is serial by default. An optional parallel pipeline can be enabled for catch-up processing.
Sources: beacon-platform/docs/parallel-digest-pipeline.md
What is parallelized
- Daily digest generation can run with bounded concurrency.
- Weekly summary generation remains serial.
Sources: beacon-platform/docs/parallel-digest-pipeline.md
How to enable
Recommended via admin UI: Regenerate AI Digests → Daily Digest Processing Mode.
Endpoints:
- GET /pipeline/daily-config
- POST /pipeline/daily-config
Settings:
- Mode: serial or parallel
- Daily concurrency (default 2)
- Start stagger ms (default 200)
Sources: beacon-platform/docs/parallel-digest-pipeline.md
Env var fallback
If D1 settings are missing, the worker reads:
- DIGEST_PIPELINE_MODE
- DAILY_DIGEST_CONCURRENCY
- DAILY_DIGEST_START_STAGGER_MS
Sources: beacon-platform/docs/parallel-digest-pipeline.md
Operational notes
- Idempotent upserts allow safe replays.
- Parallel mode increases D1 contention; keep concurrency low.
- Quota errors bubble up for queue retry.
Sources: beacon-platform/docs/parallel-digest-pipeline.md