Core Concepts
Spade is built around a few core ideas: blocks as isolated units of computation, pipelines as declarative workflows connecting blocks, and a runtime that handles scheduling, caching, and parallel execution. This section explains each concept in detail.
Blocks
Self-contained units of computation that form the building blocks of Spade pipelines.
Read →Block Collections
Repositories of related blocks sharing a language and build system.
Read →Pipelines
Declarative YAML workflows connecting blocks into a directed acyclic graph.
Read →Map/Reduce
Parallel processing for collections of data using fan-out and collection patterns.
Read →Execution Model
How Spade schedules, executes, and caches block invocations.
Read →Input Resolution
How Spade matches block outputs to inputs using type matching and explicit references.
Read →Secrets
How blocks receive credentials securely with get_secret.
Read →