Extensions¶
API reference for all extension modules. Extensions add optional capabilities to Store — install the relevant extra to enable each one. For usage guides, see Extensions.
| Module | Description |
|---|---|
| ext.arrow | PyArrow FileSystemHandler adapter for Store |
| ext.batch | Batch delete, copy, and exists operations |
| ext.cache | Store-level caching middleware with TTL |
| ext.dagster | Dagster IO manager, config-driven Store resource, and compute log manager |
| ext.glob | Portable glob pattern matching fallback |
| ext.integrity | Checksum computation and verification helpers |
| ext.observe | Callback hooks for store operations |
| ext.otel | OpenTelemetry bridge for ext.observe |
| ext.parquet | Managed Parquet datasets with manifests and completion markers |
| ext.partition | Hive-style partition path helpers |
| ext.pydantic | Pydantic model to RegistryConfig adapter |
| ext.streams | Composable BinaryIO wrappers for progress and checksums |
| ext.transfer | Upload, download, and cross-store transfer |
| ext.write | Write helpers with guaranteed client-side content hashing |
| aio.ext.write | Async write helpers with guaranteed client-side content hashing |
| ext.yaml | YAML config loader (PyYAML / ruamel.yaml) |
See also¶
- Extensions guide — overview of all extensions with installation instructions
- Choosing a Backend — backend selection guide