LS Keeper Data Bridge — ETL pipeline
Supplier files → S3 artefacts → a SQLite read model. Illustrative animation; stage names match the code.
Stakeholder
Engineer
Pause
Restart
Skip to end
½×
1×
2×
The ETL pipeline of the LS Keeper Data Bridge
An import run discovers files in the supplier's bucket, decrypts, normalises and optimises them to Parquet, merges each dataset into a snapshot, loads all snapshots into one DuckDB staging database, and publishes a SQLite read model.
Loading…
Click any card for its technical detail.