Zero to Pipeline: When Data Connectors Just Work
- Track:
- Data Engineering and MLOps
- Type:
- Talk
- Level:
- intermediate
- Room:
- S4
- Start:
- 16:05 on Wednesday, 15 July 2026
- End:
- 16:35 on Wednesday, 15 July 2026
- Duration:
- 30 minutes
Abstract
Remember spending entire afternoons configuring data connectors, debugging OAuth flows, and writing custom parsers just to ingest data from a single API? What if you could just say pipeline source add feast and have your pipeline automatically discover the API, handle authentication, and start ingesting data no config files, no setup wizards, no SDK imports?
In this 30-minute talk, I'll show you the reality behind self-configuring data pipelines that sound too good to be true but actually work. Using a fraud detection use case Feast feature store, MLflow experiment tracking, Prometheus metrics, and Linear for issue tracking we'll explore how intelligent connectors leverage LLM-driven API discovery, automatic credential management, self-healing auth, and cursor-based checkpointing to eliminate the traditional pain points of data ingestion.
We'll be honest about the tradeoffs too.