Dates
Conferences
Tags
Sort by:
Most recent
Conference: OpenAI + Data Forum 2022
Authors: Cheranellore Vasudevan, Mandy Chessell, David Radley, Dan Wolfson
2022-06-22
tldr - powered by Generative AI
The presentation discusses the importance of open source tools and integration in data operations (DataOps) and how it can promote democratization of data while ensuring security. The focus is on the Algeria and Open Lineage projects as examples of open source tools that can be used to achieve this goal.
- Open source tools and integration are crucial in promoting democratization of data while ensuring security in DataOps.
- Algeria and Open Lineage are examples of open source tools that can be used to achieve this goal.
- Algeria operates in a peer-to-peer way, allowing each silo to invest in their own tools and choose what they share and what they keep secure.
- The ease of validation and familiarity of open source tools can help build trust in a particular solution across different parts of the organization.
- Joining the open source community and contributing to the projects can help promote integration and collaboration in DataOps.
Conference: KubeCon + CloudNativeCon North America 2021
Authors: Dylan Wilder Patterson, Haytham Abuelfutuh
2021-10-15
tldr - powered by Generative AI
The presentation discusses the differences between DevOps and ML Ops, and how Flight can help with ML Ops workflows.
- ML Ops has different requirements than DevOps, such as dealing with large amounts of data and longer processing times
- Flight is a platform that can help with ML Ops workflows, providing features such as composition, caching, and validation
- Flight can handle individual containers for task execution environments, but not yet streaming data
- Flight has been well-received by data scientists for its ease of use and out-of-the-box parallelism