logo

Panel: Managing Compute With MLOps to Handle Growing Datasets & Model Sizes

Conference:  Transform X 2021

2021-10-07

Authors:   Jack Guo, Anitha Vijayakumar, Vishnu Rachakonda, Oleg Avdeëv


Abstract

Hosted by MLOps Community. Panelist to be announced soon. Demetrios Brinkmann, founder of MLOPs.community leads a panel managing the increasing compute requirements of AI models, whilst striking the right balance between flexibility for experimentation and stability in production. As enterprises collect more training data, and in many cases label it with Scale AI, they face the challenge of their models growing in both size and compute complexity. Join this session to learn how companies can develop robust and maintainable pipelines to ensure that ML experimentation remains possible, despite increasing model sizes and longer training times. This session will also cover compute for lifecycle phases from experimentation to scaling (with Metaflow, TFX, etc.) pipelines that are ready to deploy to production, including via microservices.

Materials:

Post a comment

Related work

Conference:  Transform X 2021
Authors: Chun Jiang, Alessya (Labzhinova) Visnjic, Adrian Macneil, Ville Tuulos, Elliot Branson
2021-10-07