Talk Intermediate

Understanding MLOps/LLMOps landscape: A software engineer's perspective

Review Pending

Session Description

If you are a software engineer like me who has heard about RAGs, LLM, and LLMOps, and wondering how to deploy these models on production and what the lifecycle of LLM models looks like, then you should attend this talk.

What you will gain:

- Understand the cloud-agnostic frameworks and tools in the landscape of MLOps/LLMOps.

- Learn about the purpose of inference servers for ML models and LLMs.

- Discover how to use VectorDBs.

- Find out how to run ML models and LLMs on Kubernetes.

I will talk about my experience of exploring the landscape and toolchain from my work.

Session Categories

FOSS

Reviews

Not a very strong proposal. Gives me no idea of what the talk is going to be about. Just bullet points doesn't help.

Reviewer #1 Not Sure

Same as mangesh. Lacks details

Reviewer #2 Not Sure

CFP is too bland. Also,the good stuff will require way more time ( more appropriate for a workshop).

Reviewer #3 Rejected

RAG and deployments are dime a dozen these days. I'd prefer something innovative rather than jumping on the AI bandwagon.

Reviewer #4 Rejected