Workshops - Data & AI Warsaw Tech Summit

LLMOps in Action: Build, Deploy & Optimize GenAI Apps

Join us for a one-day workshop on Large Language Model Operations (LLMOps). This event aims to provide participants in-depth knowledge of the latest advancements in development and productionization of Generative AI systems.

During the workshop you will develop and deploy a LLM-powered application that adopts LLMOps best practices when it comes to data ingestion, observability, prompt management, cost control and LLM evaluation.

Upon completing the workshop, attendees will gain a comprehensive understanding of the importance and applicability of specific LLMOps building blocks.

Wymagania

  • Some experience coding in Python, basic understanding of cloud computing and machine learning concepts.
  • Laptop with IDE and web browser
  • No prior experience with Generative AI needed.

Participant’s ROI

  • Practical knowledge of building Generative AI solutions using open-source tools.
  • Hands-on experience with management, observability and cost-control of Generative AI powered applications.
  • Tips about real world applications and best practices.

Training Materials

All participants will get training materials in the form of PDF files containing slides with theory and exercise manual with the detailed description of all exercises.

Time Box

This is a one-day event (9.00 - 16.00), there will be some breaks between sessions.

Agenda

Session #1 - Large Language Models (LLM) and LLMOps

  • What LLMOps is and how it differs from MLOps
  • LLM applications architectures and main building blocks
  • Key challenges with LLM-powered applications

Session #2 - Building an LLM-powered application

  • from a notebook to a full-fledged web interface
  • set up and populate a knowledge base with a vector search
  • design and implement an agentic workflow backend
  • function calling and structured output
  • end-to-end LLM application

Session #3 LLM systems deployment, observability, management and evaluation

  • LLM-setup and application deployment
  • prompt management
  • observability, monitoring, cost control and LLM interaction traces
  • LLM evaluation

Session #4 Advanced topics

  • guardrailing and LLM security
  • automatic prompt engineering
  • small LLM fine-tuning

Speakers

Senior Staff Data Engineer/Architect
GetInData | Part of Xebia
Chief Data Architect
GetInData | Part of Xebia