Building and Deploying LLM applications with Apache Airflow
Discover how to build reliable, scalable LLM applications using Apache Airflow in Kaxil Naik's insightful talk. Explore design patterns that integrate proprietary enterprise data to create value-driven AI applications. From orchestrating structured and unstructured data to interacting with tools like OpenAI's GPT-4 and HuggingFace, learn how Airflow enables seamless machine learning workflows at scale.
Kaxil Naik, Senior Director of Engineering at Astronomer and a leader in data engineering, shares real-world examples and future enhancements for Airflow, including proposed new providers for LLM integration. Perfect for AI, data science, and engineering professionals seeking cutting-edge solutions for natural language processing (NLP) and AI-driven workflows.
Kaxil Naik
Sr. Director of Engineering at Astronomer
Outline:
-
Chat about Chatbots IRL
-
Airflow for RAG
-
Real Use Cases
-
Running this in pr GitHub Code
UPCOMING LIVE TRAINING
Register now to save 30%