The Cloudcast (.net) - Weekly Cloud Computing Podcast

RAG That Survives Production

Informações:

Sinopse

SHOW: 992SHOW TRANSCRIPT: The Cloudcast #992 TranscriptSHOW VIDEO: https://youtube.com/@TheCloudcastNET NEW TO CLOUD? CHECK OUT OUR OTHER PODCAST - "CLOUDCAST BASICS" SHOW NOTES:Tonic.ai websiteTonic Validate Product PageTonic Validate GitHubTopic 1 - Adam, welcome to the show. Give everyone a brief introduction.Topic 2: Our topic today is RAG systems, specifically RAG in production. Let’s start with customization sources and types. When it comes to customizing off-the-shelf LLMs, RAG is one option, as is an MCP connection to a SQL database, and there is pre- and post-training, as well as fine-tuning. How does an organization decide what path is best for customization?Topic 3 - RAG came on the scene as the savior for organizations that want to use customer AI without the need for fine-tuning and additional training. It has either gone through or is currently still in the trough of disillusionment. What are your thoughts on RAG's evolution and the challenges it faces?Topic 4 - Let’s walk through