RAG in Production: From Tutorial to Enterprise The latest wave of open source content demonstrates a maturing ecosystem for building AI applications. The spotlight is on Retrieval-Augmented Generation (RAG), with practical, end-to-end tutorials that emphasize observability, evaluation, and production readiness. A standout is the MLflow tutorial series, which walks through building a complete RAG pipeline … Read more
In the ninth tutorial of the Mastering MLflow for GenAI series, Jules Damji (Databricks) builds a complete RAG application, instrumented with full MLflow observability—from query and document embedding and semantic search retrieval through LLM generation, performance analysis, and RAGAS quality evaluation.
What You’ll Learn:
🔹 End-to-end RAG pipeline instrumented as typed spans (PARSER, EMBEDDING, RETRIEVER, LLM, CHAIN): validate → embed → retrieve → assemble → generate → validate.
🔹 @mlflow.trace instrumentation plus mlflow.openai.autolog() for automatic LLM tracing.
🔹 Performance analysis across test queries: latency, token usage, cache hits, and estimated cost.
🔹 RAGAS Faithfulness and Context Relevance via mlflow.genai.evaluate() on traces with RETRIEVER spans.
🔹 Production notes: in-memory store and cosine similarity for teaching; swap in vector DBs and hybrid BM25 and semantic searches for real deployments.
🔹 MLflow UI & multi-level tracking and tracing: experiment config, per-query runs, per-step latency/tokens/cost, full pipeline timeline, span attributes, and latency bottlenecks.
Next in the Series: Notebook 1.10 covers the Multi-Agent Supervisor pattern with LangGraph.
Resources:
🔗 Notebook 1.9: https://github.com/dmatrix/mlflow-genai-tutorials/blob/main/09_complete_rag_application.ipynb
🎥 Full Series Playlist: https://youtube.com/playlist?list=PLaoPu6xpLk9EI99TuOjSgy-UuDWowJ_mR
Text generation looks like one function call. Underneath, it’s a loop: infer, pick a token, append it, repeat. Watch how Transformers.js runs an LLM step by step.. and understand what’s actually happening every time you chat with one.
Your AI agent is smart—but struggles with your data because of complex integrations. Enter Model Context Protocol (MCP), an open standard that connects AI to tools and data without custom work. Instaclustr for MCP Gateway makes it production-ready with secure, scalable, and governed access.
See MCP Gateway in action in this demo and read more in the announcement blog: https://www.instaclustr.com/blog/netapp-instaclustr-for-mcp-gateway-is-here-smarter-ai-data-access-starts-now/
Try the MCP Gateway free (console, Terraform, or API): https://console2.instaclustr.com/signup
Full shoe store chatbot code: https://github.com/instaclustr/code-samples/tree/main/MCP-Gateway/shoe-store-support-chatbot
Can you run ChatGPT securely on your own network? This panel explores how to build a private AI assistant using local LLMs without sending sensitive data to the cloud.
Learn how to deploy and compare popular local AI runtimes, including Ollama, Docker Model Runner, and Foundry Local, then integrate them into intelligent applications with .NET Aspire and Microsoft.Extensions.AI. The discussion also covers extending the same architecture to cloud-hosted LLMs, balancing privacy, performance, flexibility, and developer experience.
Whether you’re building enterprise AI, self-hosting open source models, or exploring ChatGPT alternatives, this session provides practical guidance for creating secure, production-ready AI applications.
FOSSASIA Summit 2026 held in Bangkok, is Asia’s leading Open Source tech conference featuring sessions on #AI, #Cloud, #DevOps, #Open Hardware, #Security, #Web #Mobile Technologies, #Web3, and #Databases. Learn more: http://summit.fossasia.org
Support us on Patreon and get an ad-free RSS feed with some early episodes. https://www.patreon.com/LateNightLinux
We finally have pricing for the Steam Machine, but they are very hard to actually buy, and very expensive. SteamOS is now supported on your own hardware now though, and Joe gives it a go. Plus Ubuntu makes moves to tighten up the flavours situation and announces speech to text on the desktop, and a quick KDE Korner.
Discover what’s new in SAP HANA Cloud Q2 2026 in under 7 minutes.
Join Thomas Hammer, Lead Product Manager of SAP HANA Cloud, as he walks through the key innovations in our Q2 2026 release, including custom database object knowledge graphs, new database object discovery and data retrieval tools, knowledge graph engine innovations, larger SAP HANA Cloud database instances on AWS, deeper SAP AI Core integration, and more.
See how SAP HANA Cloud automatically creates a semantic knowledge graph from your database metadata, making it easier to discover, understand, and query enterprise data. Learn how the new Database Object Discovery and Data Retrieval tools use natural language to identify relevant data, generate SQL, and retrieve results, reducing the need for deep database expertise.
Thomas also explores the latest Knowledge Graph Engine innovations, including support for transforming knowledge graphs into property graphs and federated SPARQL queries across distributed SAP HANA Cloud environments. Together, these capabilities provide a stronger foundation for semantic search, graph analytics, retrieval-augmented generation (RAG), and AI-driven applications.
The release also introduces support for SAP HANA Cloud database instances with up to 24 TB of memory on AWS, helping organizations run larger, mission-critical in-memory workloads. In addition, deeper SAP AI Core integration brings AI-powered predictions and large language model capabilities directly into SQL workflows, making it easier to build intelligent, data-driven applications.
Finally, discover additional innovations, including the new Performance Class Advisor, automated SQL Plan Advisor enhancements, Apache Iceberg REST catalog support for lakehouse scenarios, and replication support for SAP S/4HANA CDS view entities.
Chapters:
0:00 – Intro
0:56 – Custom Database Objects Knowledge Graph
1:25 – Database Object Discovery & Data Retrieval Tools
2:30 – Knowledge Graph Engine Innovations
3:22 – Larger SAP HANA Cloud database instances on AWS
4:06 – Deeper SAP AI Core Integration
5:24 – Further innovations
👉 Join the SAP HANA community to stay connected: https://pages.community.sap.com/topics/hana?source=social-Global-YouTube-No-BTP-SAP_HANA_Cloud-Educate%2FEnable-Product_Information-Video-18272618356&campaigncode=CRM-YA23-SMS-1941768&sprinklrid=18272618356
Follow us on social:
LinkedIn: https://www.linkedin.com/company/sap/
Instagram: https://www.instagram.com/sap
Facebook: https://www.facebook.com/SAP/
Threads: https://www.threads.com/@sap
About SAP:
As a global leader in enterprise applications and business AI, SAP stands at the nexus of business and technology. For over 50 years, organizations have trusted SAP to bring out their best by uniting business-critical operations across finance, procurement, HR, supply chain, and customer experience. Learn more at https://www.sap.com.
MacBreak Weekly covers all things Apple: Leo, Andy Ihnatko, Jason Snell, and Christina Warren analyze every bit of news from the most interesting company in tech. From AI to Vision Pro, iPad to iPhone, these Apple experts know-all and tell-all.
You can find more about TWiT.tv and subscribe to our full shows at https://podcasts.twit.tv
Join our community at Club TWiT: https://twit.tv/clubtwit
About us:
TWiT.tv is a technology podcasting network located in the San Francisco Bay Area with the #1 ranked technology podcast This Week in Tech hosted by Leo Laporte. Every week we produce over 30 hours of content on a variety of programs including Tech News Weekly, MacBreak Weekly, Windows Weekly, Security Now, Intelligent Machines, and more.
New series alert for developers building apps for Meta Quest 🎬
VR Developer Level Up, hosted by @dilmerv, is where we dive into what’s working across the Quest ecosystem. That includes tangible success stories with the numbers behind them, platform updates, and tool walkthroughs you can follow along with.
Ep. 1 covers four developer case studies, the latest agentic tools, and a hands-on Meta VR CLI deep dive.
We use cookies on our website to give you the most relevant experience by remembering your preferences and repeat visits. By clicking “Accept All”, you consent to the use of ALL the cookies. However, you may visit "Cookie Settings" to provide a controlled consent.
This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
Necessary cookies are absolutely essential for the website to function properly. These cookies ensure basic functionalities and security features of the website, anonymously.
Cookie
Duration
Description
cookielawinfo-checkbox-analytics
11 months
This cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Analytics".
cookielawinfo-checkbox-functional
11 months
The cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Functional".
cookielawinfo-checkbox-necessary
11 months
This cookie is set by GDPR Cookie Consent plugin. The cookies is used to store the user consent for the cookies in the category "Necessary".
cookielawinfo-checkbox-others
11 months
This cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Other.
cookielawinfo-checkbox-performance
11 months
This cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Performance".
viewed_cookie_policy
11 months
The cookie is set by the GDPR Cookie Consent plugin and is used to store whether or not user has consented to the use of cookies. It does not store any personal data.
Functional cookies help to perform certain functionalities like sharing the content of the website on social media platforms, collect feedbacks, and other third-party features.
Performance cookies are used to understand and analyze the key performance indexes of the website which helps in delivering a better user experience for the visitors.
Analytical cookies are used to understand how visitors interact with the website. These cookies help provide information on metrics the number of visitors, bounce rate, traffic source, etc.
Advertisement cookies are used to provide visitors with relevant ads and marketing campaigns. These cookies track visitors across websites and collect information to provide customized ads.