Open Source AI Digest: RAG, LLMs & MCP

Open Source AI Digest: RAG, LLMs & MCP

RAG in Production: From Tutorial to Enterprise The latest wave of open source content demonstrates a maturing ecosystem for building AI applications. The spotlight is on Retrieval-Augmented Generation (RAG), with practical, end-to-end tutorials that emphasize observability, evaluation, and production readiness. A standout is the MLflow tutorial series, which walks through building a complete RAG pipeline … Read more

Build a Complete RAG Application: End-to-End Tracing, Performance & RAGAS Evaluation (Notebook 1.9)

Build a Complete RAG Application: End-to-End Tracing, Performance & RAGAS Evaluation (Notebook 1.9)

Video by MLflow via YouTube
Build a Complete RAG Application: End-to-End Tracing, Performance & RAGAS Evaluation (Notebook 1.9)

In the ninth tutorial of the Mastering MLflow for GenAI series, Jules Damji (Databricks) builds a complete RAG application, instrumented with full MLflow observability—from query and document embedding and semantic search retrieval through LLM generation, performance analysis, and RAGAS quality evaluation.

What You’ll Learn:
🔹 End-to-end RAG pipeline instrumented as typed spans (PARSER, EMBEDDING, RETRIEVER, LLM, CHAIN): validate → embed → retrieve → assemble → generate → validate.
🔹 @mlflow.trace instrumentation plus mlflow.openai.autolog() for automatic LLM tracing.
🔹 Performance analysis across test queries: latency, token usage, cache hits, and estimated cost.
🔹 RAGAS Faithfulness and Context Relevance via mlflow.genai.evaluate() on traces with RETRIEVER spans.
🔹 Production notes: in-memory store and cosine similarity for teaching; swap in vector DBs and hybrid BM25 and semantic searches for real deployments.
🔹 MLflow UI & multi-level tracking and tracing: experiment config, per-query runs, per-step latency/tokens/cost, full pipeline timeline, span attributes, and latency bottlenecks.

Next in the Series: Notebook 1.10 covers the Multi-Agent Supervisor pattern with LangGraph.

Resources:
🔗 Notebook 1.9: https://github.com/dmatrix/mlflow-genai-tutorials/blob/main/09_complete_rag_application.ipynb
🎥 Full Series Playlist: https://youtube.com/playlist?list=PLaoPu6xpLk9EI99TuOjSgy-UuDWowJ_mR

Source

How LLMs Actually Generate Text

How LLMs Actually Generate Text

Video by Hugging Face via YouTube
How LLMs Actually Generate Text

Text generation looks like one function call. Underneath, it’s a loop: infer, pick a token, append it, repeat. Watch how Transformers.js runs an LLM step by step.. and understand what’s actually happening every time you chat with one.

Source

Stop building custom AI connectors: Instaclustr for MCP Gateway

Stop building custom AI connectors: Instaclustr for MCP Gateway

Video by NetApp Instaclustr via YouTube
Stop building custom AI connectors: Instaclustr for MCP Gateway

Your AI agent is smart—but struggles with your data because of complex integrations. Enter Model Context Protocol (MCP), an open standard that connects AI to tools and data without custom work. Instaclustr for MCP Gateway makes it production-ready with secure, scalable, and governed access.

See MCP Gateway in action in this demo and read more in the announcement blog: https://www.instaclustr.com/blog/netapp-instaclustr-for-mcp-gateway-is-here-smarter-ai-data-access-starts-now/

Try the MCP Gateway free (console, Terraform, or API): https://console2.instaclustr.com/signup

Full shoe store chatbot code: https://github.com/instaclustr/code-samples/tree/main/MCP-Gateway/shoe-store-support-chatbot

Source

Would you buy ChatGPT if you can run it on your private network? Sunny, Justin, Wei Tat, Yewon #AI

Would you buy ChatGPT if you can run it on your private network? Sunny, Justin, Wei Tat, Yewon #AI

Video by FOSSASIA via YouTube
Would you buy ChatGPT if you can run it on your private network? Sunny, Justin, Wei Tat, Yewon #AI

Can you run ChatGPT securely on your own network? This panel explores how to build a private AI assistant using local LLMs without sending sensitive data to the cloud.

Learn how to deploy and compare popular local AI runtimes, including Ollama, Docker Model Runner, and Foundry Local, then integrate them into intelligent applications with .NET Aspire and Microsoft.Extensions.AI. The discussion also covers extending the same architecture to cloud-hosted LLMs, balancing privacy, performance, flexibility, and developer experience.

Whether you’re building enterprise AI, self-hosting open source models, or exploring ChatGPT alternatives, this session provides practical guidance for creating secure, production-ready AI applications.

FOSSASIA Summit 2026 held in Bangkok, is Asia’s leading Open Source tech conference featuring sessions on #AI, #Cloud, #DevOps, #Open Hardware, #Security, #Web #Mobile Technologies, #Web3, and #Databases. Learn more: http://summit.fossasia.org

Session slide: https://eventyay.com/ev/88882f3e/talk/QBVLQE7WDBHP/

#FOSSASIA #FOSSASIASummit #opensource #FOSS

Source

Trino Contributor Call 2026 06 24

Trino Contributor Call 2026 06 24

Video by Trino via YouTube
Trino Contributor Call 2026 06 24

– 00:00 Intro, Trino query UI, and JavaScript client publishing
– 00:48 Autoscaling, KEDA, and Resource-aware admission control
– 08:24 Trino Maven plugin rewrite
– 09:12 TPC-DS Test Suite spec v4 updates
– 10:26 Trino Statement Utils compatibility in Trino Gateway
– 11:21 New Trino online sandbox: trysql.io

More details available in the meeting minutes at
https://github.com/trinodb/trino/wiki/Contributor-meetings

Call organized and hosted by Manfred Moser. Sponsor him at
https://github.com/sponsors/mosabua to support this and other open source initiatives.

Source

Late Night Linux – Episode 392

Late Night Linux – Episode 392

Video by The Late Night Linux Family via YouTube
Late Night Linux – Episode 392

Support us on Patreon and get an ad-free RSS feed with some early episodes. https://www.patreon.com/LateNightLinux

We finally have pricing for the Steam Machine, but they are very hard to actually buy, and very expensive. SteamOS is now supported on your own hardware now though, and Joe gives it a go. Plus Ubuntu makes moves to tighten up the flavours situation and announces speech to text on the desktop, and a quick KDE Korner.

https://latenightlinux.com/late-night-linux-episode-392/

Source

Top New Features in SAP HANA Cloud | Q2 2026 Release Highlights

Top New Features in SAP HANA Cloud | Q2 2026 Release Highlights

Video by SAP via YouTube
Top New Features in SAP HANA Cloud | Q2 2026 Release Highlights

Discover what’s new in SAP HANA Cloud Q2 2026 in under 7 minutes.

Join Thomas Hammer, Lead Product Manager of SAP HANA Cloud, as he walks through the key innovations in our Q2 2026 release, including custom database object knowledge graphs, new database object discovery and data retrieval tools, knowledge graph engine innovations, larger SAP HANA Cloud database instances on AWS, deeper SAP AI Core integration, and more.

See how SAP HANA Cloud automatically creates a semantic knowledge graph from your database metadata, making it easier to discover, understand, and query enterprise data. Learn how the new Database Object Discovery and Data Retrieval tools use natural language to identify relevant data, generate SQL, and retrieve results, reducing the need for deep database expertise.

Thomas also explores the latest Knowledge Graph Engine innovations, including support for transforming knowledge graphs into property graphs and federated SPARQL queries across distributed SAP HANA Cloud environments. Together, these capabilities provide a stronger foundation for semantic search, graph analytics, retrieval-augmented generation (RAG), and AI-driven applications.

The release also introduces support for SAP HANA Cloud database instances with up to 24 TB of memory on AWS, helping organizations run larger, mission-critical in-memory workloads. In addition, deeper SAP AI Core integration brings AI-powered predictions and large language model capabilities directly into SQL workflows, making it easier to build intelligent, data-driven applications.

Finally, discover additional innovations, including the new Performance Class Advisor, automated SQL Plan Advisor enhancements, Apache Iceberg REST catalog support for lakehouse scenarios, and replication support for SAP S/4HANA CDS view entities.

Chapters:
0:00 – Intro
0:56 – Custom Database Objects Knowledge Graph
1:25 – Database Object Discovery & Data Retrieval Tools
2:30 – Knowledge Graph Engine Innovations
3:22 – Larger SAP HANA Cloud database instances on AWS
4:06 – Deeper SAP AI Core Integration
5:24 – Further innovations

👉 Join the SAP HANA community to stay connected: https://pages.community.sap.com/topics/hana?source=social-Global-YouTube-No-BTP-SAP_HANA_Cloud-Educate%2FEnable-Product_Information-Video-18272618356&campaigncode=CRM-YA23-SMS-1941768&sprinklrid=18272618356

Follow us on social:
LinkedIn: https://www.linkedin.com/company/sap/
Instagram: https://www.instagram.com/sap
Facebook: https://www.facebook.com/SAP/
Threads: https://www.threads.com/@sap

About SAP:
As a global leader in enterprise applications and business AI, SAP stands at the nexus of business and technology. For over 50 years, organizations have trusted SAP to bring out their best by uniting business-critical operations across finance, procurement, HR, supply chain, and customer experience. Learn more at https://www.sap.com.

#SAPHANACloud #SAPBusinessDataCloud #DataAndAI #WhatsNewInSAPHANACloud

Source

MacBreak Weekly 1031

MacBreak Weekly 1031

Video by TWiT Tech Podcast Network via YouTube
MacBreak Weekly 1031

MacBreak Weekly covers all things Apple: Leo, Andy Ihnatko, Jason Snell, and Christina Warren analyze every bit of news from the most interesting company in tech. From AI to Vision Pro, iPad to iPhone, these Apple experts know-all and tell-all.

You can find more about TWiT.tv and subscribe to our full shows at https://podcasts.twit.tv
Join our community at Club TWiT: https://twit.tv/clubtwit

About us:
TWiT.tv is a technology podcasting network located in the San Francisco Bay Area with the #1 ranked technology podcast This Week in Tech hosted by Leo Laporte. Every week we produce over 30 hours of content on a variety of programs including Tech News Weekly, MacBreak Weekly, Windows Weekly, Security Now, Intelligent Machines, and more.

Source

VR Dev Level Up Episode 1

VR Dev Level Up Episode 1

Video by Meta Developers via YouTube
VR Dev Level Up Episode 1

New series alert for developers building apps for Meta Quest 🎬

VR Developer Level Up, hosted by @dilmerv, is where we dive into what’s working across the Quest ecosystem. That includes tangible success stories with the numbers behind them, platform updates, and tool walkthroughs you can follow along with.

Ep. 1 covers four developer case studies, the latest agentic tools, and a hands-on Meta VR CLI deep dive.

🔗 Watch it at the link in the comments.

#VRDev #MetaQuest #VR #GameDev #AI

Source