Optimizing Multi-Stage AI Pipelines: Prefix Caching for Faster Autoregressive Inference

Optimizing Multi-Stage AI Pipelines: Prefix Caching for Faster Autoregressive Inference

Video by PyTorch via YouTube
Optimizing Multi-Stage AI Pipelines: Prefix Caching for Faster Autoregressive Inference

At PyTorch Conference North America, Ricardo Noriega de Soto, Tech Lead for the vLLM Omni team and Alexander Brooks, Principal Machine Learning Engineer at Red Hat, will demonstrate how extending vLLM’s prefix caching mechanism to multistage pipelines boosts inference speeds while reducing GPU memory overhead.

Join us in San Jose on October 20th to learn practical strategies for optimizing complex AI workloads: https://hubs.la/Q04v4SL60

Source

GPU-Centric Infrastructure for AI Workloads | KubeCon Japan 2026

GPU-Centric Infrastructure for AI Workloads | KubeCon Japan 2026

Video by CNCF [Cloud Native Computing Foundation] via YouTube
GPU-Centric Infrastructure for AI Workloads | KubeCon Japan 2026

AI workloads are pushing GPU, memory, and electricity costs to unprecedented levels.

At KubeCon + CloudNativeCon Japan 2026, Takao Indoh shared why infrastructure is rapidly evolving from CPU-based architectures to dynamic, GPU-centric environments.

Watch the full talk on YouTube or explore more session recordings from KubeCon + CloudNativeCon Japan 2026: https://youtube.com/playlist?list=PLOZCGaPFoeIM&si=enU-o0Aj4hvhicwx

#KubeCon #CloudNative #Kubernetes #AI #PlatformEngineering

Source

Why your AI model isn’t reproducible #AI #DataScience #Tech

Why your AI model isn't reproducible #AI #DataScience #Tech

Video by FINOS via YouTube
Why your AI model isn't reproducible #AI #DataScience #Tech

Stop guessing why your models fail and start using AI metadata to build trustable, automated systems.

Most autonomous systems struggle because they lack the necessary context to make decisions humans trust. This video explains why machine learning evidence is the bridge between raw data and reliable performance.

Learn how to structure your pipelines to guarantee reproducible results and consistently deliver accurate AI outputs in production.

Drop a comment with your biggest data infrastructure challenge.

Source

AI Attacks Are Moving at Machine Speed. Defense Has to Catch Up with David Campbell

AI Attacks Are Moving at Machine Speed. Defense Has to Catch Up with David Campbell

Video by Open Data Science and AI Conference via YouTube
AI Attacks Are Moving at Machine Speed. Defense Has to Catch Up with David Campbell

AI security is no longer just about preventing harmful outputs.

As AI agents gain access to tools, data, memory, and production systems, security has to move beyond the model itself.

In this episode of the ODSC AI X Podcast, host Dan Gerlanc speaks with David Campbell, previously Head of AI Security at Scale AI, about the evolving risks of agentic AI and what it takes to secure AI systems in production.

They discuss AI red teaming, persistent prompt injection, least privilege, observability, system-level security, and why autonomous cyber defense may become essential as AI agents grow more capable.

00:00 Intro: AI Security, Red Teaming & Autonomous Cyber Defense
01:13 AI Security Lessons from Google, Uber & DoorDash
03:05 AI Coding Risks, Bugs & the Engineering Skills Gap
08:06 Building and Scaling Distributed Systems at Uber
14:13 Why Go Works for AI Coding Agents
16:00 AI Red Teaming & Jailbreaking Frontier Models
21:08 Automating AI Jailbreaks & Adversarial Testing
26:10 AI Agent Security: From Model Risks to Real Cyber Threats
31:06 Persistent Prompt Injection & Agent Security Risks
33:07 Least Privilege, Permissions & Human Oversight for AI Agents
37:00 Why AI Guardrails Aren’t Enough: Observability & System Security
40:03 Autonomous Cyber Defense & the Future of AI Security

Visit our website and choose the nearest ODSC AI event to attend and experience all our training and workshops: https://odsc.ai

To watch more videos like this, visit https://aiplus.training

Sign up for the newsletter to stay up to date with the latest trends in data science: https://opendatascience.com/newsletter/

Follow us online!
• Facebook: https://www.facebook.com/OPENDATASCI
• Instagram: https://www.instagram.com/odsc/
• Blog: https://opendatascience.com/
• LinkedIn: https://www.linkedin.com/company/open-data-science/
• X (twitter): https://x.com/_odsc

Source

2.5 Admins 316: BGP Clipboard Hijack

2.5 Admins 316: BGP Clipboard Hijack

Video by The Late Night Linux Family via YouTube
2.5 Admins 316: BGP Clipboard Hijack

Support us on Patreon and get an ad-free RSS feed with some early episodes. https://www.patreon.com/LateNightLinux

A BGP hijack involved some basic errors, Microsoft teaches people to ignore warnings in Windows, Zoom appears to be reading the clipboard on X11, why a non-US open certificate authority is feasible in theory, and keeping a NAS powered on as little as possible.

Source

Flagsmith Experimentation Demo: Set Up a Full A/B Test in 5 Minutes

Flagsmith Experimentation Demo: Set Up a Full A/B Test in 5 Minutes

Video by Flagsmith via YouTube
Flagsmith Experimentation Demo: Set Up a Full A/B Test in 5 Minutes

Start getting data from your A/B test in minutes with Flagsmith’s new Experimentation feature, which turns your existing feature flags into full experiments—with warehouse-native analysis built in.

Read the docs and start experimenting: https://docs.flagsmith.com/experimentation

00:00 Intro
00:24 The demo: an e-commerce checkout test
01:16 Setting up your data warehouse in two clicks
01:55 Creating your first experiment
02:28 Configuring the rollout and traffic split
02:51 Defining a conversion metric
03:52 Launching the experiment
04:32 The code: two new SDK methods
05:35 Reading the results: win probability and credible intervals
Flagsmith Experimentation enables you to run data-driven releases without leaving your feature flag platform.

Try Flagsmith for free: https://www.flagsmith.com/

Source

Why Event-Driven Architecture Matters for AI and How SAP Integration Suite Helps | From APIs to AI

Why Event-Driven Architecture Matters for AI and How SAP Integration Suite Helps | From APIs to AI

Video by SAP via YouTube
Why Event-Driven Architecture Matters for AI and How SAP Integration Suite Helps | From APIs to AI

Discover why event-driven architecture is the essential foundation for scalable,
responsive agentic AI and how SAP Integration Suite, advanced event mesh makes it possible.

Join Udo Paltzer, Head of Product Management for SAP Integration Suite, as he explains
how real-time business events empower AI agents to move beyond historical analysis and
act intelligently at the exact moment it matters.

In this video, you’ll learn:

✅ Why AI is only as intelligent as the data and events it receives
✅ How fragmented, delayed, or siloed data prevents real-time AI decisions
✅ What event-driven architecture is and why it’s essential for agentic AI
✅ How SAP Integration Suite, advanced event mesh enables reliable, secure, real-time event streaming across distributed SAP and non-SAP systems
✅ How real-time event ingestion strengthens contextual grounding for LLMs and AI agents
✅ How to accelerate scalable AI adoption and build the autonomous enterprise of the future

Trusted, real-time data is no longer a competitive advantage – it’s an imperative for
enterprise AI. SAP Integration Suite provides the integration foundation that connects
agents, applications, business processes, APIs, and data across your entire landscape.

🔗 Learn more on the SAP Community: https://sap.to/6055BGzHnb
🔗 Explore SAP Integration Suite, advanced event mesh: https://sap.to/6056BGzHnj

Chapters:
00:41 The Fundamental Truth: AI is Only as Smart as Its Data
01:08 What is Event-Driven Architecture?
01:43 SAP Integration Suite: The Foundation for Agentic AI
02:22 Real-Time Event Ingestion for AI Agents & LLMs
02:45 Building the Autonomous Enterprise of the Future

What’s your take on event-driven AI? Share your thoughts in the comments!
Follow us on social:
LinkedIn: https://sap.to/6057BGzHnd
Instagram: https://sap.to/6059BGzHn5
Facebook: https://sap.to/6050BGzHng
Threads: https://sap.to/6051BGzHn9

About SAP:
As a global leader in enterprise applications and business AI, SAP stands at the nexus of business and technology. For over 50 years, organizations have trusted SAP to bring out their best by uniting business-critical operations spanning finance, procurement, HR, supply chain, and customer experience. For more information, visit: https://sap.to/6052BGzHni

#SAPIntegrationSuite #AIagents #EnterpriseAI

Source

AI is KILLING Junior Jobs, Experts Warn! #shorts

AI is KILLING Junior Jobs, Experts Warn! #shorts

Video by TWiT Tech Podcast Network via YouTube
AI is KILLING Junior Jobs, Experts Warn! #shorts

A Harvard study found companies adopting generative AI saw a 9% drop in junior employment within 6 quarters, while senior roles continued to grow. A Stanford analysis confirms this trend. #GenerativeAI #JobMarket #FutureOfWork #AIImpact

You can find more about TWiT and subscribe to our full shows at https://podcasts.twit.tv/
Subscribe: https://twit.tv/subscribe
Products we recommend: https://www.amazon.com/shop/twitnetcastnetwork
TWiT may earn commissions on certain products.

Join our TWiT Community on Discourse: https://www.twit.community/

Source

These projects get a lot of criticism.. Why, and is it deserved ?

These projects get a lot of criticism.. Why, and is it deserved ?

Video by The Linux Experiment via YouTube
These projects get a lot of criticism.. Why, and is it deserved ?

Try out Proton Mail, the secure email that protects your privacy: https://proton.me/mail/TheLinuxEXP

Grab a brand new laptop or desktop running Linux: https://www.tuxedocomputers.com/en#

👏 SUPPORT THE CHANNEL:
Get access to:
– a Daily Linux News show
– a weekly patroncast for more thoughts
– your name in the credits

YouTube: https://www.youtube.com/@thelinuxexp/join
Patreon: https://www.patreon.com/thelinuxexperiment

Or, you can donate whatever you want:
https://paypal.me/thelinuxexp
Liberapay: https://liberapay.com/TheLinuxExperiment/

👕 GET TLE MERCH
Support the channel AND get cool new gear: https://the-linux-experiment.creator-spring.com/

Timestamps:
00:00 Intro
01:04 Sponsor: Proton Mail
02:16 SystemD
07:04 Wayland
12:27 Ubuntu
15:38 Snaps
20:24 Flatpak
24:11 Gnome
30:34 Conclusion
31:11 Sponsor: Tuxedo Computers

#linuxdesktop #linuxnews #linuxdistro

Source

The $50 Water Turbine -DIY, Portable, Powerful, Open Source

The  Water Turbine -DIY, Portable, Powerful, Open Source

Video by OpenSourceLowTech via YouTube
The  Water Turbine -DIY, Portable, Powerful, Open Source

The whole story so far; Catalunya, Berlin, Scotland, Nepal.
This open source turbine can be built for about half the cost of a 120 watt solar panel, and will produce about ten times the power per day. It can be plugged into any appropriate waterway without the need for earthworks, and uses only basic off the shelf and recycled materials, and basic hand tools.
The turbine is now working and producing power.

Build tutorial: https://www.youtube.com/watch?v=PmuW1i20K3c

This technology was produced in partnership with COACT, an open source green tech incubator in Barcelona.

And thanks to the good people at Ca La Fou (https://calafou.org/) for the rest.

My name is Daniel Connell. I prototype and develop basic technologies which anyone can make using recycled materials and simple tools.
The aim is for everyone everywhere to be able to build and maintain their own infrastructure; producing their own energy, food, clean water, communications, and anything else they need.
All designs are open source and license free for any purpose, and full construction tutorials and how-tos are available on the opensourcelowtech.org website.

00:00 Catalunya
06:50 Berlin
23:12 Scotland
34:56 Nepal
50:25 Results and Data

#water #turbine #DIY #hydro #renewable #energy

Source