HM Godoy

Video by Open Source Connect via YouTube

🔔 Follow our YouTube channel and don’t miss it!

Let’s learn, collaborate, and build together.

Source

Video by Hugging Face via YouTube

Training Agents, Session 4: from reward functions to environments.

In this live session, the reward stops being a function and becomes a place the agent acts in. In Session 3 the model answered once and a Python function scored it. Today the model runs a loop: open a file, run a command, read the error, try again. The training signal comes from what happened after acting.

We’ll walk the reset()/step() contract from Gym to LLM agents, build an environment with OpenEnv, push it to the Hub, and plug it into TRL’s GRPOTrainer with environment_factory. Then we go one step further and train a real coding agent harness through Harbor via OpenEnv, with AsyncGRPOTrainer on Hugging Face sandboxes.

What we’ll cover:
– Why verifiers stop working once an agent takes many actions, and why the reward has to live where the actions happen
– The reset()/step() contract: from CartPole to a coding agent with a shell, files, and tests
Anatomy of an RL environment: task, tools, backend, reward, episode
– The ecosystem: OpenEnv, Verifiers, OpenReward, Harbor, and how OpenEnv imports the others
– Building and serving an env with the openenv CLI: init, push, pull, fork
– Training with TRL: environment_factory and get_reward, no reward_funcs
– Demo 1: Qwen3-1.7B on MBPP inside a live Python session, held-out pass rate 0.49 → 0.59
– Demo 2: a real coding agent (OpenCode) on DeepCoder problems in HF sandboxes, reward 0.27 → 0.71 in 10 steps
– Reward hacking moves into the env: the try/except that never failed, the CVE fix read from .git history, and how to lock the box down

Source

Video by OpenCV via YouTube

Source

Video by PyTorch via YouTube

PyTorch 2.14 introduces updates across compilation, distributed training, performance, dynamic shapes, Apple Silicon, and accelerator platforms. Highlights include NVGEMM, a CuTeDSL-generated GEMM backend for Inductor; the new nccl2 backend for PyTorch Distributed; fault-tolerant process-group reconfiguration in c10d; native linear algebra on Apple Silicon; and declarative dynamic shapes with @dynamic_spec.

Bring your questions about the release to our live Q&A. Andrey Talman (Meta), Natalia Gimelshein (Meta), Joe Spisak (Reflection AI), and Chris Gottbrath (Gottbrath Tech, moderator) will share an overview of PyTorch 2.14 and answer community questions about PyTorch and the new capabilities in the release.

Topics will include:

– NVGEMM and CuTeDSL-generated CUTLASS kernels in Inductor
– The new nccl2 backend for PyTorch Distributed
– Fault-tolerant collectives and process-group reconfiguration in c10d
– Native linear algebra and additional Metal kernel improvements on Apple Silicon
– torch.switch and CUDA graph capture for torch.while_loop
– Declarative dynamic shapes with @dynamic_spec
– Experimental torch.compile support for complex-valued tensors
– Expanded ROCm, Intel XPU, and NVIDIA platform support

PyTorch 2.14 includes 2,995 commits from 487 contributors since PyTorch 2.13. The release includes work across compilation, distributed communication, device support, and accelerator platforms. PyTorch Conference North America 2026 takes place October 20–21 in San Jose, with sessions spanning compiler and runtime work, distributed communication, device portability, release engineering, CI, observability, accelerator integration, contributor infrastructure, and more. Explore PyTorch Conference North America 2026.

Source

Video by NetApp Instaclustr via YouTube

OpenSearch 3.7 allows KNN vectors to fetch from doc values vs. a full document decompression, meaning faster queries.

Source

Video by CNCF [Cloud Native Computing Foundation] via YouTube

The strength of the cloud native community goes beyond the code.

It’s built on people helping each other learn and grow. CNCF Ambassador Prithvi Raj shares why community contribution is the true foundation of open source.

#CloudNative #OpenSource #CNCF

Source

Video by FINOS via YouTube

Legacy frameworks like Apache Struts are notorious for harboring active exploits and severe CVEs. See how the enterprise Risk Navigator tool visualizes your exact exposure to high-risk legacy libraries. For frameworks with no easy upgrade path, the FINOS OSERA project offers a collaborative way for financial services to commission and share critical backpatches. #ApacheStruts #AppSec #DevSecOps

Source

Video by Open Data Science and AI Conference via YouTube

Event-Driven Automations

Want to learn more about AI in person? Check out ODSC AI West 2026, coming to SF this October 27th-29th: https://odsc.ai/west

#DataScience #AI #ArtificialIntelligence #ODSCAI

————————————————————————————————————-

Visit our website and choose the nearest ODSC event to attend and experience all our training and workshops: https://odsc.ai

To watch more videos like this, visit https://aiplus.training

Sign up for the newsletter to stay up to date with the latest trends in data science: https://opendatascience.com/newsletter/

Follow us online!
• Facebook: https://www.facebook.com/OPENDATASCI
• Instagram: https://www.instagram.com/odsc/
• Blog: https://opendatascience.com/
• LinkedIn: https://www.linkedin.com/company/open-data-science/
• X (twitter): https://x.com/_odsc

Source

Video by SAP via YouTube

See how dsm-firmenich uses RISE with SAP to unify post-merger operations, simplify its technology landscape, and prepare for future innovation.

dsm-firmenich is a global leader in nutrition, health, and beauty, formed through the merger of dsm and Firmenich. Bringing two companies together meant more than combining cultures. It also meant unifying business backbones, including finance, HR, and operational systems, so teams could work as one company.

Before its new journey with SAP, dsm-firmenich had a fragmented and complex technology landscape. With RISE with SAP, the company brought finance and HR processes together under one umbrella, helping create common processes, improve business continuity, and support greater flexibility as customer needs and market dynamics change.

Today, dsm-firmenich uses a broad SAP landscape, including SAP Ariba, Central Finance, SAP SuccessFactors, and Joule. As the company continues evolving its technology foundation, it is preparing its business to move faster, adapt to change, and explore innovation beyond integration with guided agents and AI-enabled processes.

Learn how dsm-firmenich is reimagining post-merger systems and processes with cloud-based solutions: https://sap.to/6050B1Afyo

Follow us on social:
LinkedIn: https://sap.to/6051B1AfyU
Instagram: https://sap.to/6052B1Afyq
Facebook: https://sap.to/6053B1AfyS
Threads: https://sap.to/6054B1Afys

About SAP:
As a global leader in enterprise applications and business AI, SAP stands at the nexus of business and technology. For over 50 years, organizations have trusted SAP to bring out their best by uniting business-critical operations spanning finance, procurement, HR, supply chain, and customer experience. For more information, visit: https://sap.to/6055B1Afyt

#SAP #RISEwithSAP #DigitalTransformation

Source

Video by TWiT Tech Podcast Network via YouTube

Windows Weekly is about more than Windows. Veteran Microsoft insiders Paul Thurrott and Richard Campbell join Leo for a deep dive into the most valuable company in the world. From consumer to enterprise, AI to Xbox, Windows Weekly is the only Microsoft podcast you’ll ever need.

You can find more about TWiT.tv and subscribe to our full shows at https://podcasts.twit.tv
Join our community at Club TWiT: https://twit.tv/clubtwit

About us:
TWiT.tv is a technology podcasting network located in the San Francisco Bay Area with the #1 ranked technology podcast This Week in Tech hosted by Leo Laporte. Every week we produce over 30 hours of content on a variety of programs including Tech News Weekly, MacBreak Weekly, Windows Weekly, Security Now, Intelligent Machines, and more.

Source