Video by OpenCV via YouTube
Join Jason Ren of Ai2 (Allen Institute for AI) for MolmoMotion: Forecasting Point Trajectories in 3D with Language Instruction, a live look at how open multimodal models move past describing a scene to predicting where things go next. Building on the Molmo family’s pointing and tracking capabilities, MolmoMotion takes a plain-language instruction and forecasts point trajectories through 3D space, so the model answers by showing exactly where and when motion will happen. Expect live demos, a walk through the training data and recipe, and a discussion of what this opens up for robotics, video understanding, and embodied agents.
OpenCV is a 501(c)(3) registered non-profit in the United States. See how you can support open source CV & AI: http://opencv.org/support/
Watch along for your chance to win during our live trivia segment, and participate in the live Q&A session with questions from you in the audience.
Become a paid member of the channel to help us make more episodes https://www.youtube.com/channel/UCkrcW82Y2kbgU-U9RaYfgxw/join
Got a cool project of your own? Send it to us and you may be featured https://www.jotform.com/form/233105358823151
Thumbnail by Natalia de la Rosa natdlrs.com