AI in the world announce that he is collaborating with him Nvidia and Flowlabs to create an intelligent streaming assistant using AI technology.
Streamlabs Intelligent Stream Assistant is like an interactive co-host, expert producer and technical assistant that supports independent creators from an entire production team. AI in the world it provides this brain using multimodal AI, which can offload tasks from streamers who don't have large production teams.
The companies made the announcement at Nvidia's CEO Jensen Huangkeynote address at CES 2025.
The collaboration brings together Streamlabs' expertise in live streaming and Nvidia ACE technology for digital people. The latter includes audio-to-face animations, 3D rendering technology, as well as AI vision models that understand what is happening on the screen; and Inworld's next-generation AI capabilities for understanding and knowledge. Together, these technologies simplify streaming while empowering creators to produce high-quality, engaging content.
Creators can choose from assistant personalities to complement the tone of their stream, whether they're looking for subtle behind-the-scenes support or a lively co-host.
How it works
Here's how Inworld works under the hood to power this AI agent:
- Interactive co-hosting: Using Nvidia's computer vision capabilities to detect events in real-time with Inworld's ability to drive real-time agent behavior based on game state and contextual understanding of games like Fortnite, the Assistant can Intelligent Stream to offer contextually relevant commentary at the creator's request. This awareness allows the assistant to do things like highlight a well-timed build, provide commentary during a dramatic Victory Royale, or call out audience members for suggestions.
- Stream Producer: As a producer overseeing the flow of a live show, the Intelligent Stream Assistant can trigger audio and visual effects to enhance high-impact gameplay or cut the best scenes for playback. Inworld processes multi-module input from the creator, chat, and game to execute these producer actions through the Streamlabs API, giving the creator full control over how their stream will look expanding.
- Technical Assistant: The Intelligent Stream Assistant also helps with Streamlabs desktop setup and troubleshooting. Inworld processes input from the creator to implement scene transitions or animations through the Streamlabs API, helping to ensure the stream runs smoothly.
The Intelligent Stream Assistant will be available through the Streamlabs App Store when the product launches later in 2025.
“The pace of innovation in next-generation AI is nothing short of phenomenal, moving us beyond first-generation applications into a new era of sophisticated agent behavior,” said Kylan Gibbs, CEO of Inworld, in a statement. our collaboration with Streamlabs and Nvidia demonstrates how Inworld's AI agents enable real-time, context-aware interactions.More importantly, it demonstrates the real-world potential of AI to add to games and entertainment – empowering creators to deepen engagement and delight their audiences.”
Live streaming has never been more popular – or more challenging. While millions of creators engage audiences around the world, the challenges of managing production, engaging with viewers, and delivering entertainment reports at the same time being terrible.
From rendering scene transitions to providing compelling narrative, streamers must navigate a complex mix of technical and creative demands, often with limited resources, Inworld AI said.
For new and smaller creators, these barriers can be even steeper, making it harder to grow their audience and maintain consistency, the company said. Whether as a dynamic co-host by engaging the audience through real-time interaction or as a producer streamlining technical workflows, the Intelligent Flow Assistant empowers creators to focus on what matters most – including their audience.
“We hope that with this cutting-edge technology, creators can now embrace AI in a way that is true to their brand and allows them to push the boundaries of innovation,” said Ashray Urs, head of Streamlabs, in a statement. “The first intelligent streaming assistant represents another step forward for the medium, empowering creators to use this technology to make streaming easier and more attractor, length in which they maintain the level of authenticity they need to nurture and grow their community.”
Inworld's AI engine and tools are powering the next generation of innovation in games and entertainment. Inworld is backed by Lightspeed Venture Partners, Section 32, Intel Capital, Founding Fund, the Disney Accelerator, Microsoft's M12 fund, BITKRAFT Ventures, First Spark Ventures co-founded by Eric Schmidt, The Venture Reality Fund, Kleiner Perkins, CRV , Stanford University , Meta, Micron Ventures, LG Technology Ventures, Samsung Next, NTT Docomo Ventures, and SK Telecom Venture Capital.
Source link