Unity Introduces New AI Tools for Developers

Unity, the popular development suite, has unveiled two innovative AI tools designed to empower game developers. The first tool, Unity Muse, offers creators AI-driven assistance, serving as a teaching and search tool for those utilizing the Unity engine. Additionally, Unity Sentis allows developers to embed neural networks into game builds, opening up new possibilities.

Unity Muse simplifies the development process by presenting a sophisticated chatbot that offers adaptive advice to users. The long-term vision for Muse is to enable developers to create a wide range of content within the Unity Editor using natural input such as text prompts and sketches. Although achieving this ambitious goal may be a challenge, Muse already acts as a powerful teaching tool, benefiting developers.

Unity Sentis, on the other hand, integrates AI directly into game builds. The tool serves as a bridge between neural networks and the Unity Runtime, unlocking endless possibilities. Currently in closed beta, Sentis allows developers to incorporate AI functionality into their games, generating real-time AI-driven content like dialogue, assets, and animations.

While the results showcased in the trailer are impressive, the AI-generated assets still exhibit an uncanny eeriness. Unity’s AI solutions are a work in progress, showing promise but also room for improvement.

In addition to these two tools, Unity is also introducing “professional-quality” AI solutions in its store. These solutions promise to provide AI-powered smart NPCs, AI-produced VFX, textures, 2D sprites and 3D models, generative speech, AI testing within games, and more.

Unity’s AI-based advancements are undoubtedly exciting, but they also raise concerns within the workforce. The proliferation of generative AI without adequate regulation could lead to significant job displacement. Unity’s new AI products have the potential to revolutionize game development, but they must be handled responsibly.

Unity is not the only company providing support for developers. Microsoft’s ID@Xbox program is also committed to offering assistance to independent developers for the next 10 years.