Welcome to the TechNet Wiki Tuesday – TNWiki Article Spotlight.
This article explains about how to call Language Understanding Intelligent Service (LUIS) from Unity3d. The reason why I have selected this article is as this article talks about Unity3d with the combination of Language Understanding Intelligent Service (LUIS). There are very articles which explains about Unity3d and this article is special as this article also describing about how to call the LUIS from Unity3d.
Language Understanding (LUIS) allows your application to understand what a person wants in their own words. LUIS uses machine learning to allow developers to build applications that can receive user input in natural language and extract meaning from it.
Chilberto also explained in this article as this post is continues of his previous post Azure Cognitive Services - Bing Speech API and Language Understanding Intelligent Service (LUIS) and in that article he has explained about using Azure Cognitive Services using LUIS with Speech API. In this article he extends to call the LUIS from Unity3d game application.
In this article we can learn
- Unity Project
- Asset Store
- Setting up the scene
- Visual stimuli
- Star Cruiser
- Capturing Voice
- Converting to .wav format
- Convert to Text
- Translating from Text to Command
The important point to be note here is we can download the source code from the download part of the article.
Chilberto completed this article with the conclusion as below
Combining AI with gaming has been happening for a while now and using hosted services makes a lot of sense for scalability, global coverage, and the simplicity in getting up and running for both indie devs and professional studios. The example shown here is simple and, in all likelihood, controlling the movement of a ship would be easier to be done with an arrow or WASD keys.
But imagine a more complex scenario. For example, Lock phasers on target alpha, strength to stun or All ahead full to Alpha Centauri in the Gamma Quadrant. It is a guess that many players of loot grabbing games on consoles would have loved a voice-controlled inventory system: Sell to a merchant, all ammo where the inventory is over 10 and not used by any of my guns.
I believe this article will be a great feast for all who is looking to work with Unity3d and Cognitive Services ,don't miss to read this article from here Unity3d - Using LUIS for voice activated commands by Chilberto . I hope you all enjoy reading his article.
See you all soon in another blog post.
PS: Today’s banners come from MandarDharmadhikari.
Thank you all.