TNWiki Article Spotlight – Unity3d and Language Understanding Intelligent Service (LUIS)

  • Article
Dear All,

Welcome to the TechNet Wiki Tuesday – TNWiki Article Spotlight.

In today's blog post we are going to see about  Unity3d - Using LUIS for voice activated commands  by Chilberto

This article explains about how to call Language Understanding Intelligent Service (LUIS) from Unity3d. The reason why I have selected this article is as this article talks about Unity3d with the combination of Language Understanding Intelligent Service (LUIS). There are very articles which explains about Unity3d and this article is special as this article also describing about how to call the LUIS from Unity3d.

Language Understanding (LUIS) allows your application to understand what a person wants in their own words. LUIS uses machine learning to allow developers to build applications that can receive user input in natural language and extract meaning from it.

Chilberto also explained in this article as this post is continues of his previous post Azure Cognitive Services - Bing Speech API and Language Understanding Intelligent Service (LUIS)  and in that article he has explained about using Azure Cognitive Services using LUIS with  Speech API. In this article he extends to call the LUIS from Unity3d game application.

Unity is the ultimate 2D and 3D game development platform. We can deploy the Unity in mobile, desktop, VR/AR, consoles or the Web and etc. Unity supports javascript and C# as development languages but an important fact to emphasize is the engine uses the C# compiler Mono to build the game.

In this article we can learn

  • Unity Project
  • Asset Store
  • Setting up the scene
  • Visual stimuli
  • Star Cruiser
  • Capturing Voice
  • Converting to .wav format
  • Convert to Text
  • Translating from Text to Command

The important point to be note here is we can download the source code from the download part of the article.

Chilberto completed this article with the conclusion as below

Combining AI with gaming has been happening for a while now and using hosted services makes a lot of sense for scalability, global coverage, and the simplicity in getting up and running for both indie devs and professional studios.  The example shown here is simple and, in all likelihood, controlling the movement of a ship would be easier to be done with an arrow or WASD keys.
But imagine a more complex scenario.  For example, Lock phasers on target alpha, strength to stun or All ahead full to Alpha Centauri in the Gamma Quadrant.   It is a guess that many players of loot grabbing games on consoles would have loved a voice-controlled inventory system: Sell to a merchant, all ammo where the inventory is over 10 and not used by any of my guns.

I believe this article will be a great feast for all who is looking to work with Unity3d and Cognitive Services  ,don't miss to read this article from here  Unity3d - Using LUIS for voice activated commands  by Chilberto . I hope you all enjoy reading his article.

See you all soon in another blog post.

PS: Today’s banners come from MandarDharmadhikari.

Thank you all.

tnwlogo_3

Yours,
Syed Shanu
MSDN Profile | MVP Profile | Facebook | Twitter |
TechNet Wiki the community where we all join hands to share Microsoft-related information.