OrderUp!

This is a game I developed for my University project that covered multimodal interface game systems and how they can be utilised within the gaming industry.
For the purpose of this project, I made use of speech recognition capabilities in Unity Engine, on top of your basic keyboard and mice to create a Kitchen Simulator game.

The game puts you in the role of a chef, in which you can use a variety of machines and ingredients to prepare burger recipes.

The game can be fully played with your typical keyboard and mouse system, however, a voice recognition system was used to further expand the user experience and enable the use of voice as an additional interaction medium.

The game was designed with multimodal systems in mind, therefore a well-developed level design, thought out colours and models were implemented later in a bare-bones state.

Voice Recognition System

This was a system that would detect user speech recognition when they held down the spacebar key. I used the built-in Unity Engine KeywordRecognizer to allow the game to recognise certain words and execute code accordingly.

The entire game could be controlled using the speech recognition system (aside from the movement), which allowed for a diverse and interactive way of playing the game.

Machinery

Ingredient Dispenser

This is a machine that spawns ingredients when interacted with. The buttons can be manually pressed with the mouse, or be spawned using a voice command such as "spawn/make [item name]"

Cooker

Cooker is a simple machine that would cook a specific item after a short period. Item staying on the grill for too long becomes burnt which is unusable for the combiner machine.

Combiner

This machine takes all the ingredients on its conveyor and combines them automatically to create the burger of your choice. Due to this project being about multimodal systems, the only way that you could realistically combine ingredients to create a dish was through using machines.

The ingredients stored in the machine are displayed on the screen on the machine and the buttons are used to create the burger recipe can be pressed manually using a point-and-click or through voice commands such as "Make Basic Burger".

Receiver

This machine creates a random burger recipe order and displays it on the screen. The machine would only take the burger that corresponds to the burger on screen. If the order is wrong, an error message would display. If the order is correct, the conveyor would take the order away.

Once again this machine can be interacted with a mouse click as well as using the speech recognition system. Saying the following lines "Order Up", would activate the machine.

A lot of things could be improved in this project, ranging from the general look and style, to code efficiency in both the voice recognition system and the general code for the game systems. And more importantly how the machines operate and how the player interacts with them.
I plan to revisit this project and do a little reboot of the game's systems and design.