Download
4 years ago Senior Software Engineer Sharath Patali, added speech recognition to a multitouch interface, which can be seen in the below video.
We thought it would be fun to redo that project from the ground up, but actually link it to the current Media app within Snowflake and as part of a hackday project.
The result of this hackday project from colleague Dev, you can see in the video below.
Here at NUITEQ we stimulate innovation and creative thinking. We allow our software engineers to spend a certain amount of their time working on their own ideas, the so called hackdays. These hackdays don’t have to be related to Snowflake, multitouch technology or Natural User Interfaces, which is what NUITEQ is all about. We are really true believers of this kind of creative freedom and flexibility as it allows the brilliant minds of these ridiculously talented people, to make their own thoughts a reality, opposed to only working on product related projects or customer development projects.
The rules of a NUITEQ hackday project:
- It has to be a rough crude prototype/hack, so it doesn’t have to be a flawlessly working finished end product
- Spend max 2 work days on the project (in this case this project was a 3 work day project)
- Create a short 2-3 min crude video of the project to showcase the work
- Make sure to have fun and learn something new
Project description:
The goal of this project was to integrate speech recognition into the existing Media app from Snowflake to process simple commands. The Media app has different content layouts and the user can switch from one to another using voice commands. Using this feature is very straight forward. The user has to click a designated button which starts recording the command (for 2 seconds). The commands take the form of numbers (one, two, three etc), with each number representing a particular layout. If the command was successfully processed, the layout corresponding to that command is activated, else the icons are arranged in a random fashion.
Potential improvements:
- Improve accuracy by configuring Pocketsphinx to accept a different sampling rate.
- Broaden the scope of the commands, such as using polysyllabic words or using a more comprehensive dictionary.
- Continuous recording without the need to push a button
Let us know what you think in the comments section below.
Please note that this is a project and what you see in the video is not actually part of the Snowflake product range till date.
