This means you can now record audio using your kinect, but that's not all that interesting in and of itself. Linux support for speech recognition at this point is not all that great. It is possible to run dragon naturallyspeaking via wine or to use the sphinx project (after much training), but neither of those approaches really appealed to me for simple voice commands (as opposed to dictation). The google android project happens to include a speech recognizer from Nuance which by default is meant to be built for an ARM target, like your phone. After extensive hacking around the build system I was able to instead build for an x86 target, like your desktop. Now, you can combine these two things- kinect array microphone + android voice recognition to do some more interesting things, i.e. toggle hand tracking on and off via voice.
How to get started:
1) Check if you have the "unbuffer" application which is part of the linux scripting language called expect:
which unbuffer
If the above command comes up empty you should download a copy of unbuffer from the link here:
http://dl.dropbox.com/u/11217419/unbuffer
copy unbuffer to a directory that is in your path, like /usr/local/bin or ~/bin
2)Download my precompiled version of the srec subproject from here:
http://dl.dropbox.com/u/11217419/srec_kinect.tgz
3)save the tarball from step 1 in a convenient directory then unpack it with this command:
tar xfz srec_kinect.tgz
4)switch into the subdirectory where I've placed some convenience scripts:
cd srec/config/en.us
5) Open a second terminal and in that second terminal also switch into srec/config/en.us
6) In the first terminal execute
./run_SRecTestAudio.sh
and in the other terminal execute
cat speech_fifo
7) try speaking into your microphone and wait for recognition results to appear in both terminals. Note that the vocabulary as configured at this point is very small- words like up,down,left,right and the numbers from 1-9 should be recognized properly.
Integrating the kinect:
1)Acquire Antonio Ospite's firmware tools like so:
git clone http://git.ao2.it/kinect-audio-setup.git/
2)move into the kinect-audio-setup subdirectory:
cd kinect-audio-setup
3)build kinect_upload_fw as root:
make install
4)Fetch and extract the microsoft kinect SDK audio firmware (depending on your directory permissions, this may also need to be run as root):
./kinect_fetch_fw /lib/firmware/kinect
This will extract the firmware to this location by default:
/lib/firmware/kinect/UACFirmware.C9C6E852_35A3_41DC_A57D_BDDEB43DFD04
5)Upload the newly extracted firmware to the kinect:
kinect_upload_fw /lib/firmware/kinect/UACFirmware.C9C6E852_35A3_41DC_A57D_BDDEB43DFD04
6)Check for a new USB audio device in your dmesg output
7)Configure the kinect USB audio device to be your primary microphone input and
try out run_SRecTestAudio.sh again as described earlier.
Additional Notes:
I unfortunately no longer remember all the changes I had to make in order for the srec project within android build for x86. Perhaps someone with better knowledge of the android build system can chime in at the comments below. In the interim, use the precompiled copy that I have linked above, just be aware that it is old, I think it dates back to the froyo branch of android or earlier (I compiled it a long time ago). If you want to take a shot at building the latest srec yourself, check out the android source code then look under external/srec/
The run_SRecTestAudio.sh script sets up the speech recognizer to run on live audio and pipes the recognition results to a fifo in the same directory called speech_fifo. Running cat in the second terminal lets you read out the recognition results as they arrive. Instead of cat you could alternatively have whatever programs needs recognition results read from the fifo and act accordingly. Unbuffer is used to make sure you see recognition results right away rather than waiting for the speech_fifo to fill up.
The srec recognizer does not require any training but has certain limitations. The most significant limitation is the vocabulary it can recognize. The larger the vocabulary you specify, the less accurate the recognition results will likely be. As a result this recognizer is best used for a small set of frequently used voice commands. Under srec/config/en.us/grammars/ there are a number of .grxml files which define what words the recognizer can understand. You can define your own simple grammar (.grxml) here which, for example, only recognizes the digits on a phone keypad. To do this you can follow the syntax of any of the other .grxml files in the directory and then execute run_compile_grammars.sh which will produce a .g2g file from the .grxml file. There is also a voicetag/texttag file with extension .tcp which needs to point to the g2g file of your choice. You can find the .tcp files under the srec/config/en.us/tcp directory. run_SRecTestAudio.sh points to a tcp file which you can specify.
outstanding article! Can't wait to tell my kinect to control my xbmc gentoo :)
ReplyDeleteIf you don't mind I'd like to ask you if you could share your srec changes?
In case the license allows this I'm sure making this a standalone shared lib would help a lot in many projects.
friendly,
marcel "frostwork"unbehaun
I intend to post up the binaries and more detailed instructions when I get home tonight. After I started writing this post I realized I had a lot of hard-coded absolute paths in the build scripts so I need to go through and make them relative paths before I post up the files.
ReplyDeletesounds good! I'll try to wrap a cmake build system around it then to create a shared.so
ReplyDeletethank you for sharing your changes!
ReplyDeleteLooks like it will need some time to create proper cmake scripts around the sourcecode :)
Did I miss where you posted the changes?
ReplyDeletekodom, look above under step 2 of "How to get started" and you'll see this link: http://dl.dropbox.com/u/11217419/srec_kinect.tgz
ReplyDeleteThat is my build of the recognizer. Were you looking for a written description of the changes needed to make that build?
Hi, i'm trying to integrate the kinect audio as how you gave in the instruction "integrating the kinect" but it always fails at the 4th step saying:
ReplyDeletels: cannot access UACFirmware.*: No such file or directory
install: cannot stat `': No such file or directory
It seems the extraction does not produce any file. Do you know why this is happening and how to fix it exactly?
and by the way, does this work on 64 bit machines? i'm on ubuntu 10.04 64 bit..
Thanks man, this will be really useful..
30hoursflight, it's possible that maybe the download location of the firmware file has changed and thus no file is getting downloaded or perhaps you need to run step 4 as root so that kinect_fetch_fw is actually able to write to /lib/firmware/kinect(or I suppose you could change the owner and permissions of that directory). Let me know if none of those ideas explain your problem. Not sure about the 64-bit concerns- my linux box is an old 32-bit machine.
ReplyDeleteThe Download location is definitely correct as i've downloaded the driver myself. I, of course, also run the 4th step command as root user. What seems to be the problem is that when we extract that archive we just downloaded, it does not contain the "UACFirmware.C9C6..."
ReplyDeleteDO you think you have any idea on this?
About the 32 / 64 bit issue, we can simply change the download link in the script you made to download the 64 bit version driver, i guess. But either way, the problem i just mentioned above still persists.
Thanks for helping man..
Check if ur 7z version >= 9.20
DeleteUnder 64-bit ubuntu, you also need to install ia32-libs-multiarch ( sudo apt-get install ia32-libs-multiarch ) or you will get an error about "file not found" for libESR_Portable.so
ReplyDeletehi trtg,
ReplyDeletecan you send the makefile to build srec for Linux? (sleuthhound@gmail.com)
thank you so much!
This comment has been removed by the author.
ReplyDeleteThis comment has been removed by the author.
ReplyDeleteI really appreciate you posting this. speech recognition software
ReplyDeletecoach outlet
ReplyDeletecoach outlet
michael kors handbags
cheap jordans
michael kors outlet clearance
toms shoes
adidas originals
michael kors outlet
christian louboutin shoes
christian louboutin shoes
asics shoes
adidas ultra boost
lebron james shoes 13
replica watches
jordan 3 infrared
cheap jordan shoes
jordan 3
michael kors purses
coach outlet
louis vuitton bags
michael kors handbags
louis vuitton handbags
coach factory outlet
asics outlet
toms shoes
toms
louis vuitton outlet
coach factory outlet
gucci handbags
replica watches for sale
supra sneakers
tods outlet
michael kors outlet
lebron james shoes
michael kors outlet clearance
cheap ray ban sunglasses
jordan shoes
louis vuitton outlet
michael kors outlet
christian louboutin outlet
2016.7.29haungqin
ugg boots
ReplyDeleteugg boots uk
coach outlet
louis vuitton purses
uggs uk
uggs outlet
uggs outlet
louis vuitton handbags
ugg slippers
rolex watches
toms shoes
christian louboutin outlet
coach outlet online
michael kors handbags
michael kors outlet
hollister clothing
curry 3
christian louboutin sale
coach factory outlet online
los angeles clippers jerseys
oakley sunglasses
moncler jackets
ugg boots
pandora jewelry
coach factory outlet
coach outlet clearance
christian louboutin outlet
red bottoms
burberry outlet
oakley sunglasses
coach outlet store online clearances
air max 90
louis vuitton handbags
louis vuitton outlet
louboutin shoes
michael kors handbags
chenlili20160909
adidas shoes
ReplyDeleteair max 95
ray ban sunglasses
true religion jeans
coach outlet
tory burch outlet store
true religion jeans
nike air max
james shoes
nike outlet
20170323huazhen
ray ban sunglasses
ReplyDeletecoach outlet
tory burch
oakley sunglasses
christian louboutin
nike store
yeezy boost 350 v2
michael jordan shoes
coach outlet
red bottom shoes
20175.6wengdongdong
moncler jackets
ReplyDeletecoach outlet store
ed hardy outlet
curry shoes
coach outlet online
ralph lauren outlet
kate spade outlet online
nike air force
tory burch outlet online
toms outlet
170522yueqin
ray ban sunglasses
ReplyDeletemichael kors outlet
michael kors outlet
nike air max
coach outlet
adidas yeezy
tods outlet
pandora outlet
discount oakley sunglasses
michael kors canada
mt0622
coach outlet online
ReplyDeletecanada goose outlet
coach outlet
coach factory outlet
michael kors
ugg boots clearance
polo ralph lauren outlet
cheap ugg boots
uggs outlet
ralph lauren polo
20170914lck
20180102 leilei3915
ReplyDeletepolo outlet
jordan shoes
kate spade outlet online
coach factory outlet
ugg outlet store
christian louboutin
ray ban sunglasse
michael kors outlet online
cheap jordans for sale
ralph lauren shirts
mont blanc pens
ReplyDeleteoakley sunglasses wholesale
coach factory outlet online
ralph lauren
christian louboutin
nike air max
pandora outlet
christian louboutin outlet
canada goose
cheap nfl jerseys wholesale
chenminghui20180412
cat boots
ReplyDeletelongchamp bags
links of london
michael kors outlet
nike flyknit racer
michael kors handbags
fila
kobe 9
michael kors purses
ray ban outlet
The onus remains solidly, on each speech producer to recognize the kind of speech most reasonable to his/her motivation.robot voice text to speech
ReplyDeleteWould take that finish on Sunday, too, he laughed. Had a long wait at 16 (485 yard par 4) because it a really tough hole. I hit a 3 wood straight into the wind and a 2 iron into the bunker. Several days later, Owen picked up a thigh injury in training. Newcastle manager Sam Allardyce admitted that Owen was likely to miss the start of the forthcoming Premier League season due to the injury which "doesn't look as encouraging as we first thought". Owen made his comeback from injury in a club friendly on 13 August 2007 and declared himself available for Newcastle's next match, against Aston Villa, as well as England's forthcoming international matches.
ReplyDeleteAnd there's no need to doubt whether Longchamp Soldes Destockage these teams would be Cheap Oakley Sunglasses willing to create the cap space necessary to sign James. In his 15th season, James is averaging 26.9points, 9.0 assists and 8.4 rebounds per game while shooting 54.3percent from the field and 37.1percent from 3 point range. Bolsos Michael Kors Baratos He is Ray Ban Sale UK the most powerful and recognizable star in the league, and his impact can extend beyond the floor to a city's economy.
You can pick the kind of the voice - male or female and generally there is more than one voice accessible per sexual orientation.free text to speech converter
ReplyDeleteCoach Outlet Usa
ReplyDeleteCoach Bags Outlet
Coach Sale
Coach Outlet Sale
Coach Bags For Cheap
Coach Bags On Sale At Outlet
Coach Outlet Near Me
Coach Name Change
Coach Store
Coach Tote
Black Coach Purse
Outlet Michael Kors
MK Purses Clearance
Michael Kors Outlet Sale
Michael Kors Bags On Sale Amazon
Amazon Michael Kors Bags
Michael Kors Tote Sale
Cheap MK Bags
MK Handbags Sale
Michael Kors Outlet Online
MK Bags On Sale
Cheap Michael Kors
Cheap Michael Kors Handbags
Coach Outlet Usa
ReplyDeleteCoach Bags Outlet
Coach Sale
Coach Outlet Sale
Coach Bags For Cheap
Coach Bags On Sale At Outlet
Coach Outlet Near Me
Coach Name Change
Coach Store
Coach Tote
Black Coach Purse
Outlet Michael Kors
MK Purses Clearance
Michael Kors Outlet Sale
Michael Kors Bags On Sale Amazon
Amazon Michael Kors Bags
Michael Kors Tote Sale
Cheap MK Bags
MK Handbags Sale
Michael Kors Outlet Online
MK Bags On Sale
Cheap Michael Kors
Cheap Michael Kors Handbags
Both things are possible if you carry Michael Kors Handbags Wholesale. If you are a woman who goes for innovative designs, a designer Michael Kors Bags On Sale is perfect for you. Offering a huge selection of chic purses, handbags, shoes and accessories, Michael Kors Outlet Online Store celebrates womanhood in an entirely unique way. Michael Kors Factory Outlet Online Store At Wholesale Price are one of the most sought-after handbags worldwide. We all agree that diamonds are a woman's best friend; however Official Coach Factory Outlet Online are absolutely next in line. To Coach Outlet Sale aficionados, don't fret because we have great news: a discount Official Coach Outlet Online isn't hard to find. If you are a smart shopper looking for a good buy and great deals on your next handbag purchase, you can go to Official Coach Outlet Online.
ReplyDeleteFriendly Links: Toms Shoes Womens | Toms Clearance
kebutuhan pasutri jadi semakin lengkap dengan adanya levitra 100 mg original cod di cikarang kota sebagai obat untuk pembangkit ereksi agar hubungan bersama istrinya jadi lebih memuaskan info selengkapnya . dengan bantuan pil levitra asli 100 mg cod di karawang yang berasal dari jerman kini pasutri lebih bisa memaksimalkan saat hubungan badan bersama pasangan menuju puncak seksual yang mereka inginkan baca selanjutnya . kehebatan pria saat mengonsumsi levitra asli 100 mg cod di semarang utara semakin dapat menambah percaya diri saat diranjang bersama pasangan tanpa adanya rasa kecewa saat penetrasi read more . rasa khas yang ada didalam permen soloco asli cod di bandung adalah memiliki rasa coklat yang banyak disukai oleh kalangan pria dan wanita, untuk itu permen ini sangat cocok bagi kalangan dewasa yang ingin mencapai klimaks saat berhubungan intim bersama pasangan.
ReplyDeleteGreat job for publishing such a nice article. Your article isn’t only useful but it is additionally really informative. Thank you because you have been willing to share information with us. text to speech natural voices
ReplyDeletesupreme clothing
ReplyDeletelebron 18
yeezy 350 v2
longchamp bags
jordans shoes
lebron 17 shoes
yeezy boost 350
yeezy boost 350
giannis antetokounmpo shoes
jordan shoes
cami avizesi - cami avizeleri - avize cami - no deposit bonus forex 2021 - takipçi satın al - takipçi satın al - takipçi satın al - takipcialdim.com/tiktok-takipci-satin-al/ - instagram beğeni satın al - instagram beğeni satın al - btcturk - tiktok izlenme satın al - sms onay - youtube izlenme satın al - no deposit bonus forex 2021 - tiktok jeton hilesi - tiktok beğeni satın al - binance - takipçi satın al - uc satın al - sms onay - sms onay - tiktok takipçi satın al - tiktok beğeni satın al - twitter takipçi satın al - trend topic satın al - youtube abone satın al - instagram beğeni satın al - tiktok beğeni satın al - twitter takipçi satın al - trend topic satın al - youtube abone satın al - takipcialdim.com/instagram-begeni-satin-al/ - tiktok takipçi satın al - tiktok beğeni satın al - twitter takipçi satın al - trend topic satın al - youtube abone satın al - instagram beğeni satın al - perde modelleri - instagram takipçi satın al - takipçi satın al - instagram takipçi satın al - betboo
ReplyDeleteinstagram takipçi satın al
ReplyDeleteinstagram takipçi satın al
takipçi satın al
takipçi satın al
instagram takipçi satın al
takipçi satın al
instagram takipçi satın al
aşk kitapları
tiktok takipçi satın al
instagram beğeni satın al
youtube abone satın al
twitter takipçi satın al
tiktok beğeni satın al
tiktok izlenme satın al
twitter takipçi satın al
tiktok takipçi satın al
youtube abone satın al
tiktok beğeni satın al
instagram beğeni satın al
trend topic satın al
trend topic satın al
youtube abone satın al
beğeni satın al
tiktok izlenme satın al
sms onay
youtube izlenme satın al
tiktok beğeni satın al
sms onay
sms onay
perde modelleri
instagram takipçi satın al
takipçi satın al
tiktok jeton hilesi
pubg uc satın al
sultanbet
marsbahis
betboo
betboo
betboo
takipçi satın al
ReplyDeletetakipçi satın al
takipçi satın al
marsbahis
ReplyDeletebetboo
sultanbet
marsbahis
betboo
sultanbet
This post is so useful and valuable to increase our knowledge. I am happy that you have shared great info with us. Grateful to you for sharing an article like this. Dropbox transfer
ReplyDeleteThis comment has been removed by the author.
ReplyDeleteSo nice I am enjoying for that post as for u latest version of this Security tool Available
ReplyDeletedragon naturally speaking crack
cyberlink youcam deluxe crack
opencanvas crack
nch photopad image editor pro crack
I guess I am the only one who comes here to share my very own experience guess what? I am using my laptop for almost the post 2 years.
ReplyDeleteDragon Naturally Speaking Crack
I guess I am the only one who came here to share my very own experience. Guess what!? I am using my laptop for almost the past 2 years, but I had no idea of solving some basic issues. I do not know how to Crack Softwares Free Download But thankfully, I recently visited a website named ProCrackHere
ReplyDeleteDragon Naturally Speaking Crack
Netbalancer Crack
useful site look at this website look at these guys Recommended Site view it read
ReplyDeleter5h01j9j47 s3s70o2i80 w4y12w0x88 h1y47h8h54 z4n88x8r39 o3x91j4k46
ReplyDelete안동출장안마
ReplyDelete안동출장안마
전주출장안마
무주출장안마
전주출장안마
영주출장안마
군산출장안마