View unanswered posts    View active topics

Board index KnoppMyth General

All times are UTC - 6 hours





Post new topic Reply to topic  Page 1 of 1
  [ 14 posts ] 
Print view Previous topic   Next topic  
Author Message
Search for:
Gnarl
PostPosted: Fri Apr 11, 2008 10:45 am 
Offline
Joined: Mon Feb 16, 2004 7:06 pm
Posts: 309
Location: Toronto
This was actually a lot easier then I thought it would be when I got the idea from watching Star Trek. I found this to work about 70%, but this could be just because I'm using a $5 computer mic. It works best when using simple words and speaking in a monotone voice.

There are 3 main components required.
1. sphinx-2 - speech recognition engine
2. perlbox - front end for configuring voice commands
3. festival - text to speech engine, not required but I use it for the system to tell me the time.

Other programs required are:
telnet - used to connect to mythfrontend and send commands to it
expect - a way to script those telnet commands
perl-tk - graphical library for perlbox's gui configuration
festvox-kallpc16k - a voice for festival

Installation

apt-get install expect festival festvox-kallpc16k telnet sphinx2-bin

wget http://prdownloads.sourceforge.net/perl ... noarch.deb or you can get it from http://perlbox.org. I recommend going there to read up on how it works.

You will also need to enable the telnet control in Myth through Setup > Setup > General > 3rd page > Enable network remote control

To begin you can start perlbox-voice and use the gui to play around. From here you can start the listener and add custom commands. To control myth I wrote a script to control a bunch of sub scripts by feeding an argument in to it. This way I only had to make a shortcut for on script in the path.

Configuration

My configuration is as follows:

/home/mythtv/.perlbox-voice/Listener.conf #This is my config for perlbox. it contains all the voice to command codes I use.
Code:
# Maintained by Config::Simple/3.7
# -----------------------------------


[path_section]
task=/home/mythtv/.perlbox-voice/commands
agent_bin=/usr/lib/perlbox-voice/PerlboxListener.pl
dict=/home/mythtv/.perlbox-voice/commands/current.dic
language_model=/home/mythtv/.perlbox-voice/commands/current.lm
hmm=/usr/share/sphinx2/model/hmm/6k
perlbox_lib=/usr/lib/perlbox-voice/Perlbox/
sent=/home/mythtv/.perlbox-voice/commands/current.sent
s2continuous=/usr/bin/sphinx2-continuous


[option_section]
magic=listen
verbosity_level=3
playsound=1
perlbox-voice-version=.09
use_magic=0
magic_interval=5
help_browser=mozilla
desktop_plugin=none


[command_section]
left=voice-control.sh left
remove=voice-control.sh delete
main menu=voice-control.sh mainmenu
exit=pkill mythfrontend
forward=voice-control.sh ff
save=voice-control.sh save
real time=voice-control.sh realtime
down=voice-control.sh down
unpause=voice-control.sh unpause
show=voice-control.sh recordings
video=voice-control.sh videos
night=say sleep well
paws=voice-control.sh pause
guide=voice-conrtol.sh livetvguide
console=xterm
stat=voice-control.sh status
enter=voice-control.sh select
morning=say and good morning to you
cancel=voice-control.sh cancel
display recordings=voice-control.sh recordings
time=voice-control.sh time
confirm delete=voice-control.sh confirmdelete
up=voice-control.sh up
terminal=xterm
start myth=mythfrontend
myth=mythfrontend
stop=voice-control.sh stop
right=voice-control.sh right
videos=voice-control.sh videos
skip=voice-control.sh skip
rewind=voicecontrol.sh rw
replay=voice-control.sh replay


Below are the scripts that I call to control myth


voice-control.sh ###This is the min script that is use to call the command for myth.
Code:
#!/bin/bash

#This script controls which expect scripts to run when the switch is given

SCRIPTHOME="/myth/backup/scripts/voice" ##Change this to your scripts dir

case $1 in
        start) perlbox-voice --nogui & >> /dev/null;;
        recordings) $SCRIPTHOME/voice-recordings.sh;;
        mainmenu) $SCRIPTHOME/voice-mainmenu.sh >> /dev/null;;
        down) $SCRIPTHOME/voice-down.sh >> /dev/null;;
        ff) $SCRIPTHOME/voice-ff.sh >> /dev/null;;
        left) $SCRIPTHOME/voice-left.sh >> /dev/null;;
        livetv) $SCRIPTHOME/voice-livetv.sh >> /dev/null;;
        livetvguide) $SCRIPTHOME/voice-livetvguide.sh >> /dev/null;;
        status) $SCRIPTHOME/voice-mythstatus.sh >> /dev/null;;
        pause) $SCRIPTHOME/voice-pause.sh >> /dev/null;;
        unpause) $SCRIPTHOME/voice-unpause.sh >> /dev/null;;
        right) $SCRIPTHOME/voice-right-.sh >> /dev/null;;
        rw) $SCRIPTHOME/voice-rw.sh >> /dev/null;;
        select) $SCRIPTHOME/voice-select.sh >> /dev/null;;
        realtime) $SCRIPTHOME/voice-speed-realtime.sh >> /dev/null;;
        stop) $SCRIPTHOME/voice-stop.sh >> /dev/null;;
        up) $SCRIPTHOME/voice-up.sh >> /dev/null;;
        videos) $SCRIPTHOME/voice-videos.sh >> /dev/null;;
        delete) $SCRIPTHOME/voice-delete.sh >> /dev/null;;
        confirmdelete) $SCRIPTHOME/voice-confirm-delete.sh >> /dev/null;;
        time) $SCRIPTHOME/voice-time.sh >> /dev/null;;
        skip) $SCRIPTHOME/voice-skip.sh >> /dev/null;;
        replay) $SCRIPTHOME/voice-replay.sh >> /dev/null;;
        save) $SCRIPTHOME/voice-save.sh >> /dev/null;;
        cancel) $SCRIPTHOME/voice-cancel.sh >> /dev/null;;
#       ) $SCRIPTHOME/voice-.sh >> /dev/null;;
#       ) $SCRIPTHOME/voice-.sh >> /dev/null;;
        help) echo "   Available arguments: start, recordings, mainmenu, down, ff, left, livetv...";;
        *) echo "  usage: voice-control.sh [arg]";;
esac


Below here are the sub-scripts.

voice-cancel.sh
Code:
#!/usr/bin/expect --
# Test expect script to telnet.

spawn telnet localhost 6546
expect "#"
send "key escape\r"
expect "OK"
send "exit\r"
# end of expect script.


voice-confirm-delete.sh
Code:
#!/usr/bin/expect --
# Test expect script to telnet.

spawn telnet localhost 6546
expect "#"
send "key d\r"
expect "OK"
send "key up\r"
expect "OK"
send "key enter\r"
expect "OK"
send "exit\r"
# end of expect script.


voice-delete.sh
Code:
#!/usr/bin/expect --
# Test expect script to telnet.

spawn telnet localhost 6546
expect "#"
send "key d\r"
expect "OK"
send "key up\r"
expect "OK"
send "exit\r"
# end of expect script.


voice-down.sh
Code:
#!/usr/bin/expect --
# Test expect script to telnet.

spawn telnet localhost 6546
expect "#"
send "key down\r"
expect "OK"
send "exit\r"
# end of expect script.


voice-ff.sh
Code:
#!/usr/bin/expect --
# Test expect script to telnet.

spawn telnet localhost 6546
expect "#"
send "play seek forward\r"
expect "OK"
send "exit\r"
# end of expect script.


voice-left.sh
Code:
#!/usr/bin/expect --
# Test expect script to telnet.

spawn telnet localhost 6546
expect "#"
send "key left\r"
expect "OK"
send "exit\r"
# end of expect script.


voice-livetv.sh
Code:
#!/usr/bin/expect --
# Test expect script to telnet.

spawn telnet localhost 6546
expect "#"
send "jump livetv\r"
expect "OK"
send "exit\r"
# end of expect script.


voice-livetvguide.sh
Code:
#!/usr/bin/expect --
# Test expect script to telnet.

spawn telnet localhost 6546
expect "#"
send "jump livetvguide\r"
expect "OK"
send "exit\r"
# end of expect script.


voice-mainmenu.sh
Code:
#!/usr/bin/expect --
# Test expect script to telnet.

spawn telnet localhost 6546
expect "#"
send "jump mainmenu\r"
expect "OK"
send "exit\r"
# end of expect script.


voice-mythstatus.sh
Code:
#!/usr/bin/expect --
# Test expect script to telnet.

spawn telnet localhost 6546
expect "#"
send "jump statusbox\r"
expect "OK"
send "exit\r"
# end of expect script.


voice-pause.sh
Code:
#!/usr/bin/expect --
# Test expect script to telnet.

spawn telnet localhost 6546
expect "#"
send "play speed pause\r"
expect "OK"
send "exit\r"
# end of expect script.


voice-recordings.sh
Code:
#!/usr/bin/expect --
# Test expect script to telnet.

spawn telnet localhost 6546
expect "#"
send "jump playbackrecordings\r"
expect "OK"
send "exit\r"
# end of expect script.


voice-replay.sh
Code:
#!/usr/bin/expect --
# Test expect script to telnet.

spawn telnet localhost 6546
expect "#"
send "key q\r"
expect "OK"
send "exit\r"
# end of expect script.


voice-right.sh
Code:
#!/usr/bin/expect --
# Test expect script to telnet.

spawn telnet localhost 6546
expect "#"
send "key right\r"
expect "OK"
send "exit\r"
# end of expect script.


voice-rw.sh
Code:
#!/usr/bin/expect --
# Test expect script to telnet.

spawn telnet localhost 6546
expect "#"
send "play seek backward\r"
expect "OK"
send "exit\r"
# end of expect script.


voice-save.sh
Code:
#!/usr/bin/expect --
# Test expect script to telnet.

spawn telnet localhost 6546
expect "#"
send "key escape\r"
expect "OK"
send "key enter\r"
expect "OK"
send "exit\r"
# end of expect script.


voice-select.sh
Code:
#!/usr/bin/expect --
# Test expect script to telnet.

spawn telnet localhost 6546
expect "#"
send "key enter\r"
expect "OK"
send "exit\r"
# end of expect script.


voice-skip.sh
Code:
#!/usr/bin/expect --
# Test expect script to telnet.

spawn telnet localhost 6546
expect "#"
send "key z\r"
expect "OK"
send "exit\r"
# end of expect script.


voice-speed-realtime.sh
Code:
#!/usr/bin/expect --
# Test expect script to telnet.

spawn telnet localhost 6546
expect "#"
send "play speed 1x\r"
expect "OK"
send "exit\r"
# end of expect script.


voice-stop.sh
Code:
#!/usr/bin/expect --
# Test expect script to telnet.

spawn telnet localhost 6546
expect "#"
send "play stop\r"
expect "OK"
send "exit\r"
# end of expect script.


voice-time.sh
Code:
#!/bin/bash

#echo "The time is $(date +%I" "%M" "%p)" > /tmp/currenttime
echo "The time is $(date +%H" "%M" "hours)" > /tmp/currenttime
festival --tts /tmp/currenttime
rm -f /tmp/currenttime



voice-unpause.sh
Code:
#!/usr/bin/expect --
# Test expect script to telnet.

spawn telnet localhost 6546
expect "#"
send "key p\r"
expect "OK"
send "exit\r"
# end of expect script.


voice-up.sh
Code:
#!/usr/bin/expect --
# Test expect script to telnet.

spawn telnet localhost 6546
expect "#"
send "key up\r"
expect "OK"
send "exit\r"
# end of expect script.


voice-videos.sh
Code:
#!/usr/bin/expect --
# Test expect script to telnet.

spawn telnet localhost 6546
expect "#"
send "jump mythvideo\r"
expect "OK"
send "exit\r"
# end of expect script.


Enjoy!

_________________
KnoppMyth Folding@home
How to setup F@H
F@H Stats Page


Last edited by Gnarl on Thu Apr 24, 2008 9:56 am, edited 2 times in total.
Top
 Profile  
 
cecil
 Post subject:
PostPosted: Sat Apr 12, 2008 6:10 pm 
Offline
Site Admin
Joined: Fri Sep 19, 2003 6:37 pm
Posts: 2659
Location: Whittier, Ca
:)
Top
 Profile  
 
RacerX
 Post subject:
PostPosted: Sat Apr 12, 2008 11:50 pm 
Offline
Joined: Sun Sep 05, 2004 7:06 pm
Posts: 690
Very interesting...thanks

:lol:
Top
 Profile  
 
thornsoft
 Post subject:
PostPosted: Sun Apr 13, 2008 1:00 pm 
Offline
Joined: Fri Nov 18, 2005 9:22 am
Posts: 777
Location: spencerport, ny (USA)
Seems like a cool idea, but is it practical? Isn't it a matter of time before you're watching a show and somebody (in the show) says something that deletes your shows or otherwise causes unintended behavior? There were concerns and jokes when Vista included voice navigation - someone made a proof-of-concept .mp3 that would do things to your PC.
Top
 Profile  
 
Gnarl
 Post subject:
PostPosted: Sun Apr 13, 2008 2:58 pm 
Offline
Joined: Mon Feb 16, 2004 7:06 pm
Posts: 309
Location: Toronto
thornsoft wrote:
Seems like a cool idea, but is it practical? Isn't it a matter of time before you're watching a show and somebody (in the show) says something that deletes your shows or otherwise causes unintended behavior?
I basically just did this for the cool factor and to see if i could. Pearlbox can be setup to use a key word that must be spoken to activate the listener before an action word and all major impact functions have a second prompt in the UI to confirm. To have it recognize the action I have to be about 8-10" away from the mic which I know doesn't make it practical at all, but that also depend on mic placement and quality.

_________________
KnoppMyth Folding@home
How to setup F@H
F@H Stats Page
Top
 Profile  
 
mjl
 Post subject:
PostPosted: Tue Apr 15, 2008 10:43 pm 
Offline
Joined: Sun Jun 12, 2005 10:55 pm
Posts: 3161
Location: Warwick, RI
Hi Gnarl,

For what it is worth, I like it also :) With a few tweaks to extend your features, I would suspect there are a few folks that would be able to enjoy a KM machine but can't currently because of a handycap.

sphinx-2-bin typo should be sphinx2-bin

Could you throw in some of the lower level stuff, like how to activate what is required to run to make it work from a boot? I have a friend who is totally blind and something like this could just be awesome for him!

Km is not just a "toaster", it rocks :)
Thanks
Mike
Top
 Profile  
 
Gnarl
 Post subject:
PostPosted: Tue Apr 22, 2008 12:39 pm 
Offline
Joined: Mon Feb 16, 2004 7:06 pm
Posts: 309
Location: Toronto
I fixed the above typo and here is a startup script that I altered from something else. Copy and past it into /etc/init.d/perlbox.
Code:
#! /bin/bash
#
# motion        Start the motion detection .
#

NAME=perlbox
PATH=/bin:/usr/bin:/sbin:/usr/sbin
DAEMON=/usr/bin/perlbox-voice
PIDFILE_1=/var/run/perlbox-voice.pid
LOGFILE="/var/log/perlbox_$(date +%Y%m)"

trap "" 1
export LANG=C
export PATH

test -f $DAEMON || exit 0


case "$1" in
  start)
    echo "Starting voice detection : $NAME"
    echo "-----------------------------------------------------------------------------------" >> $LOGFILE
    perlbox-voice --nogui >> $LOGFILE 2>&1 &
    sleep 5
    echo `ps axf | grep -v grep | grep pbox | head -n1 | awk '{print $1}'` > $PIDFILE_1
    ;;

  stop)
    echo "Stopping motion detection : $NAME"
    kill  $(cat $PIDFILE_1)
    kill  $(ps axf | grep -v grep | grep sphinx2-continuous | head -n1 | awk '{print $1}')
    rm -rf $PIDFILE_1 2> /dev/null
    ;;

  status)
    echo "Status motion detection : $NAME"
    if (test -f $PIDFILE_1); then
        echo -n "Running process for $NAME : "
        cat $PIDFILE_1
    else
        echo "Stopped"
    fi
    ;;

  *)
    echo "Usage: /etc/init.d/$NAME {start|stop|status}"
    exit 1
    ;;
esac

if [ $? == 0 ]; then
        echo .
        exit 0
else
        echo failed
        exit 1
fi
Make it executable with
Code:
chmod 755 /etc/init.d/perlbox

One thing I didn't mention before was that you will have to make the above scripts executable also with
Code:
chmod 755 <scriptname>
To add it to startup run
Code:
update-rc.d perlbox defaults 99

_________________
KnoppMyth Folding@home
How to setup F@H
F@H Stats Page


Last edited by Gnarl on Tue May 20, 2008 12:28 pm, edited 3 times in total.
Top
 Profile  
 
Gnarl
 Post subject:
PostPosted: Tue Apr 22, 2008 2:02 pm 
Offline
Joined: Mon Feb 16, 2004 7:06 pm
Posts: 309
Location: Toronto
Because the above startup script runs the application as root you will need to make a shortcut in roots folder to the config file for perlbox-voice
Code:
ln -s /home/mythtv/.perlbox-voice /root/

_________________
KnoppMyth Folding@home
How to setup F@H
F@H Stats Page
Top
 Profile  
 
tjc
 Post subject:
PostPosted: Tue Apr 22, 2008 5:21 pm 
Offline
Joined: Thu Mar 25, 2004 11:00 am
Posts: 9551
Location: Arlington, MA
Gnarl wrote:
Make it executable with
Code:
chmod 777 /etc/init.d/perlbox

One thing I didn't mention before was that you will have to make the above scripts executable also with
Code:
chmod 777

No, don't do that. Please use the appropriate permissions rather than the "'cleaning' the car windows by knocking them out with a sledgehammer" approach.
Code:
chmod 755 /etc/init.d/perlbox

Or better still use the symbolic form:
Code:
chmod u=rwx,go=rx /etc/init.d/perlbox

Every time I hear someone spreading this bit of evil misinformation it makes me want to knock them to the ground and tattoo the appropriate version of the command on the inside of their eyelids with glow in the dark ink. :evil:
Top
 Profile  
 
Gnarl
 Post subject:
PostPosted: Wed Apr 23, 2008 11:02 am 
Offline
Joined: Mon Feb 16, 2004 7:06 pm
Posts: 309
Location: Toronto
tjc wrote:
Every time I hear someone spreading this bit of evil misinformation it makes me want to knock them to the ground and tattoo the appropriate version of the command on the inside of their eyelids with glow in the dark ink. :evil:


Point taken... my eyelids are still in pain

_________________
KnoppMyth Folding@home
How to setup F@H
F@H Stats Page
Top
 Profile  
 
mjl
 Post subject:
PostPosted: Wed Apr 23, 2008 7:40 pm 
Offline
Joined: Sun Jun 12, 2005 10:55 pm
Posts: 3161
Location: Warwick, RI
Hi,

typo I think:
Code:
right) $SCRIPTHOME/voiceright-.sh >> /dev/null;;


voice-right

Mike
Top
 Profile  
 
Gnarl
 Post subject:
PostPosted: Thu Apr 24, 2008 9:56 am 
Offline
Joined: Mon Feb 16, 2004 7:06 pm
Posts: 309
Location: Toronto
mjl wrote:
Hi,

typo I think:
Code:
right) $SCRIPTHOME/voiceright-.sh >> /dev/null;;


voice-right

Mike
Fixed.

I should probably check my script also :D

_________________
KnoppMyth Folding@home
How to setup F@H
F@H Stats Page
Top
 Profile  
 
mjl
 Post subject:
PostPosted: Thu Apr 24, 2008 10:22 am 
Offline
Joined: Sun Jun 12, 2005 10:55 pm
Posts: 3161
Location: Warwick, RI
Hi Gnarl,

At least you know someone is at least looking at your scripts :)

Just for reference, it listens about as well as my kids with about the same responses,"I Don't Understand" get that one a lot, along with "You Didn't Tell Me...." :)

Thanks
Mike
Top
 Profile  
 
Gnarl
 Post subject:
PostPosted: Tue May 20, 2008 12:28 pm 
Offline
Joined: Mon Feb 16, 2004 7:06 pm
Posts: 309
Location: Toronto
Update startup script.

_________________
KnoppMyth Folding@home
How to setup F@H
F@H Stats Page
Top
 Profile  
 

Display posts from previous:  Sort by  
Post new topic Reply to topic  Page 1 of 1
  [ 14 posts ] 


Board index KnoppMyth General

All times are UTC - 6 hours




Who is online

Users browsing this forum: No registered users and 82 guests

You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Jump to:  
Powered by phpBB® Forum Software © phpBB Group

Theme Created By ceyhansuyu