Assistive Technology Apps for the iPhone and iTouch: AAC and Speech to Text

I have been exploring apps for the iPhone for assistive technology. We are adding an iTouch to our equipment loan center to trial Proloquo2go Here is a blog article on it from the Autism site on Change.org.

I got word the other day that Nuance is coming out with Dragon Naturally Speaking for the iPhone. The app isn't up and ready yet, but will be soon. See the blog post on Crave from CNET for "Texting without Typing" for more information.

While I was looking, I went to the Nuance site for more information the Dragon iPhone application. I found a great video tutorial on using a voice recorder on the iPhone to add into Dragon and get it transcribed. The video site is called "Skill Casting" and you can see the video here. The teacher is such a fun and pleasant person! I was impressed.

I am probably way behind many of you in getting these tools out and used, but we are seeing the potential of using these handheld apps for our students in middle and high school that think they are too cool to drag around a speech generating device or use some of the mainstream software tools on a "special" computer just for them in the back of the room. Maybe you don't struggle with those issues, but I sure do! Maybe as technology grows, these handheld apps will be the answer for many. Now with the Google phones, Droid, etc. the apps are moving way past only the iPhone. We have to run to keep up...

All the best to you!

Lon

Bookmark this on Delicious

Questions About Using Dragon Naturally Speaking in the Special Education Setting

One of our readers sent me a question regarding Dragon Naturally Speaking. I thought it would be helpful to throw it out to everyone for comments and suggestions and asked for permission to post it. I have presented the question below and my answer after. I have had a lot of difficulty getting it to work with students and our discussion below explains why. If anyone has something to share on this or a fix you have found, please share a comment...

Question:
"Thank you for sharing all of your valuable information on your blog. I always learn something new and helpful when I visit your blog! I am trying Dragon Naturally Speaking with a young lady who has some significant physical disabilities and is struggling with using the mouse to access the computer. She speaks very softly- we have been working with her to "turn up her volume" which she is getting much better at. The Dragon also is having a difficult time recognizing her words correctly. For example she will say "The cat is black" and it will recognize "At it's plant be" or "The top is blue" is recognized as "Time is blue" and when she says "period" it recognizes it as "daily". We are using the headphone that came with the Dragon but after doing some research I saw that perhaps changing the headphone may make a difference?
We also are using Dragon 9.5 and maybe should upgrade to Dragon 10? I also read that the Dragon has difficulty recognizing speech of folks who have an accent- she doesn't have an accent per se, but maybe her word pronunciation is affecting the outcome?
Again, this is my first time using Dragon with a student and could use any advice/suggestions that you could think of. I have visited several sites that discuss using the Dragon, but still am feeling like I'm missing something or wonder if there might be another program that would work more efficiently for her?"

My answer:
"Dragon is a great program, but the limitations you are facing are common to my own experiences with it. The students I have worked with generally have poor pronunciation and volume when reading aloud. Shyness and lack of confidence can also be a factor. Mix in the issues of disabilities and, as you can see, it can be tricky to get this "miracle software" to work.
Here are some ideas:
1. Get a better quality microphone (as you suggested)
2. Go in and highlight the incorrect words and change them so that the computer learns that when the student says a word and consistently gets a different one, it will make the change automatically. This is done by selecting a misspelled/mis-interpreted word and correcting the word you want it to be from a word list, or typing it in yourself. If this can overcome the errors in interpretation, then you might be able to get it to work OK.
3. Sometimes a sound shield around the student stops ambient room noise from disrupting the ability for the software to hear the reader.

Our version in my AT closet is an older version and so I have not experienced the new versions - you are working with a newer one than we have. I use it a lot to write papers, etc. and have trouble too sometimes - I don't know of anything better. I know that the Mac has built in speech to text - it might work better. Because of the very issues you have brought up, I tend to steer teachers away from using Dragon unless the student has a good speaking voice - logistically, it just breeds frustration unless someone is OK with spending lots of time."

What have your experiences been using dragon?

All the best to you,
Lon



Bookmark this on Delicious