Watch as I stand on a street corner near my apartment “looking” around with the iPhone’s camera while chatting about what I’m hearing around me. Sighted readers, does this work at all for you? What feedback could you give to help me improve my videography skills?
Parker Waddington and Randy Rusnak from Accessible Devices and VIP Conduit hold a conversation demonstrating the HeyTel iPhone walkie-talkie application. Described by its developer as “instant voice messaging,” HeyTel operates similar to amateur radio, citizens’ band (CB) radio and the push-to-talk cellular services offered by companies like NexTel.
Enjoy this approximately 36-minute sound-seeing adventure as I get off the bus, check into the bus stop using Foursquare, cross two streets, walk to a shopping center and combine use of the A+ Voice Compass iPhone app with a bit of sighted assistance to locate Supercuts for a long-needed hair cut. It is just one example of the responsible combination of traditional orientation and mobility skills and technology to achieve successful results while traveling as a blind person.
Kevin Chao demonstrates oMoby, a visual-search application for the iPhone that enables users to take pictures of objects and identify them quickly.
Originally intended for use by sighted people as a shopping tool for locating similar products and making price comparisons, visual-search tools like oMoby and Noogle Noggles are helping blind people independently count their cash, identify their groceries and hear visual descriptions of many other objects.
Kevin Chao demonstrates Digit-Eyes, an iPhone app that scans the barcodes found on commercial products and enables the creation and use of audio or text labels that can be easily attached to items found in the home, on the job or at school.
Digit-Eyes relies on the iPhone’s camera to scan barcodes. Correct positioning of the iPhone is critical for the successful use of Digit-Eyes, Noogle Noggles, oMoby or any other app that uses the camera. There is a learning curve for most blind people who wish to use these apps, but employing a systematic approach and staying patient can really pay off in the long run.
Follow these steps to start scanning with Digit-Eyes:
- Find and double tap the Digit-Eyes icon on the Home screen.
- Flick to the right to locate the Scan button and double tap it to get the party started.
- Digit-Eyes immediately begins scanning and a ticking sound is heard to let you know it is working.
- While Digit-Eyes is scanning, position the iPhone so that it is lined up with the product being scanned and follow our camera-handling tips for best results.
- You will hear a beep and VoiceOver will speak the name of the identified item when the scan has completed successfully.
- If you are unable to complete the scan after several minutes, flick to the right to find the Cancel button and double tap it so you may try again later.
We thank Nancy Miracle, president of Digital Miracles, the company that develops and sells Digit-Eyes, for providing some quick tips for successfully using the iPhone’s camera:
- Make sure the screen curtain is not enabled. Digit-Eyes can’t see anything when the iPhone’s display is blank. Triple tap using three fingers to toggle the screen curtain on and off.
- Make sure there is light for the camera to acquire a good image. If you are indoors, it may be necessary to turn on a light.
- Place a finger immediately to the right of the camera, which is located in the upper-righthand corner of the iPhone when it is facing away from you. This will help you line it up with the item to be scanned.
- Place the iPhone approximately two inches above the object and gradually move it upward. The recommended approximate distance varies according to the device being used. Place the iPhone 3 G S approximately six inches away from the object being scanned. The iPhone 4 should be placed between six and 12 inches away. The new iPod Touch should be placed 12 to 20 inches distant.
- Never move the iPhone from side to side while scanning. The camera’s automatic focusing technology apparently can’t capture a good image under these conditions.
- Gradually turn round objects like bottles, cans and jars clockwise or counterclockwise in increments of 60 degrees while scanning. Simply scan the four sides of rectangular and square objects. In most, but not all, cases, the barcode will be found on the front or back of a box.
- The barcodes on many grocery and other products typically found in stores may be located in unexpected places. For example, the barcode may be located on the bottom of a box of breakfast cereal. It may be helpful to think about the way a product might be positioned on the conveyor belt in the grocery store during the check-out process to determine where to look for its barcode.
- Keep in mind that the camera in the iPhone does not work like the ID Mate or other products based on laser barcode scanners. Using products like Digit-Eyes is going to require a great deal of patience and practice in the beginning while you learn effective techniques for estimating the correct distance between the iPhone and the item being scanned and lining the iPhone up with the product so that a clear picture can be taken.
- The Digit-Eyes website contains exhaustive information and tutorials covering the effective use of the product. It even gives you the ability to print practice sheets of barcodes you can scan with your iPhone.
- Nancy and I discussed Digit-Eyes and the iPhone’s camera in depth in a two-part interview broadcast on the July 24 and July 31 episodes of ACB Radio’s Main Menu technology show.
Have you found a technique for using the camera that works well for you? Do you have an interesting story to tell about how Digit-Eyes and other camera-based iPhone apps have helped increase your independence? If so, please share it with us in the comments.
Noogle Noggles enables the user to take a picture of an object, quickly identify it and get more information about it straight from Google. It is being used by blind people to identify books, cards, groceries, household items, money and many other types of objects.
Kevin Chao demonstrates the Siri virtual assistant app for the iPhone. Simply open Siri, press the speech button, ask your phone for help with something and this app will get the requested information for you.
If you are not wearing earbuds, headphones or a Bluetooth headset while using Siri, follow these steps to make sure VoiceOver does not interfere:
- Flick to the “speech” button or touch it near the lower-righthand corner of the screen.
- Double tap with three fingers to mute the speech from VoiceOver.
- Double tap to hear the beep indicating you may start talking.
- Ask your question and wait for the beep indicating Siri has stopped listening.
- Double tap with three fingers to unmute and resume speech from VoiceOver.
- Flick around the screen to locate the information that answers your question.
Apple has owned this app for at least six months. While Siri is reasonably accessible now, it does contain poorly-labeled buttons, VoiceOver easily interferes with the user’s ability to dictate questions and there is a general lack of Apple’s typically thoughtful accessible design considerations in the user interface for this app. We hope that, as Apple updates and possibly integrates Siri’s technology into iOS, the company will add the finishing touches to its accessibility along the way.
Kevin Chao demonstrates a special VoiceOver practice mode that helps new users learn the gestures needed to effectively access Apple’s touch-screen devices.
Audio from this recording will be used as part of a short VoiceOver promo that will go out to the mainstream technology industry demonstrating the capabilities of blind people using accessible touch screens thanks to the built-in accessibility support included in Apple products.
I demonstrated Sendero’s brand-new LookAround GPS application for the iPhone on Jeff Bishop’s Sept. 17 Desert Skies show. It was also heard on ACB Radio’s Main Menu program. I thought it would be nice to share this sound-seeing demo with those of you who may have missed the previous listening opportunities.
Since the recording of this demonstration, Sendero has submitted version 1.1 of LookAround to Apple for approval and posting on the iTunes Store. This update may have fixed some of the concerns that came up in this recording. Stay tuned to Sendero’s LookAround page for the latest information on this app as it becomes available.