Googles Lookout can now detect paper currency and read document text aloud

By keeping their smartphone pointed forward with the rear camera unobscured, users can leverage Lookout to detect and identify items in a scene.

Tasks folks take for granted can be a challenge for the estimated 2.2 billion people around the world with visual impairments, who might not notice a maintenance flyer pinned to their buildings window or could struggle to pick out ingredients in an unfamiliar kitchen.

Google accessibility engineering product managers like Patrick Clary worked with low-vision testers to ensure Lookout can, for example, spot packages delivered to a storage room; a couch, table, and dishwasher in a condominium; and elevators and stairwells in highrise buildings. The Lookout team also programmed in cues to indicate the location of objects in relation to users, like chair 3 oclock to warn of an obstacle to the immediate right.

Users can swipe between modes and optionally use a screen reader, such as Googles own TalkBack, to identify the option theyve selected. Lookout also now gives auditory hints like try rotating the product to the other side when it cant spot a barcode, label, or ad off the bat.

As its name implies, it reads snippets of text from things like envelopes and coupons aloud, even in reverse orientation.

A document-reading mode captures lengthier text and lets users read at their own pace, use a screen-reading app, or manually copy and paste the text into a third-party app.

Original article
Author: Kyle Wiggers

Kyle Wiggers writes about artificial intelligence for VentureBeat and lives in New York City. He stands behind VentureBeat’s ethics statement. This is a complete list of VentureBeat articles written by Kyle Wiggers, in reverse chronological order.

Kyle Wiggers has recently written 3 articles on similar topics including :
  1. "Google announced that it has acquired no-code app development platform AppSheet for an undisclosed sum. The team will join Google Cloud". (January 21, 2020)
  2. "Ahead of the 2020 Consumer Electronics Show, Google took the wraps off of new hardware in its growing Coral device family". (January 3, 2020)
  3. "Google Duplex, Google's AI voice reservation system, has seemingly expanded beyond the U.S. to the U.K., Australia, and Canada ". (April 13, 2020)
Posted on  ,