Will Apple's iTV feature voice recognition and a speaking program guide?
27th Jun 2012 | 14:36
Talking TVs could change the way we interact with our electronics
Voice recognition and talking TVs
Your iPhone might be busily talking away to you and soon almost all gadgets will be able to understand some spoken instructions, but will the rumoured Apple iTV talk back to you?
Panasonic and British technology company TVonics have developed products that can physically talk, and which could change the way we all interact with our electronics.
The 'talking TVs' from Panasonic and TVonics' DTR-HD500 Freeview HD set-top box go against the trend somewhat.
New TVs from both Samsung and LG are equipped with voice recognition technology that takes spoken commands in place of those from a remote control. On Samsung's ES8000 Series of LED TVs it's impressive stuff.
Completely revolutionising the long criticised web browser experience on a TV, simple search terms can be barked at the Samsung TV as well as navigation controls and set phrases to operate other functions.
It's even subtler than it sounds, with a second mic buried in a remote control so that instructions don't need to be yelled. The gesture control system, meanwhile, is less successful.
You've probably had a go at voice control on the Xbox 360's Kinect, too, but Panasonic's 'talking televisions' - in essence its entire 2012 output - are more interesting in that they're all about explanation.
Audio Description services, which describe what's happening onscreen for blind and partially sighted people, were pioneered by Panasonic, but this is another step forward.
Developed in conjunction with the Royal National Institute of Blind People (RNIB) in the UK, this 'Voice Guidance' software attempts to solve a major accessibility problem in the digital TV age: how to browse complex TV schedules and set recordings.
It works by announcing onscreen information using synthetic speech and provides clear instructions on how to navigate the TV menu. During our test we found it incredibly straightforward: after you've engaged Voice Guidance in the Sound menus, and chosen the volume, user level (beginner or expert - the former using very comprehensive explanations) and speed, the TV suddenly becomes exceptionally user-friendly.
Change the Freeview channel and a woman's voice announces 'DVB, ITV1, The Jeremy Kyle Show, 09:25- 10:30, subtitles', with each channel change, while there is full guidance for all other aspects of the EPG (searching, changing to Freesat or analogue channels, selecting by genre), changing inputs, and volume.
Leen Petre, principal manager, Media and Culture at RNIB says that the TVs have been very well received by blind and partially sighted people. "People I've spoken to are those that generally struggle with technology, and what they like is that it's all-in-one. Having separate boxes and having to know whether you're on HDMI 1 or HDMI 4 - people haven't got to worry about that," she says, adding that she hopes the other big TV companies will soon follow Panasonic's example.
Accessibility for all?
Is this new tech purely for those with sight difficulties? Not at all, says Mark Vasey, senior manager at the Panasonic IPTV & DTV Solution Centre in the UK.
"Initially our intention was to implement the functionality for blind and partially sighted users, allowing them to access the TV and discover and select content in the same way a fully sighted user could," he says.
"However, we also believe text-to-speech is extremely useful for non-technical users, who are not so familiar with more complex TV functionality - such as the EPG and management of recordings. We believe that the spoken instructions for navigation and operation will be very beneficial to these users in understanding how the features work and what they offer."
Petre agrees: "There are so many different options and menus on modern TVs and this technology is good for people - not just blind and partially sighted people - that aren't familiar with using a menu-driven interface, which can be bewildering. Put it in Beginner mode and the Panasonic TV doesn't just tell you what's on your screen, but what to do next."
Voice guidance vs voice activation
Panasonic clearly believes that blind and partially sighted users should have the same access to our TVs as sighted users without paying an additional premium. However, the technology it's come up with will help a lot of users get to grips with the digital and smart TV functions.
"It's a natural next step to consider how text-to-speech and voice activation could be combined to provide a significant step forward in the overall user experience of what are becoming increasingly complex products," says Vasey, adding that its work with the RNIB highlighted the need to consider how to improve navigation of its TVs in general, and not just for blind or partially sighted users.
"Anything that reliably introduces more interactivity more directly, and takes away the need to navigate menus or use a whole series of buttons on remote controls, is going to be beneficial for blind and partially sighted people, but only if it's combined with voice output of what appears on the screen," says Petre, who's cautious about embracing a technology that hasn't so far been thought through in terms of accessibility for all.
"Some people seem to think that the next big thing is voice control, and that we won't need voice guidance, but it's only a substitute for pressing buttons - it still doesn't allow you to know what appears on your screen. We need a combination of the two, but voice activation has massive potential and the RNIB would be very keen to explore how the two technologies can be combined."
Petre adds that much of the innovation around remote controls has accessibility limitations, and that both wand-style remotes and those with touchscreens actually make things more difficult for blind and partially sighted people.
Text to speech in set-top boxes
Although Panasonic is the first TV manufacturer to offer a talking - as opposed to a listening - feature, it's not the only company hitting back with chat.
From this month all new products from British set-top box maker TVonics have special text-to-speech software called IVONA installed, while those with existing DTR-HD500 or DTR-Z500HD set-top boxes can download the software for free from the RNIB and TVonics websites.
We tested a re-vamped DTR-HD500 and found the voice guidance system - which is based on IVONA software - exceptionally easy to use. Forget about the sight issue; this tech is ideal for anyone in the least bit nervous about the digital age.
The voice is less robotic than on the Panasonic TV, though functionality is similar. While tuning-in DVB channels we're regularly informed of the progress (for example, '45%, 24 channels found'), and when we engage the EPG we're talked through choosing channels in an impressively smooth manner. The wording is almost identical to the Panasonic - programme title, channel, timings etc - but the TVonics also tells you what's on next.
Press the pause button and the voice pipes-up, 'paused at three seconds behind live TV' before saying 'playing from 23 seconds behind live TV' upon un-pausing.
Recording is easy, too, and not just single programmes - series links are also simply explained. What we liked best is that the box tells you exactly what it's doing at all times, right down to 'preparing timer' to 'now recording' for the exact second it's started recording.
That's useful tech for all users. The TVonics box is slightly different since all menus are explained, for example uttering 'Six options. First, General Settings. Press OK to access' when faced with a list of options.
"The RNIB did a lot of work to get the IVONA software to a high standard, and also worked with TVonics," says Petre. "The main difference between the two is that with TVonics there has been a small investment from the RNIB."
It may lack the all-in-one experience boasted by the Panasonic, but the actual voice guidance system TVonics is more polished and comprehensive.
Siri at your service
In terms of accessibility, Apple has history. "The iPhone and iPad have voice output, so Apple seems to consider it a standard feature," says Petre, who also praises the iPhone for its zoom function, which has enabled blind and partially sighted people to use a normal phone.
"An Apple TV could be accessible, but if it's more about downloading films and on-demand TV it's in a different category of product than a TV you use all the time."
If it does chat, guide and advice, Apple's hotly tipped TVs will presumably answer back in Siri's typically sarcastic-cum-apologetic manner. Expect 'Record Match of the Day' to soon be met with, 'Sorry, I don't understand. Your team has just been relegated. Football League Show will record instead.'