Advertise on Bizcommunity

Subscribe to industry newsletters

Human-driven transcription services appear best equipped with 99% accuracy rate

The BBC's subtitling department has suffered yet another Not Safe For Work (NSFW) subtitling gaffe when automated subtitles mistook 'six' for 'sex' during the BBC's popular Saturday night Strictly Come Dancing entertainment show. This proves that human-driven transcription services appear best equipped to help the corporation due to their 99% accuracy rate over AI-powered solutions.
© Antonio Guillem via 123RF.com.

The BBC’s run of errors started in February this year when its live subtitling service mistakenly produced a subtitle reading “Nigel Owens is a gay”, when it should have been “Nigel Owens is saying penalty and yellow card” in reference to the Welsh international referee awarding Scotland a penalty during a Scotland v England rugby match.

Another NSFW subtitle gaffe happened during the recent royal wedding in which automated subtitles read “beautiful breasts” instead of “beautiful dress.”

Human ear is better adapted


The BBC claims that the errors in the subtitles do not lie with its automated speech recognition (ASR) subtitling service, which it claims “produces accuracy levels in excess of 98%” - yet a survey from the World Economic Forum shows that whilst AI has a word accuracy rate of 95%, it will not yet be fully able to substitute human translation or transcription services.

In recent years, there have undoubtedly been major strides made in terms of AI transcription with AI-driven transcription services producing error rates of just 5.9%. However, language experts believe that the human ear is better adapted to recognising a broader vocabulary, different accents, and interlocked speech.

One of the biggest reasons for inaccuracies in ASR-driven subtitles is the narrow set of simple, short, command-based vocabularies surrounding interactions with bots, who rely on a dictionary-based vocabulary. As a result, they are generally unable to recognise slang-terms, colloquialisms, and interlocked speech.

Human-powered transcriptions still prefered


“The inaccuracies seen in the BBC’s ASR-driven subtitles are understandable,” explained transcription service provider GoTranscript CEO, Peter Trebek. “Although AI-driven tools are able to complement features such as ASR-driven subtitles, they are not yet able to recognise interlocked speech as found in sporting and social events, and neither are they yet able to recognise colloquial language or varied accents. This is why for the immediate future, the human ear will still serve as the standard bearer in terms of transcription and translation services.”

AI-powered transcription certainly has its perks when it comes to speed, which is likely the main reason it is used for live event transcriptions. However, human-powered transcriptions are still the prefered choice for those looking to avoid awkward mistakes.
Get a daily news update via WhatsApp or sign up to our newsletters.
Comment
Thomas Carter
Take Note has been investigating and working on a hybrid transcription process which combines both human and AI transcription. However, the results still show that AI transcription is currently only reliable for clear audio with 1-2 speakers, and still requires extensive proofreading to make it perfect.Take Note offers bespoke Transcription Services worldwide via our Secure Online Portal; from brief, concise Summaries to Verbatim legal documents, and YouTube video Captions in between. For an instant quote, or simply some advice on Timestamped Transcripts or video SEO, just go to our secure portal. https://takenotetyping.com
Posted on 26 Oct 2018 15:32

Related

News