Voice Watch: Revolutionizing Spectator Sports With AI-Powered Commentary

Dentsu

The world of sports has traditionally been dominated by visual experiences. However, with the advent of cutting-edge technology, we are witnessing a paradigm shift. Voice Watch, an innovative AI-powered system, is breaking down barriers and making live sports more accessible to visually impaired individuals.

How Does Voice Watch Work?

At the heart of Voice Watch lies a sophisticated AI system that combines:

  • Object Recognition: This technology tracks the movements of athletes and equipment on the field, providing a real-time visual representation of the action.
  • Data Analysis: By analyzing vast amounts of data, including player positions, scores, and game statistics, Voice Watch can provide insightful commentary and predictions.
  • Natural Language Processing: This AI component enables the system to generate human-like commentary, describing the action in a clear and engaging manner.
The Voice Watch system screen

More Than Just Commentary

Voice Watch goes beyond simply describing the action. It can also provide context, analysis, and predictions, offering a comprehensive and immersive experience for visually impaired fans. For example, during a football match, Voice Watch might provide commentary like:

  • "Player number 10 has the ball and is making a run towards the goal. The defense is closing in. Will they be able to intercept the pass?"
  • "The home team is leading by two goals. The away team needs to score quickly to stay in the game."
  • "The referee has just awarded a penalty kick to the visiting team. This could be a turning point in the match."
AI commentary was generated for a Super Taikyu race, Japan’s biggest endurance motorsport race

Expanding Accessibility

The potential applications of Voice Watch extend far beyond traditional sports. It can be adapted to provide commentary for a wide range of events, including:

  • Para-sports: Ensuring that athletes with disabilities can enjoy and participate in sporting events on an equal footing.
  • Youth sports: Providing commentary for local and community-based sporting events, allowing parents and spectators to follow the action even if they cannot be physically present.
  • Historical sporting events: Offering commentary on classic matches or games, providing a unique way to relive sporting history.
AI commentary was generated for a 50-meter running race at an elementary school’s sports day

A Brighter Future for Sports

Voice Watch represents a significant step forward in making sports more inclusive and accessible for all. As AI technology continues to advance, we can expect to see even more innovative solutions that break down barriers and create a more equitable sporting landscape.

This article was originally published in Japanese on Dentsu Ho, dentsu's brand media in Japan. To read the full version of the article including the interview with Kazuhiro Shimura, Creative Director at Dentsu Inc. who led the project to develop the AI-based live commentary, head here.