Flawless, artificial intelligence at the service of dubbing

The start-up Flawless was born from the union of director Scott Mann and tech-savvy entrepreneur Nick Lynes. Flawless is ready to revolutionize the world and dubbing techniques by introducing artificial intelligence. The project was born from the need to adapt only the movement of the actors' lips to any language using the TrueSync software.

Flawless: How will dubbing transform?

At the basis of the idea of ​​the two founders is the TrueSync software . This technology allows the lips of the original actor to match those of the voice actor. The key factor of this project is the ability to focus and change only one element: the lips and their movement. Flawless allows, thanks to artificial intelligence, to obtain a perfect synchronism of the translation of the lines by creating new lip movements . Flawless's self-learning models create a three-dimensional interpretation, taking advantage of the geometry and geography of the image. Flawless also allows you to have a very high translation speed at reduced costs.

artificial intelligence and dubbing
artificial intelligence and dubbing

Artificial intelligence in dubbing how the idea of ​​Flawless was born

The idea of ​​the London start-up Flawless was born from the need to want an interpretation as natural and perfect as possible . The two founders Scott Mann and Nick Lynes want with this technology to eliminate the discrepancies and disharmonies between the lips that move with the original language and the words that come out instead in another. Director Scott Mann said he came up with the idea after seeing a dub of his movie Bus 657 :

I was devastated because it was enough to change a small word in a sentence to greatly change a character and the atmosphere of the story, and consequently the whole film.

Scott Mann

Flawless: the world of revolutionized dubbing
Flawless: the world of revolutionized dubbing

The two co-founders are very optimistic about the chances of their project's success. The optimism is linked to the huge demand and demand for dubbed content due to the exponential growth of services such as Netflix, Amazon Prime Video or Disney +. In fact, it is no coincidence that Amazon has picked up the same market demand and is trying to work on an automated dubbing system . Furthermore, Flawless could concern and influence the correction of the post-production phase of a dialogue part in the same language. But Flawless has not only positive aspects: there are also many perplexities about it. First of all, the director and the entrepreneur have to face those who compare their technology to deepfake , a technique that allows you to create fake videos in which a person says and does anything. This, however, is not the only problem. Some actors may disagree that their interpretation is being altered by artificial intelligence.

The evolution of dubbing in history

Originally, cinema had no text, music or audio. Only in 1929 the cinema as we know it today will be born, and silent cinema will see its end. This change, however, brought with it a problem: how to produce a film in one language and then broadcast it in another? The first solution was to use the technique of multiple versions, that is, to shoot the film several times and in several different languages. This very expensive technique was used only for a year, until 1930, the year in which dubbing was born. This phenomenon spread throughout Europe and in Italy it saw a particular growth. The success of dubbing in our country is to be associated with the historical period and the presence of the fascist regime in our territory. In fact, to keep the national language in force, Mussolini imposed a state law by which he prohibited the circulation of foreign films in a different language.

The article Flawless, artificial intelligence at the service of dubbing comes from Tech CuE | Close-up Engineering .