YouTube Icon

Lightspeed-Backed Enables Businesses To Generate Videos On The Fly With AI/ML

Lightspeed-Backed Enables Businesses To Generate Videos On The Fly With AI/ML

Bengaluru-based totally startup Rephrase.Ai is trying to assist corporations create customized content via system-generated videos

Besides advertising videos, Rephrase is being used to create edtech publications, video chatbots and A/B testing

Founded in March 2018, the synthetic media startup is seeking to installation technology to music all films generated thru the platform to dam piracy

Every couple of months you could count on a collage of plain-searching photos of human faces using up chatter on social media with the headline asking you to guess which amongst them are actual human beings and which might be generated by AI.

The approach which lets in computer engineers to create these styles of lifelike faces turned into invented in 2014 by means of Ian J Goodfellow, an AI researcher who at that factor used to paintings at Google Brain and now's the director of machine mastering at Apple. 

Also Read:- How to spy Facebook and Snapchat messages through OgyMogy

Goodfellow’s seminal paper showed how Generative Adversarial Networks or GaNs can hire  AI fashions to play a game of cat and mouse — with one trying to create an photo and the other looking to discover a true one from the laptop generated one — to iteratively make AI-generated media greater life like.

Building on this technique, Bengaluru-based startup Rephrase.Ai is trying to assist organizations create personalized marketing motion pictures via a SaaS dashboard. Rephrase’s tech uses pre-recorded audio and video clips of fashions to create multimedia based at the user options.

The synthetic media startup became founded in March 2018 by Ashray Malhotra, Nisheeth Lahoti and Shivam Mangla. This is the second entrepreneurial challenge of Malhotra and Lahoti, the primary become SoundRex, a startup that labored on lowering latencies in audio transmission using gadget gaining knowledge of algorithms. Mangla was a software engineer at Facebook’s Menlo Park headquarters before founding Rephrase together with his IIT Bombay batchmates.

“Nisheeth mentioned to me that he desired to build an engine which can take textual content as input and create a Hollywood level film as output in order that we will simply take a script and create a film without ever taking pictures some thing,” said Ashray Malhotra, who's additionally the CEO of Rephrase.Ai. 

While this is an ambition far out inside the destiny while the technology advances sufficient, the startup’s decided to consciousness on the short-time period monetisable intention of automating the advent of films for organizations where just a front-facing version speaks into a digital camera.

Lightspeed-Backed Rephrase.Ai Enables Businesses To Generate Videos On The Fly With AI/ML

A SaaS Dashboard Meets Video Automation 

Rephrase.Ai’s tech is constructed round present pictures where models for 10 minutes talk directly to a digital camera. This enables map facial expressions and lip moves to the speech — at 30 frames in keeping with second, this creates a database of 18,000 frames for each version. The startup’s ML algorithms primarily based on GaNs, created with the aid of a team of six deep getting to know engineers, use predictive analytics to overlay any audio record on any video within the database to generate a real looking video.

This way that a person can just choose any version on the SaaS dashboard and type the text which the character will then speak. On pinnacle of this base of AI-generated video, a consumer can also choose costumes, custom backgrounds, caption placements, and pick out audio from a menu of forty languages.    

“In fashionable instances, what you'll must do is first behavior version auditions, then get a cinematographer, lease a studio, shoot and then do put up manufacturing shoot enhancing. We removed all of those duties and made the whole manner only a few mins long,” said Malhotra.

Currently, the convenience of video advent that Rephrase.Ai offers has been followed for four  use instances — the primary characteristic of advertising films in which clients can send out personalized advertising motion pictures to potential clients, introduction of edtech video courses, changing text chatbots into video chatbots and A/B trying out of advertising films.

Malhotra said that Rephrase.Ai has created a video direction on edtech platform Udemy to exhibit what it does in the region. “Creating video content is a big price for an edtech agency which limits the scalability of the process. We can create hours of video content material in only a depend of a few minutes with a easy input which could assist edtech companies scale certainly well,” he claimed.

In digital marketing, budgets are frequently small and companies don’t have enough time and assets to test out extraordinary variations of an ad campaign. This is in which Rephrase.Ai found a problem it is able to restore. “We help businesses create multiple variations of the same video at a very reasonable fee and very, in no time. And they're then capable of run all of these one-of-a-kind videos on social media and notice what works best for them,” stated the founder.

While pooling in sales from those use-instances, the agency plans to in addition increase its AI algorithms to progressively add greater versions together with multiple emotions, hand gestures, head movements, exclusive digicam angles and dramatically specific backgrounds. 


“With every of those small tech jumps, you’re going to see us get a step toward the digital film concept,” Malhotra stated.

Facing Competition In Two Markets

Since Rephrase.Ai has its eyes specially on the advertising and marketing content material use-case, it has to contend with competition from hooked up players such as Vidyard, Loom, Wochit, Animoto and Wibbitz, amongst others. Though those structures too automate video advent at scale with more than one versions including textual content, history tracks, visual templates and so on, they can’t be used to generate movies of human fashions the usage of AI. 

On the artificial media front, a London-primarily based startup Synthesia, founded in 2017, gives the equal set of functions as Rephrase.Ai. Moreover, it also boasts of a funding kitty of over $four Mn and a stellar listing of customers consisting of Reuters, WPP, McCann, BBC and Accenture. In assessment, the Bengaluru-based totally startup has raised $1.Five Mn in seed funding led via Lightspeed Ventures and AV8 Ventures — and has but to expose any important customers.

However, generative AI startups are nonetheless in the early stages and most of these provide text, voice or animation-primarily based answers. While GPT-three is the fine instance of the textual content producing AI, voice synthesis is some thing that corporations like IBM, Google, Amazon and Apple have mastered over time with their text to speech engines. 

Using AI to create human-like characters is typically performed through growing a three-D man or woman and projecting movements of frame parts on it, which leads to the uncanny valley trouble wherein the fashions appearance very close to actual people and yet there’s a distinction which could make human beings experience uneasy. 

The way this trouble is dealt with is VFX in which multiple digicam angles are shot of a version after which the pictures is reconciled with the animated character which turns out to be an high priced affair. “Now in preference to some thing which used to price one hundred thousand dollars, and require dedicated VFX artists, we’re able to make it low-cost for normal use instances throughout a group of other one-of-a-kind industries and across a bunch of various sized organizations,” stated Malhotra. 

Dealing With The Danger Of Fake Videos

Every agency that creates media using AI is faced with the problem of deep fakes — content that can be real to the point of deceptive the audience into believing in its authenticity. According to a Georgetown University report, the Russian disinformation ploy in the 2016 US presidential election will be a template for each foreign governments and non-state actors to apply AI/ML deepfakes that destabilise countries.

Since the commonplace definition of deepfakes is restrained to swapping facial expressions, body movements or talk between  characters, Rephrase.Ai technology doesn’t technically fall below the deepfake category.

But what’s to forestall a user from manipulating hundreds of hours of digital camera dealing with photos and audio tracks of political leaders to create a faux video? Malhotra stated that the startup doesn’t allow any political content to be created on its platform and organizations are made to sign an settlement to now not use it for any ulterior motives.

Besides, all requests for video creation are monitored by way of the business enterprise as of now and because the range of videos produced at the platform scales up, Rephrase.Ai would set up generation to music all of the content generated. Moreover, even though organizations are allowed to onboard pictures in their personal sales representatives to the platform, every of these are vetted by using the startup.

“As founders we left our earlier jobs because we see that there’s a massive sufficient industrial value for proper makes use of of this generation. And that’s where we want to build the organisation,” stated Malhotra.

Author Biography.

Editorial Team
Editorial Team

Content Writer

Join Our Newsletter.

Subscribe to CrowdforThink newsletter to get daily update directly deliver into your inbox.

CrowdforGeeks is where lifelong learners come to learn the skills they need, to land the jobs they want, to build the lives they deserve.


CrowdforThink is a leading Indian media and information platform, known for its end-to-end coverage of the Indian startup ecosystem.


Our mission is "Har Koi Dekhe Video, Har Ghar Dekhe Video, Ghar Ghar Dekhe Video" so we Provide videos related to Tutorials, Travel, Technology, Wedding, Cooking, Dance, Festivals, Celebration.

Apna Video Wala

News & Blogs


How Baby Amore Is Bringing Organic, Eco-Friendl...

Founded in 2019, Baby Amore was born out of the need to deliver top class baby care products with...


How Simpl’s BNPL Strategy Is Enabling Higher Co...

The buy-now-pay-later segment has been witnessing an extended increase as new gamers like Amazon,...


How Meghalaya-Based D2C Startup Zizira Is Spici...

D2C emblem Zizira is bringing Meghalayan spices and herbs like Lakadong turmeric and valerian tea...

Top Authors

Lamia Rochdi is the Marketing Manager at Bell Flavors & Fragrances EMEA. A successful family-...

Lamia Rochdi

I’m Mertin Wilson a technician in a camera company and certified expert of different P...

Mertin Wilson

Zakariya has recently joined the PakWheels team as a Content Marketing Executive, shortly after g...

Zakariya Usman

Pankaj Singh is a Senior Digital Marketing Consultant with more than 2 years of experience in SEO...

Pankaj Singh

Our Client Says

WhatsApp Chat with Our Support Team