Vimeo unveils AI editing tool based on transcripts

Video platform Vimeo unveils a set of AI tools that allow users to edit videos based on transcripts. Users can also generate scripts for videos with a ChatGPT-like feature. Vimeo will release the AI ​​tools to paying users this summer.

To enable the feature, an AI model first creates a transcription of an uploaded video, after which the user has some options in the beta version. For example, the tool can automatically detect silences of a certain length and filler words and remove them from the video. The end result does contain jump cuts where small empty moments or words have been removed. Users can also select words and phrases in the transcription to remove or isolate those parts.

In addition to the assembly tool, customers can also use a teleprompter function. The text to be read can optionally be generated with Vimeo’s AI script generator. As with similar text-based AI models, users enter a short prompt. Based on this description, the tool creates a script. According to TechCrunch Vimeo uses OpenAI’s ChatGPT technology, although the video company has not confirmed this as far as is known.

Anyone can currently test the editing function on the Vimeo website. The AI ​​tools should be released in July for customers with a Standard or Pro subscription, writes the company. In practice, the function costs at least fifteen euros per month based on an annual subscription to Vimeo Standard.

The left box shows the transcript of the video, with the available AI editing functions above it. The various cut parts can be seen in the bar below the video. Individual clips can ultimately be exported or the video can be used as a whole.