Google AI introduces URL2Video for automatic creation of videos from webpage


Image source: https://ai.googleblog.com/2020/10/experimenting-with-automatic-video.html

Google introduces URL2Video, a prototype search pipeline that automatically converts a web page into a short video.

Brief Introduction to Automatically Creating Videos from Web Page

URL2Video is an AI-based tool that only requires the website URL to perform the task, given the time and visual constraints of the content owner. It extracts quality documents such as texts, images or videos and design styles including fonts, colors and layouts from HTML, CSS, DOM information and organizes the resources into one relevant shot sequence, which looks like the website. It then converts them to a video with user-specified aspect ratio and duration to create meaningful video.

https://ai.googleblog.com/2020/10/experimenting-with-automatic-video.html

Fig: By extracting the structural content and design of the input web page, URL2Video makes automatic editing decisions to present the key messages in a video. It takes into account the time (for example, duration in seconds) and spatial (for example, aspect ratio) constraints of the output video defined by users.

Below is an example of a one page conversion that integrates several short video clips into a 12 second output video. It shows how the pipeline makes automatic editing decisions like choosing font, color, timing, order of content, etc.

https://ai.googleblog.com/2020/10/experimenting-with-automatic-video.html

Fig: URL2Video identifies the key content of our Google search intro page (top), including titles and video elements. It converts them to video taking into account presentation flow, source design, and output constraints (a 12-second landscape video; at the bottom).

Source: https://ai.googleblog.com/2020/10/experimenting-with-automatic-video.html

Paper: https://research.google/pubs/pub49618/

Video:


Comments are closed.