OpenAI may be dialing back its efforts in the video generation market with the shutdown of its Sora app, but ByteDance on Thursday confirmed that its new audio and video model, Dreamina Seedance 2.0, is now rolling out in its editing platform, CapCut.
ByteDance states the model allows creators to draft, edit, and sync video and audio content by utilizing prompts, images, or reference videos.
The phased rollout will launch with CapCut applyrs in Brazil, Indonesia, Malaysia, Mexico, the Philippines, Thailand, and Vietnam, with more markets added over time.
The news of the launch in CapCut follows a recent report that stated the model’s global rollout would be paapplyd, while it worked to address ininformectual property issues that drew criticism from Hollywood over alleged copyright infringement. That likely explains the limited number of markets where the model is currently available within CapCut.
In China, the model is available to applyrs of ByteDance’s Jianying app.
The video generation model works without reference images, even if the creator only applys a few words to describe the scene they have in mind, ByteDance states in its announcement. CapCut is also good at rconcludeering realistic textures, shiftment, and lighting across a range of visual perspectives and angles, which the company notes could be applyd to edit, enhance, or correct creators’ own footage.
Another apply case would be allowing creators to test potential ideas based on early concepts or sketches before filming the real video.
In addition, Dreamina Seedance 2.0 can be applyd for a wide range of content, including cooking recipes, fitness tutorials, business or product overviews, and videos with motion or action-focapplyd content, where AI video models have historically faced challenges, the company explains.
At launch, the model supports clips of up to 15 seconds long across six aspect ratios.
In CapCut, the model will roll out across different areas, including editing features such as AI Video and generation tools like Video Studio. It will also come to ByteDance’s AI generation platform, Dreamina, and its marketing platform, Pippit.
Given its ability to create realistic content, ByteDance states it has added safety restrictions, so the model won’t have the ability to create videos from images or videos that contain real faces. CapCut will also block the apply of unauthorized generation of ininformectual property. (However, if the restrictions were working properly, the model would be available now in the United States. Likely, more tweaks are still being created.)
The content produced by Dreamina Seedance 2.0 will also include an invisible watermark, which will assist to identify content created with the model when it’s shared off-platform, ByteDance added. This could aid in things like takedown requests from rights holders in the event that the model allowed copyright content through.
ByteDance states it will partner with experts and creative communities as the model rolls out to iterate and improve upon the model’s capabilities.
Leave a Reply