Amateurs working on mini-films and short-form videos usually spend lots of time and effort on the multi-round complicated process of setting and adjusting scenes, plots, and cameras to deliver satisfying video shots. We present Virtual Dynamic Storyboard (VDS) to allow users storyboarding shots in virtual environments, where the filming staff can easily test the settings of shots before the actual filming. VDS runs on a "propose-simulate-discriminate" mode: Given a formatted story script and a camera script as input, it generates several character animation and camera movement proposals following predefined story and cinematic rules to allow an off-the-shelf simulation engine to render videos. To pick up the top-quality dynamic storyboard from the candidates, we equip it with a shot ranking discriminator based on shot quality criteria learned from professional manual-created data. VDS is comprehensively validated via extensive experiments and user studies, demonstrating its efficiency, effectiveness, and great potential in assisting amateur video production.
翻译:制作微型电影和短片的业余演员通常花很多时间和精力在设置和调整场景、图案和摄影机的多轮复杂过程上,以提供令人满意的录像镜头。我们展示虚拟动态故事机(VDS),让用户在虚拟环境中可以写故事,让拍摄人员在实际拍摄之前很容易地测试拍摄镜头的设置。VDS以“Propose-simulate-difference”模式运行:鉴于编造的故事脚本和摄像脚本作为输入,它根据预先确定的故事和电影规则,产生若干个字符动画和摄影机移动提议,以便让一个现成的模拟机制作视频。要从候选人那里取出最高质量的动态故事机,我们根据专业手工制作的数据所学的射击质量标准,为它配备一个射击分级器。 VDS通过广泛的实验和用户研究得到全面验证,展示其效率、有效性以及协助业余视频制作的巨大潜力。