Microsoft’s AI automatically comments on video clips
February 11, 2020
Generating live video captions with AI could bolster engagement on social media, or serve as a benchmark for the task of translating video to text. Preliminary work to this end has employed encoder-decoder models to generate comments, but they haven’t modeled the interaction between videos and comments explicitly, so they’ve tended to generate irrelevant comments.
That’s why a team if I…