AI Video and Audio Analysis helps you identify exactly where and how your brand, competitors, or other keywords you monitor are being referenced in your mentions, without having to watch the entire video or listen to the whole podcast.
This feature currently works only for YouTube and TikTok, analyzing videos up to 60 minutes, and for podcasts (with no duration cap) — except Spotify due to its API limitations. It’s available on Business and Enterprise plans only.
How AI Video and Audio Analysis Works in Mentionlytics
Our AI algorithms process your mentions that contain video content and your podcast mentions, scanning for keywords you track with Mentionlytics.
The algorithms identify these keywords in speech or if they are featured somehow in the video’s visual part, and generate a brief but meaningful summary of what the video/podcast is about and whether or not your keyword is being discussed there.
If your keyword is present in the video/podcast, then our AI points out exactly at which second(s) of the content it’s being discussed and what people say there.
Thus, you can decide whether this mention is worth watching/listening to, or you can just glance at what they said and move on to more important tasks.
Important Note: Mentionlytics doesn’t scan the online space for videos and audios associated with the keywords you track. It collects mentions that contain your keywords in their text and then analyzes the video and audio content within them. This means that AI Video and Audio Analysis is conducted on the already collected mentions.
How to Use AI Video and Audio Analysis
AI Video and Audio Analysis has already been enabled for your YouTube, TikTok, and podcast mentions, if you’re a Business or Enterprise plan user. All you have to do is browse your corresponding mentions and check out the AI-generated summaries.
Note: The video and audio summaries are generated in the same language as SIA’s AI Summaries, which you can change from Settings → Notifications → SIA Alert Settings → SIA Summarization Language.
You can see the part of the video/audio where your keywords are being mentioned by clicking on the play button right below the summary. The box will expand to show you the exact seconds when your keywords are referenced and the context.
Also, you can easily copy the whole text to use in your reports or share it directly with your team/clients, e.g., in an email, by clicking the grey copy button at the top right corner of the summary box.
Lastly, you have the option to let video and audio analysis affect the relevance and sentiment categorization of your mentions by ticking on the corresponding box when you add new keywords or edit existing ones.
This means that, for example, if a video or podcast mention is categorized as Normal in Relevance based on its caption analysis, but AI Video and Audio Analysis identifies that there is just a vague reference to your keyword, it might change the mention’s Relevance to Low, almost like a human would do.
It’s a helpful addition that improves relevance and sentiment results in Mentionlytics, since the algorithm now understands the mention’s context in detail.