Skip to main content

Auto Caption

Use AI to automate the Caption in your images.

Written by Chris Emmerson
Updated this week

The Auto Caption feature automatically selects and applies the most relevant caption to your images.

In addition to selecting the most relevant caption, it uses the information gained from the face and number recognition features to automatically populate the names of the people in the caption accordingly.

Setting up Auto Caption

In order to get started using this feature, you will need to enable it in the Auto Captioning section of your project settings by selecting a Caption Config file. This file outlines all of the captions that you want the software to choose between when analysing your images.

You can select one of our premade global Caption Config files, or you can edit them and create your own custom files.

Please see our dedicated Caption Configuration help article here if you would like to learn more about customising your configuration files.

You will also need to specify in your project Metadata settings where you want to output the result of this Auto Caption feature.

Most likely, you will want to go to your Caption/Description metadata field in your project settings and apply the "=caption" formula by pressing the "=" hotkey.

Screenshot of Caption Pro's project metadata settings with a "caption formula" in the Caption Description metadata field

Using Auto Caption

When you have this feature enabled, you will immediately see two new sections in the user interface: the caption builder bar beneath the name bar, and the caption selector section to the right of the UI above the image metadata:

Caption Builder Bar

Screenshot of Caption Pro's auto caption feature with the caption reading "San Francisco 49ers tight end Jake Tonges (88) celebrates"

Caption Selector Section

Screenshot of Caption Pro's caption selection section

The software will give a certainty score to any caption it sees as potentially relevant, and select the highest scoring caption that qualifies, based on the number of people in the image.

For example: there could be a caption in the list that relies on there being at least two people in the image which is deemed a 95% certainty score, such as:

"=person() is tackled by =person()" - this needs two people to work.

If there is only one person detected in the image however, the software will select the highest scoring caption that allows for just one person in the image, that could be something like:

"=person() in action"

Overriding the automatically selected caption

If the software hasn't selected the correct caption first time, you have a few options to quickly change or edit the caption.

Changing the selected caption

You can switch between the pre-defined captions by selecting a different one from the caption selector section. This can be done with your mouse, or by pressing shift + up/down on your keyboard.

If you cannot navigate to the desired caption quickly, you can press the "p" hotkey to enter the "caption filter" panel. Start typing which caption you want, and select it from there:

Screenshot of Caption Pro's caption selection section

Quickly change the order of the names in the caption

If the caption is correct, but the names in the caption appear in the wrong order, you can quickly rearrange the order of the names by:

  1. Dragging the names in the name bar into the correct order

  2. Using the Shift + < or > hotkey

Manually editing the caption

If you want to manually edit the caption rather than selecting a different one, you can edit it directly inside the caption builder bar. You can either click inside the bar, or use one of many hotkeys to edit only the relevant part of the caption.

While manually editing the caption from the caption builder, an auto-complete panel will appear with suggestions to help you quickly select the relevant phrase. This auto-complete feature presents suggestions from: your caption configuration file, names from your face database that appear in the project, names from your text lists and any code replacement entries you have active in the project.

Screenshot of Caption Pro auto-complete showing suggested captions for “Brock Purdy run”

Variables

Some captions in the configuration may contain "variables". Two types of variables that might be present in your captions include the "nth" variable or a "custom variable".

Nth variable

One of the most commonly used variable is the "Nth" variable. This is a placeholder for any instance in the caption where you might want to add "first" "second" third" etc. This could be for scoring a goal in Soccer or numbering bases in baseball:

You can hover your mouse over this variable if it appears in your caption to select the correct output, or you can press the "N" hotkey followed by whichever number you want to output.

Enabling the "apply to all unconfirmed images" toggle will make sure this change applies to all instances of this variable in other unconfirmed images your project.

Custom variable

In this example, we have a custom variable in our configuration file that looks like this:

This will present an option at the end of the caption where a user can choose what the person is celebrating. In the app it will look like this:

You can hover your mouse over the custom variable in the caption builder bar or use a hotkey to select the relevant one.

Hotkeys

You can check the hotkeys from the help menu at the top of the app or by using the "?" hotkey. We strongly recommend utilising these hotkeys to further speed up your captioning workflow:

screenshot of Caption Pro's caption builder hotkeys

Did this answer your question?