Description
This article provides information on the Labelbox queue system works, providing guidance on how to navigate task queues and manage reservations.
Prerequisites
Access to the Labelbox project as a labeler, reviewer, or admin.
The basics of the labeling queue:
Batch Submission: When you send a batch of data rows to a project, Labelbox adds them to the project's labeling queue. This queue automatically distributes the data rows among active labelers, ensuring efficient utilization of resources.
Reservation System: Labelbox reserves several data rows for each labeler, preventing other team members from labeling the same assets simultaneously. This system aims to eliminate duplicate labeling efforts and streamline the labeling process.
How reservations work:
Automatic Reservations: Upon starting to label, Labelbox automatically reserves three assets for the labeler. As labelers progress, the queue replenishes these reservations to maintain a steady workload.
Expiration and Availability: Reservations expire after 24* hours of inactivity. Expired reservations are displayed in the project settings queue, allowing other labelers to claim them. This mechanism ensures that data rows remain accessible and utilized efficiently.
Clearing Reservations: Users can manually clear reservations for a user through the project settings. However, clearing reservations during active labeling can result in loss of unsubmitted work.
Below is an example of the labeling queue. As you can see, assets are reserved and the option to clear any reservations.
FAQ:
Where can I find the queue and who reserved the labels?
You can navigate to Project > Settings > Queue. From there, you can view the queue from any workflow task.
How come there are data rows available, but the “Start labeling” or “Start reviewing” is grayed out?
This is mostly likely because other project members have reserved the data rows. As an admin, you can clear the reservations, and the data rows should be available to label/review/rework.
How come I was working on a data row and lost all of my annotations? I’m no longer able to label the same data row?
It is likely that your reservation for the data row was cleared, which resulted in the loss of unsubmitted work.
How come the timer was grayed out for a second?
When the system detects 5 minutes of inactivity, the timer will be grayed out and the recording time will be paused.