AI Deduper
Q: What is the Diligentsia AI Deduper
Diligentsia uses generative AI to personalize (“bespeak”) the platform to the needs of your company.
The AI Deduper is a tool in the Data Repository that searches across the platform for:
duplicate files, and
different versions of the same filename
It brings any matches into one place so you can review and decide whether to delete, move, copy, or download the files.
Example: If an “Employee Records” file is uploaded more than once, the Deduper finds each location and shows them together so you can decide what to do.
Q How Does it Work
Step 1: You select Deduper from Filing Assistant Menu.
Step 1: You select Deduper from Filing Assistant Menu.
Step 2: You are then taken to the wait screen and list of duplicated files shows in Deduper Assistant.
Step 2: You are then taken to the wait screen and list of duplicated files shows in Deduper Assistant.
List of duplicated files shows in Deduper Assistant. you can copy, move, download or delete.
Step 3: You can see the changes in the Audit Log.
Step 3: You can see the changes in the Audit Log.
Step 4: If there are no duplicated files identified then this is reported
Step 4: If there are no duplicated files identified then this is reported
FAQs
Q: Where do i find the Deduper feature?
On your dashboard, go to Data Repository, then select Deduper from the Filing Assistant dropdown menu.
Q: Does the AI Deduper check file contents to detect duplicates?
No. The AI Deduper identifies duplicates by filename, not by file content. We do not check file contents for this feature.
Q Do i get a report of duplicated files that I can delete/move/copy?
Yes. You can access a Deduper Report from Data Repository → Filing Assistant dropdown → Deduper Report.
Q: I am on the Free plan — can I access the AI Deduper?
No. The AI Deduper is available only to Lite and Pro users.
Q: I am on the Lite plan — do I need to pay extra to access the AI Deduper?
No. The AI Deduper is included with the Lite plan.
Q: I am on the Pro plan — do I need to pay extra to access the AI Deduper?
No. The AI Deduper is included with the Pro plan.
Q: Does the Deduper generate a report?
Yes. It provides a report listing duplicate files.
Q: Can I move files identified by the AI Deduper?
Yes. You can move, copy, download, or delete the files it identifies.
Q: What if no duplicates are found?
The Deduper will tell you that no duplicates were detected.
Q: Where can I see changes made by the Deduper?
In the Audit Log.
Q: Is the AI Deduper available in Expansion Packs?
No. It is a core feature (available on Lite and Pro).
Q: How do I track deletion of duplicates?
Any deletion or movement is recorded in the Audit Log.
Q: Can I undo file deletions made by the Deduper?
No. If a file is deleted using the Deduper, it cannot be recovered through the Deduper.
Q: Is there a limit to how many files the AI Deduper can scan?
No limit is specified. It works across the platform.
Q: Is the Deduper available in all data rooms?
The Deduper is accessed from the Data Repository in Diligentsia.
Q: Can I run the Deduper manually or is it automated?
You must manually initiate the Deduper from the menu.
Troubleshooting FAQs: AI Deduper
Q: Why can’t I find the Deduper feature in my dashboard?
A: The Deduper is in Data Repository → Filing Assistant dropdown. Also confirm you are on Lite or Pro, as the Free plan does not include Deduper.
Q: What should I do if the Deduper doesn’t identify any duplicates?
A: If none are found, the Deduper will report that. Check that your repository contains files with the same filename (or versions with similar naming), since Deduper detects duplicates by name.
Q: Does the Deduper compare file contents?
A: No. It identifies duplicates by filename only.
Q: Can I access the Deduper on the Free plan?
A: No. It is available only to Lite and Pro plan users.
Q: How do I generate a Deduper report?
A: Go to Data Repository → Filing Assistant dropdown → Deduper Report.
Q: Can I recover files deleted by the Deduper?
A: No. Deleted files cannot be recovered through the Deduper.
Q: Why isn’t the Deduper scanning all my files?
A: Deduper scans files in the Data Repository. Make sure files are properly uploaded and named. If versions aren’t being picked up, review your file naming, since detection is name-based.
Q: How do I track changes made by the Deduper?
A: Check the Audit Log for records of deletions, movements, and copies.
Q: Can I move files identified by the Deduper?
A: Yes. You can move, copy, download, or delete the files it identifies.
Q: Is there a limit to the number of files the Deduper can process?
A: No specified limit.
Q: What happens if I accidentally delete an important file using the Deduper?
A: Deleted files cannot be recovered through the Deduper, so delete carefully.
Q: Is the Deduper feature available in Expansion Packs?
A: No. It is a core feature included with Lite and Pro.
Q: How do I know which files are flagged as duplicates?
A: The Deduper shows a list of duplicate files, including where they appear.
Q: Can I automate the Deduper to run periodically?
A: No. It must be started manually from the Filing Assistant menu.
Q: Where can I see changes made to duplicate files?
A: In the Audit Log.
Q: What if I need to keep multiple versions of a file?
A: The Deduper does not delete automatically. It flags duplicates so you can choose what to keep, move, copy, or delete.
Q: Can I use the Deduper for external data rooms?
A: The Deduper is for use within Diligentsia’s Data Repository and does not scan external data rooms.
Q: Why isn’t the Deduper identifying all versions of a file?
A: It detects duplicates by filename. If versions have very different names, they may not be flagged.
Q: Can I access Deduper reports offline?
A: Deduper reports are generated in the platform and can be exported for offline use.
Q: How do I contact support if the Deduper isn’t working?
A: Use the support bot on the website or email support@diligentsia.co.uk.