Have you encountered these limitations when working with Duplicate Detection functionalities in Dynamics 365?

You can include only 450 characters in the matchcode. Either change or delete rule conditions to reduce the number of characters included, and then try again.

Bulk Detect Duplicate Limit Exceeded. The Bulk Duplicate Detection job cannot detect more than 5000 duplicates. Please review your duplicate rules or resolve existing duplicates and rerun the job

Although the OOB duplicate detection functionalities are useful in some cases, I often find myself wasting hours to workaround those limitations when dealing with large amount of data. So I decided to build a solution which allows me to quickly query for duplicates and see how many records duplicated.

Introducing Deduplicator

Deduplicator is a plugin for XrmToolBox. You can download the plugin in XrmToolBox Plugin Store.

What Deduplicator can do

In the first release, it has below features:

• Allows matching multiple fields with no length limitation.
• Allows searching more than 5000 records.
• Allows selecting fields for results view.
• Shows total of duplicated records

Deduplicator is open source

Empowerment of individuals is a key part of what makes open source work, since in the end, innovations tend to come from small groups, not from large, structured efforts. – Tim O’Reilly

You can find the source code of the plugin in Github at:

https://github.com/khoait/DynCrmExp.Deduplicator

Please rate and share the plugin if you think it helpful, also don’t hesitate to leave any comment here or in the GitHub to make it better or if you find any bugs.