Hubspots new duplicate filter bringing in way too many duplicate possibilities

HubSpot’s Manage Duplicate section is now using just first and last name are equal to decide that something is a potential duplicate. It’s insane. No other criteria like company name or state or anything. So the volume of my potential duplicates is at 35K!! It was at 10K but with the new visibility its at 35K. How am I supposed to go through and merge/reject that many pairings? Also a record that is identified as a potential dupe will not sync over to SFDC. It’s basically a nightmare and super frustrating. I inherited this Hubspot instance so most of the dupes are from years past but with this new visibility, even for dupes found this year I’m at 25k all of a sudden. Any ideas to help?

Hi @KCowell1,

I think there are a few different things at play here.

Manage Duplicate section is now using just first and last name are equal to decide that something is a potential duplicate

I didn’t catch any update here but I think this may be related to the the new increased limits more so than to the filter rules, see here: HubSpot Login and Sign in

What is it?

We’re increasing the limit on the number of duplicates surfaced by the HubSpot Model. The list below reflects the change in limits across all plans that have access to the duplicate management tool. All limits reflect the number of duplicates surfaced per object.

Data Hub Starter - 2K → 10K

Data Hub Professional – 5K → 30K

Data Hub Enterprise – 10K → 100K

Platform Starter - 1K

Platform Pro - 2K → 10K

Platform Ent - 2K → 10K

Note: the limit on the recently released custom duplicate detection rules is still 10K duplicates per object.

Why does it matter?

Higher limits mean greater visibility into duplicate records, helping teams clean up their data more effectively. Previously, customers may have been unaware of duplicates beyond their existing limits, leading to incomplete data hygiene efforts. By surfacing more duplicates, businesses can improve data accuracy, reduce redundancy, and enhance operational efficiency. This ensures that teams work with cleaner, more reliable data.

How does it work?

These new limits are auto-enabled in the Manage Duplicates tool, so you may notice an increase in the total number of duplicates detected.

However, you can now create custom rules to identify duplicates, see here: HubSpot Login and Sign in

How am I supposed to go through and merge/reject that many pairings?

There is also a a public beta for a duplicate similarity score here: HubSpot Login and Sign in

With custom rules, you can also manage duplicates in bulk: Review and manage duplicate records

Also a record that is identified as a potential dupe will not sync over to SFDC.

I was not aware of that and can’t find any documentation on this either. Are you sure about this?

They should still sync - there is no automatic “block” just because HubSpot has identified duplicates. Sync eligibility is controlled by your Salesforce inclusion segment and sync rules, not by the duplicate flag itself.

If you’re seeing that they’re not, it should show up as a Salesforce sync error. If so, can you please share a screenshot of the error details?

Lastly, if you’re simply not a fan of how HubSpot handles this, you might like Koalify. Personally, I prefer it to the HubSpot tool and nd would recommend it. It lets you set custom deduplication rules, primary rules and will store results in custom properties that you can filter for, use in reports or within workflows: https://koalify.io/

You can install the app through the HubSpot app marketplace or through my affiliate link which makes me eligible for commission.

Best regards

It’s contact duplicates.

Hi @KCowell1 and welcome back! It’s so great to see you again on the HubSpot Community!

And @karstenkoehler thanks so much for sharing these valuable insights! :glowing_star:

@KCowell1, the new duplicate detection definitely makes a lot more pairs visible, but I can see how that scale is overwhelming. Thanks for your valuable feedback.

To add to what Karsten shared, I’d like to confirm that the duplicate tool takes more than just first and last names into account for contacts.

To make things more manageable, you could try using Manage Duplicates > Actions >Refine suggestions. Add a few extra properties, like company, state, phone, zip, or lifecycle stage, to quickly bulk reject clear false positives. Once rejected, those pairs won’t keep popping up.

And if you’re seeing sync issues with Salesforce, double-check for duplicate records in Salesforce itself.

Here are some resources for more information:

I hope this helps!
Bérangère

Hi @TeeTech and thanks for your contribution!

Which API were you thinking about here, please?

Do you have the link to the HubSpot documentation?

Thanks,
Bérangère

Hi, I wouldn’t merge anything based on the name alone. I’d only treat it as a real duplicate if another field matches too, like email, phone, or company. I’d also separate the old records from new duplicates so you can stop the problem from growing while you clean up the older ones.

Hi @TeeTech, Thanks for clarifying and sharing the relevant documentation.

This will be helpful for other Community Members.

Have a lovely day!
Bérangère