I need help creating reports for the fields/properties of an object to see how much data is populated in each field.
Example- For deals, I want to see which field is populated/not populated and how much. Similarly for other objects as well.
Hi @KNagpal9 happy to help with your question about what fields are used and which aren’t.
HubSpot includes a Data Model that let’s you visualize your CRM architecture and how the various objects (Contacts, Companies, Deals, Tickets, and custom objects) relate to each other and activities (calls, emails, etc.)
Within the Data Model, you can click into each object to see Property Insights:
When you click the Properties tab, you can see where the properties are used and what the Fill Rate (%) is. To do this, it requires Ops Hub Pro or Enterprise.
You’d also gain access to the Data Quality tools, which includes a weekly notification to review your property usage, etc. as well as the ability to monitor specific qualities.
Can I still export these properties that have no data even if I don’t have Ops Hub Pro or Enterprise?
Also, what does unused stand for in this? Does that mean that the property is not being used in any workflow, campaign, or segment?
Also, I am not able see the data model for leads any specific reason ?
@KNagpal9 here are the answers to your questions:
With any subscription you can export properties and export the property history and with the CRM API you can retrieve properties.
The export functionality for properties with no data is part of the data quality tools and isn’t possible without the Pro or Enterprise subscription - you could either start a 2 week trial if you only need temporary access, or you could run a script to gather the data you need.
I used Hub Helper Harry (an AI chatbot built with chatGPT and trained on HubSpot) to generate a starting point:
"
To export properties that have no values, you would typically need to:
- Identify Properties with Null or Empty Values: First, go through your dataset and identify the properties that are either
null,undefined, or have empty values (e.g., empty strings or arrays). - Filter and Export: After identifying these properties, you can create a script (e.g., in Python, JavaScript, or another programming language) to filter out entries that have values and then export the remaining properties without values.
Here’s a general approach you can use, depending on your dataset structure (e.g., JSON):
Example with JSON Data in Python:
import json
# Load your JSON data
with open('data.json', 'r') as file:
data = json.load(file)
# Initialize a list to store properties with no values
empty_properties = []
# Iterate through the JSON data
for entry in data:
for key, value in entry.items():
if value in [None, '', [], {}]: # Adjust conditions based on your needs
empty_properties.append({key: value})
# Export the empty properties to a new file
with open('empty_properties.json', 'w') as output_file:
json.dump(empty_properties, output_file, indent=4)
print("Exported properties with no values
"
I didn’t test this code and it may require further modifications.
Unused means these properties aren’t being used in any tools, which would include workflows, campaigns, lists, forms, etc.
The leads object is a pseudo object, or secondary object, that is a subset of the contact object. I’m not sure why it’s not included in the Data Model other than it having just been recently released.
Where are you opening leads @KNagpal9 ? in the data model or directly in the workspace?
@KNagpal9 Our migration platform includes an Estimator tool (completely free to use) which will do exactly what you’re asking for. If you connect it to your HubSpot portal, we’ll take a look at your objects and fields, then we’ll show you how populated each field is (% and #).
You can access the tool here, then after registering click on the calculator icon on the left. Here’s a quick walkthrough: Estimate - 20 August 2024 | Loom
And here’s a snippet of the PDF that you’ll receive:
Hope this helps!
@noahmckeon sorry, replied to the wrong thread, disregard my previous question 
Would you also know more about the deduping the companies since I currently have many companies created every time a new record enters the system? I want to set up a proficient process to ensure I can do bulk deduping to make it much easier.