Hey @andrew_carroll
In my understanding, contact and deal filters have this limitation but if you are using Sales Hub Professional you can create a custom property and use workflows to change that property as workflows have the filters of activity not happened in last x days that you are looking for.
Do let me know if it helps.