thanks so much for the feedback @Calebb, It looks like you are leveraging the team availablity of office hours for live chat. This should turn the chat widget to the outside of office hours mode and not display as if there are agents online without any action from the agents themselves, similar to how you are describing this above. Are you noticing this functionality work this way or would expect this to work differently?
Also, feel free to email me directly @ cdewey@hubspot.com to chat in more detail about this request! thank you so much for your feedback and time.