Linking contacts to events that appear in your outlook calendar

So later this week I am heading to a conference. The event is in my outlook calendar. Hubspot can see my calendar.

Now after the event, I want to add my new contacts, I cannot associate them to my synced calendar. I have to create a new meeting (log a meeting). Which effectively means I have to create the same event twice. Once in my outlook calnedar and again in hubspot.

Surely I am not the only who is fustrated by this arrangement.