Perhaps this will help someone else: I had a similar maddening experience for days. Following the docs perfectly, my DELETE request appeared to be successful, but the workflow extensions were never archived as expected. My solution was to PATCH like this:
This still does not "delete" the action, but at least it yielded the result I was looking for: the "unpublished" action is no longer visible in the client.