When someone says "Sorry, not sorry" they are still sorry for something.

Basically I'm sorry that you though I would be sorry for that other thing, but I'm not.