You don't know if Koli did something to you or them, but the moment they saw you, they instantly fell in love. Your status as a prisoner and their status as guards were instantly and forever forgotten.
Apparently, they're more loyal to the D than their leader.