When the lancers were over Gabriel went away to a remote corner of the room
This imagery here is very reflective of the two encounters that he had with Lily and Miss Ivors. Given that Gabriel seems very respected by his family and has a good reputation, these two encounters definitely hurt Gabriel's ego since they both challenged Gabriel's expectations of conversation.