It's difficult to convincingly argue which of the two occurrences is more damaging. It is easy, however, to reduce one of those occurrences you view as less damaging into "You said lies about me", to promote your narrative.