“I’m not mad, I’m just disappointed.”

Ever heard that one before? Of course you have. It’s the classic guilt trip disguised as emotional honesty, and it works like a charm every single time.

We’ve all dealt with toxic people who somehow manage to make us feel terrible without ever raising their voice or saying anything overtly cruel. They’re masters of passive aggression, wielding seemingly innocent phrases like weapons while maintaining plausible deniability.

The worst part? You often don’t realize you’re being manipulated until you’re already feeling guilty, confused, or questioning your own reality.

After years of studying psychology and observing human behavior, I’ve noticed these phrases pop up again and again. They’re the calling cards of people who want to control you without taking responsibility for their actions.

Let’s break down the eight most common passive aggressive phrases toxic people use, so you can spot them coming from a mile away.

1. “Whatever you think is best”

This phrase sounds supportive on the surface, right? Wrong.

When someone consistently responds with “whatever you think is best,” especially in a flat or resigned tone, they’re not being agreeable. They’re setting you up to take the blame if things go wrong.

I once worked with someone who’d respond this way whenever we discussed project decisions. Later, when something didn’t work out, guess who suddenly had plenty of opinions about how I should have done things differently?

The passive aggressive person uses this phrase to avoid responsibility while simultaneously expressing their disapproval. They’re essentially saying, “I disagree, but I’ll let you mess this up so I can say I told you so later.”

2. “I guess I’ll just do everything myself”

Talk about a masterclass in martyrdom.

This phrase is designed to make you feel guilty for not reading their mind or not helping in the exact way they wanted. Instead of asking directly for help or communicating their needs, they choose the dramatic route.

In my book Hidden Secrets of Buddhism: How To Live With Maximum Impact and Minimum Ego, I discuss how genuine communication requires vulnerability and directness. Passive aggressive people avoid both by playing the victim instead.

The manipulative genius of this phrase is that it puts you in an impossible position. If you offer to help after they say this, you’re only doing it because they guilted you. If you don’t help, you’re the bad guy who lets them struggle alone.

3. “No offense, but…”

Spoiler alert: they’re about to offend you.

“No offense, but” is the passive aggressive person’s get-out-of-jail-free card. They think that by prefacing their criticism with these magic words, they can say whatever hurtful thing they want without consequences.

It’s like punching someone in the face while saying “no harm intended.” The disclaimer doesn’t negate the action.

What makes this phrase particularly toxic is that if you do take offense (which is completely reasonable), they can turn it around on you. “Why are you so sensitive? I specifically said no offense!”

4. “I’m fine”

Two words. Infinite passive aggression.

When someone says “I’m fine” through gritted teeth or with obvious body language that screams the opposite, they’re not fine. They’re furious, hurt, or frustrated, but they want you to work for the information.

This phrase is emotional manipulation at its finest. They’re simultaneously punishing you with their coldness while forcing you to play detective about what’s wrong. And here’s the kicker: if you don’t figure it out, you’re insensitive. If you keep asking, you’re annoying.

The healthy alternative would be to say, “I’m upset about something, and I need some time to process before we talk.” But that requires emotional maturity that passive aggressive people often lack.

5. “I was just joking”

Ah yes, the classic backpedal.

Toxic people love to disguise their cruelty as humor. They’ll say something cutting, watch for your reaction, and then retreat behind “I was just joking” when called out.

This phrase serves a dual purpose: it allows them to express their true negative feelings while avoiding accountability, and it makes you look like the bad guy who can’t take a joke.

I’ve noticed this pattern countless times in toxic relationships. The “joke” is never actually funny. It’s always pointed, personal, and designed to hurt while maintaining deniability.

6. “You’re being too sensitive”

This is gaslighting 101.

When someone consistently tells you that you’re being too sensitive, they’re not commenting on your emotional state. They’re invalidating your feelings and avoiding responsibility for their hurtful behavior.

In Buddhist philosophy, which I explore extensively in Hidden Secrets of Buddhism: How To Live With Maximum Impact and Minimum Ego, we learn about the importance of accepting all emotions as valid. There’s no such thing as being “too sensitive” when someone has genuinely hurt you.

This phrase is particularly insidious because it makes you question your own emotional responses. Over time, you might start suppressing your feelings or doubting your instincts, which is exactly what the manipulator wants.

7. “I thought you knew”

Ever been blindsided by someone’s expectations that they never actually communicated? That’s where this phrase comes in.

“I thought you knew” is the passive aggressive person’s way of making their lack of communication your problem. They had expectations, didn’t express them, and now you’re somehow at fault for not being psychic.

This happened to me with a friend who got upset that I didn’t invite them to a casual gathering. When I asked why they didn’t mention wanting to come, their response was, “I thought you knew I’d want to be included.”

The manipulation here is subtle but effective. It makes you feel guilty for not anticipating their needs while they avoid taking responsibility for not communicating them.

8. “After everything I’ve done for you”

This phrase is emotional blackmail, plain and simple.

Toxic people keep a mental scorecard of every nice thing they’ve ever done, ready to weaponize it when they want something from you. They frame their past actions as investments that you’re now obligated to repay.

Genuine kindness doesn’t come with strings attached. When someone truly cares about you, they don’t throw their good deeds in your face during disagreements.

This phrase is designed to make you feel indebted and guilty, shifting the focus from whatever legitimate issue you might have raised to their perceived martyrdom.

Final words

Recognizing these phrases is the first step to protecting yourself from passive aggressive manipulation. The second step is understanding that you’re not responsible for managing other people’s emotions when they refuse to communicate directly.

You can’t control how others behave, but you can control how you respond. When someone uses these phrases, you have the right to call out the behavior, set boundaries, or simply walk away.

Remember, healthy relationships are built on honest communication, not manipulation disguised as innocence. Don’t let anyone convince you otherwise.

The next time you hear one of these phrases, trust your gut. That uncomfortable feeling you get isn’t you being too sensitive. It’s your intuition warning you that something’s not right.

And your intuition is usually spot on.