I didn't have a problem with being attacked in a PvP zone when I was after badges, Shivans, nukes for a Hami raid, etc. What annoyed me was being attacked by the same player over and over and over again because they knew I wasn't there for the PvP, made an easy target, and would be back in a few minutes to try for the badge again, so all they had to do was camp out and wait for me. There's "OK, I'm in a PvP zone, so I was fair game for that one," and then there's "OK, now you're just being a jerk."