Towards the later half of my CoH lifetime, I started spending more and more time in the various PvP zones (until the last two-three years...), but I never built my characters strictly for PvP.
I tried many times to get my SG to join in, sometimes successful, other times not. We even had an internal SG PvP ranking ladder (with yearly "seasons" to determine that year's "champion") that I helped run for a stretch (the league was started by one of the SG's officers, I was promoted and took over for a while when he couldn't, then I passed the torch on to someone else when RL prevented me from attending to the task), and it was fun to do if only slightly tricky to manage the 30-40 characters on it (mostly alts, there were only about 15-16 or so players interested total at the highest peak population). Once I even put together a short music video featuring some various clips of my SG duking it out in the Arena, though I never uploaded it to Youtube or anything like that (I might still have the video laying around somewhere, but it's so dated I'm not sure it's worth uploading now... I recorded it in like 2007-2008ish I think...?)...
To me, PvP was something that could be fun once you got past or even avoided the people with the "super extreme min/max IO" builds/playstyles. Granted open PvP zones sometimes made that difficult, but you could easily trim down the headaches by doing it through the Arena with people you knew(which did help a lot if you were not a seasoned veteran at it and needed someone to practice with or test out builds on).
I started loosing interest towards the end long after all the PvP changes had firmly taken hold, and I would go to any of the various PvP zones and only find 1-2 other people in it. The fun just wasn't there anymore when you only had maybe one guy to fight and he consistently whooped your butt because he had significantly better (and more expensive) IOs, and the other guy in the zone didn't want to PvP because he was farming NPCs for IOs (else, badge farming by taking over the Capsules...)... Of course, Victory Server was always leaning towards the "lol PvP" side of things, so that right there might have been a bigger factor for why the zones eventually died out of activity, but the server was my home so I wasn't about to just jump over to a different server; it wouldn't have been the same...