As long as you don't take forever to pass and clear the lane I have no problem. But if you drive in formation like you are a member of the Thunderbirds or Blue Angels, then we are going to have a problem. The passing lane is for passing, not riding in formation with another slower driver!
As for me and the speed limit, I generally drive around 5 mph over the speed limit on 4 lane roads and generally right around the speed limit in towns except for a few that are known speed trap towns. One such town is Golden Meadow, LA and has been known for speed trapping since before I was born. If the speed limit says 45 mph, set your cruise control at 44 mph there.