I concur with Sammi, only more so. No autopay (except our monthly insurance installment, which been done well for over a decade - but the agent is local, and the bank small), and in fact no on-line anything for finances.
We open anything that could be a bill the day it comes in, throw out the weeds (ads, etc), write the due date on the envelope, and put them all in the same place on the desk. Every payday, we go through that collection, and mail whatever will come out of that paycheck, so we know it is taken care of. Since my is a professor on a 10 month contract, we pay the summer crud (any fixed bill - utilities, mortgage, etc) ahead every year so we know it is all taken care of until well into the fall. It really reduces the risk of error on our part.
We did have a couple of problems years ago with dullards who did not get our mailing address correct (we do not use the street address for safety reasons and haven't for years) and sent bills to the street address, from which they of course got returned. I can be unpleasant when annoyed by such stupidity.