In the final analysis you are free do do what you want. It's your gun.
Caution, soap box/rant:
To me, some things are just inherently dangerous and carry with them risks that go beyond what is acceptable. Some people have the "it would never happen to me" attitude when assessing risk, and consequently, don't see a problem with modifying an firearms action so that the trigger pull is below factory recommendations, or removing a factory installed integrated safety mechainism, like the hammer block or magazine safety. These are the same people who leave their keys in the ignition of their cars, and a an unsecured, loaded firearm in the glove box.
The voluntary action of modifying or removing any safety feature of a gun installed by the manufacturer is dangerous and irresponsible and carrys with it substancial risk both for the gun owner, family members and bystanders. This action also greatly increases the already sizeable burden of the gun owner's liability, both civil and criminal.....and such action is, I believe, indefensible in court.