You did not mention how long you have been on the Norco, but if it is a few weeks or even a month there should be no physical withdrawal from stopping it. You may have well-controlled pain because you are taking pain meds. Stretch out the Norco intervals and see if the pain is worse.
If your doctor agrees, you can substitute OTC Tylenol or ibuprofen for the Norco and see if your pain is controlled. If the answer is yes...you are ready to stop the Norco and just use the OTC medication as needed for break through pain. Coming off the Norco over a few days is better than stopping it cold, but either way there should be no opiate withdrawal symptoms.