Stuart, there is nothing foolish about removing propellers...as part of an annual check it's a good idea to check for corrosion on the bolts/ prop flange (and the condition of the removable crankshaft hub, if you are so fitted).
For wood props, it's even more important to retorque the prop (at more regular intervals too, due to season/humidity changes, etc).
If you tell us the type, manufacturer etc of the prop, you will likely get "chapter & verse" on the proper prop torque! As an aside, what engine do you have? This has an influence upon whether you &/or your Inspector should be examining the prop hub at suitable intervals.