From what I've read, i.e. talking out of my R's, bad cleaning is more likely to damage the barrel than shooting. If your concerned about accuracy 1st decide what accuracy you will except, then see the rifle produce a group and see if it measures up.
One of my frustrations with a lot of discussion of accuracy is how often its not measured or the range is not given, or its not specified if the measurement is edge to edge or centre to centre, even in professional magazine articles - oops I'm starting to rant.
Enjoy
Halam