I agree his loss, no need to get in to any aggro just have nothing to do with the twat.
I hate walking the dog at weekends, even though its pretty quiet here it's so much nicer to meet zero people while taking the dog out, in fact a bit of wind and rain just makes the chances even lower ha ha
My lab seems to get himself in trouble every now and then so I steer well clear of other dog walkers unless I know them.
Don't let it get to you