Since you don't want to yank, how do you feel about them yanking themselves? This is already happening on your walks.
You should teach him to lunge. Since you say his yanking is an annoyance, and I assume that it cannot pull you off your feet, then just stand your ground.
10-15ft line, send him...