I’m guessing any doctor who actually said that wasn’t talking about alcohol, but as Vanilla at Half-Fast points out:
Compared with abstainers, light drinkers exercised 5.7 more minutes per week, moderate drinkers 10.1 more minutes, and heavy drinkers 19.9 more minutes.
You can read the full article on WebMD here.