I don't disagree--though we have to remember that Smith, whose book was published 1776, was extrapolating from the early stages of the development of the factory system. Capitalists had not yet captured nations' central governments, which is what allowed them to bend whole societies to their desires.