Physicians in ancient rome generally had lower prestige because they evolved from barbers. Barbers did not have high prestige so it would make sense that the physicians did not either. Physicians also generally did not own their own practices, so that took prestige away from them.
