Then your doctor is an arse. Your body does not retain cholesterol from the foods that you eat.
Smoking is a far bigger cause of cholesterol build up in your arteries than any amount of red meat, eggs and butter. Refer the silly bastard to the authorities for retraining or suggest he has a chat with a couple of cardiologists from Broad Green Hospital who I know run regular workshops for local GPs and despair of the levels of ignorance they encounter.