My understanding is all medical schools require physics. You also will need to know it for your MCAT exam. I also think you'd want to stick to the first year of general biology rather than seeing if other things will substitute. It needs to be general biology for biology majors and include an associated lab. If you already know to which medical schools you plan on applying, you can contact those school's admission offices and ask if they would accept what you are suggesting. You can also just pick a few schools to see what they say. If they say 'no' you have your answer. If they say 'yes' then you at least know some schools will accept it.
I'm really surprised your advisor said you don't need to take physics. Have them look at the
Medical School Admission Requirements (MSAR) book which includes all of the specifics.