Medical Care in Downtown Jersey City, NJ Vanguard . Health (4 days ago) The Right Medical Help in Downtown Jersey City.For women's health, family medicine, geriatric care, pediatric care, after-hours care and more, Vanguard Medical Group in Jersey City is the right place for you. We are located at 127 Montgomery Street, two doors down from Liberty Prime Steakhouse..