The Right Medical Help in Downtown Jersey City. For women's health, family medicine, geriatric care, pediatric care, after-hours care and more, Vanguard Medical Group in Jersey City is the right place for you. We are located at 127 Montgomery Street, two doors down from Liberty Prime Steakhouse. Major insurance plans are accepted..