Bayonne Medical Center. 29 E 29th Street. Bayonne, NJ 07002. Phone: 201.858.5000. get directions. The people that live here in Bayonne have been our number one concern for over 100 years—we've always been neighbor taking care of neighbor. Today, we remain dedicated to caring for you, your family and our community by staying on the forefront ....