"My bride is ..," he captioned an image in which Bieber is seen kissing Hailey.
Sharing a few more pictures on Instagram, the "Sorry" hitmaker said that "he is looking forward to forever" with Hailey.
The couple got secretly married last year, but on Monday they exchanged vows in a larger ceremony, in front of family and friends, reports people.com.
The ceremony was held at the Montage Palmetto Bluff in South Carolina by the May River.
Bieber and Baldwin said "I Do's" before 154 guests including models Kendall Jenner, Camila Morrone and Joan Smalls.
Bieber's ex-girlfriend Caitlin Beadles was also present at the wedding.
She documented the festivities on her Instagram Story, which show her raving over "gluten-free" cornbread at what appears to be the couple's rehearsal dinner.