Style comes first: look through full galleries, not just highlights, and find a photographer whose images consistently feel like the day you want to remember. Documentary, fine-art, traditional and editorial all look very different, so decide what appeals before comparing prices.
Then check the practical details: how many hours of coverage, whether a second shooter is included, how and when you receive your images, album options, and whether they have photographed at your venue before.