Whisk together mayonnaise, buttermilk, dill, caraway seeds, and ¼ teaspoon each salt and pepper. Let chill in the fridge for at least 30 minutes to let the flavors come together.
Preheat your oven to 400 degrees.
Wash potatoes.
Boil 1 quart of water with 1 tsp. salt. Add potatoes and turn heat to low, let simmer for 12 minutes. Drain.
Put potatoes on a greased baking sheet.
Wrap each potato with ⅓ piece of bacon, with the two ends meeting underneath the potato.
Bake potatoes for about 25 minutes, or until bacon is crispy!
Serve as a side dish or as an appetizer with toothpicks.