Preheat oven to 275 degrees F.
Oil and flour a 9 inch by 5 inch by 3 inch pan.
Place warm milk into a small bowl. Whisk in 1 tablespoon of sugar until dissolved. Whisk in yeast until dissolved. Set aside to proof.
In a medium bowl, mix together the flour xanthan gum, baking powder, salt, and 3 tablespoons sugar.
Mix eggs, olive oil, and vinegar. Beat for a few seconds to combine. Add the yeast mixture. Beat to combine. Add the flour mixture. Beat for 3 minutes.
Scrape mixture into prepared loaf pan and smooth the top. Place in a warm, draft-free location to rise until about half again it’s size in bulk; about 30-40 minutes at sea level.
Bake at 375 degrees F for 30 minutes. If the top of the bread is getting too brown, place a ten of foil over it.