In a small saucepan, heat whole milk and culinary lavender buds over medium-low heat until steaming; remove from heat and steep for 15 minutes, then strain out buds and cool milk.
Preheat oven to 350°F (175°C); grease and flour an 8-inch round cake pan or line with parchment paper.
In a medium bowl, whisk all-purpose flour, baking powder, and fine sea salt.
In a stand mixer, beat softened butter, granulated sugar, and 0.33 cup honey for 3 minutes until pale and creamy.
Add eggs one at a time, followed by vanilla extract, beating well after each addition.
Alternately add dry flour mixture and strained lavender milk in three additions, beginning and ending with flour.
Pour batter into prepared pan, smoothing top with a spatula.
Bake for 32 to 35 minutes until a toothpick inserted in center comes out clean.
Cool cake in pan for 10 minutes, then invert onto a wire rack to cool completely.
For glaze: whisk powdered sugar, 2 tablespoons honey, and 1.5 tablespoons lavender milk until smooth; drizzle generously over cooled cake.