Whisk flour, cornstarch, baking powder, and salt together in a medium bowl.
Beat softened butter and granulated sugar in a stand mixer on medium-high speed for 4 minutes until pale and creamy.
Add egg and vanilla bean paste, beating on medium speed until fully combined.
Gradually add the dry flour mixture on low speed, mixing just until soft dough forms without overmixing.
Scoop dough into 1.5-tablespoon balls, placing them 2 inches apart on parchment-lined baking sheets.
Flatten dough balls gently with the bottom of a drinking glass to 1/2-inch thickness.
Chill the baking sheets in the refrigerator for 20 minutes to prevent excess spreading.
Preheat the oven to 350°F (175°C) and bake cookies for 9 to 11 minutes until edges are set and tops are matte.
Cool cookies on the baking sheet for 5 minutes, then transfer to a wire rack to cool completely.
Whisk powdered sugar, milk, and vanilla in a small bowl until a smooth glaze forms, spread onto cooled cookies, and top with holiday sprinkles.