Preheat oven to 350°F (175°C). Grease a 9x13-inch ceramic baking dish with softened butter.
Place dried brioche cubes in the prepared baking dish; scatter toasted pecans over bread.
Whisk eggs, milk, heavy cream, brown sugar, cinnamon, nutmeg, and vanilla extract together in a large bowl.
Pour custard mixture evenly over bread cubes; press bread down gently with a spatula to submerge completely.
Let dish stand at room temperature for 15 minutes to allow bread to soak up custard.
Bake uncovered for 40 to 45 minutes until top turns golden brown and center sets firmly; serve warm with caramel sauce.