Preheat oven to 350°F. Spray a loaf pan with baking spray.
Combine the brown sugar, sugar, oil, and eggs into a bowl. Stir to mix.
Mix bananas, pumpkin puree, and whole milk. Add to the sugar/egg mixture.
Sift the flour, salt, baking soda, baking powder, cinnamon, and pumpkin pie spices together. Add pecans or walnuts.
Slowly add ⅓ of the dry ingredients to the wet ingredients at a time, mix as you add.
Pour into the prepared glass loaf pan.
Bake at 350°F for 85 minutes or until a toothpick inserted in the middle comes out clean.
Remove from oven and allow to cool completely.