Bake in the preheated oven until light golden brown on the edges, 30 to 40 minutes.
While the rolls are baking, make the glaze: Beat confectioners’ sugar, milk, butter, cream cheese, and vanilla in a bowl until well combined.
Remove pumpkin rolls from the oven and immediately spread glaze over top.