To the butter and pumpkin mixture, add in the powdered sugar, vanilla extract, and pumpkin pie spice. Use a rubber spatula to mix the ingredients together a bit before turning on the stand mixer to low to combine. You can also cover the mixer with a towel to prevent a powdery mess. Scrape the sides of the mixing bowl as needed.