In a stand mixer with the paddle attachment, beat the room temperature butter until soft and fluffy.
To the stand mixer, add the powdered sugar, cinnamon, and vanilla extract and mix on low speed until most of the powdered sugar has blended with the butter.
Add in one tablespoon of milk and again mix on low speed. Add up to three more tablespoons of milk until the desired consistency is reached.