Penrose tilings (and their corresponding Ammann patterns) have been a source of fascination for mathematicians and physicists ever since their discovery in the 1970's. I will describe a new perspective on where these objects and their remarkable properties come from, and explain how this perspective allows one to construct the other natural analogues in 2D, 3D and 4D. I will then discuss some possible connections to physics which go beyond the well-known connection to quasicrystals.