I finally figured out why my Ficus lyrata kept dropping leaves

I finally figured out why my Ficus lyrata kept dropping leaves! Turns out I was moving it around too much trying to find the "perfect" spot. Since I settled it in bright indirect light by the east window and stopped fussing with it, new growth has actually started showing up. I'm still nervous about watering—I keep second-guessing myself on when the soil is truly dry—but at least it's not looking sad anymore. Has anyone else had this problem, or am I just overthinking it?