I think if you have a lot that you can't wear for whatever reason that is a warning sign.
I know some people who have over 40 dresses they cannot wear because they cannot fit them. If you gained some weight in quarantine and reasonably think you will lose it, I am not talking about you.
For awhile I had some dresses that I had dreamed of getting, but when they came the cut didn't sit right on my torso or shoulders were tight. It took longer than I like to admit to let them go because of the emotional attachment. But that was silly because my torso length isn't going to change and it made the dress look bad on me. Whenever I looked at the dress it would make me feel like shit because I am too tall for a lot of the stuff I admired. It isn't worth it.
So if you are keeping a bunch of stuff that doesn't make you happy to see, wear or store. You are wasting space you have to pay to own plus upkeep energy.
If it still legitimately makes you happy it is fine, but I do think after a certain point having so much can be oppressive for most people. Unless you have money to have people upkeep it for you.
But like another anon said how much you want to deal with things will change over time. Priorities change and you don't have to be sick of lolita as a whole to downsize.