Height matters, but it's not as big of a deal as you think. Ancientfag here, I've seen more than my share of manlets get laid and plenty of lanklets fail with women. Obviously I've seen plenty of both.
First things first, women are horrible at judging size. They're constantly lied to about what is 8 inches and what 6' tall is. Yeah, they might be attracted to the taller guy at first, but if he's an autistic fuck like the rest of us, you better believe she'll go for the short guy with a better personality. My best friend is a 5'4 manlet. His wife is one of the hottest women I've ever met. My little brother is short and has 0 problems getting laid. I'm not exactly a casanova, but at 6'2 I don't have many problems with women. At the same time, plenty of less attractive manlets do significantly better than me.
Height matters, but it's not the end of the world. If you're short, you need to get in shape, get a decent career, be confident and generally just get your shit together. Some girls wont want you, plenty more will. It's the same with tall guys, I've been rejected by women who were 5' tall or so for being too big for them as they wanted guys closer to their size. The only place people obsess with height is /fit/ because we're all insecure assholes on the inside.