There's always someone bigger than you, you can't be jealous of other people. Last summer I fucked five women (more pussy than I've got in my life, I guess my game was on that year). One night stand where the girl looked uncomfortable with my size when I was thrusting (but was italian and didn't speak English very well, so didn't express herself much), a different English girl after that where when I pushed it in she said "Christ you're big", which was nice to hear. A different American girl after that (what? I live in Europe) who didn't make any comment about my size and recounted being with a black guy with a huge dick, and then a different English girl who said you're quite big. Finally, another Italian girl (later became my gf) who told me her ex was built like a horse, super thick and they struggled having sex. I think that the guy was hung like hell but had no sex experience, so he didn't know about things like lube and foreplay. But anyway my self-esteem was crushed by the last girl after being built up so much by the women before. She had an orgasm with him one time, and the rest of the time was mostly bitter, painful encounters and they didn't fuck much. Before that, regular size penis dude and she came a few times. I'm above average, I could star in porn, but I'd be the small guy in the scene. Initially she never came with me during sex (but, that cuts both ways, I told her about the English girl that came twice during a one night stand, I've also had way better blow jobs where I came), then after about 6 months I stop giving a fuck and she started cuming almost every time, sometimes multiple times.
Moral of the story: don't let other men fuck with your self-esteem. Women will be honest with you if you can take it. If you can't, that's where you get lies.