Being hated on CGL has no real bearing IRL, though, except for the possibility of people having pre-conceptions that can be quickly dissolved if the person really is as nice as they're made out to be.
If you're someone who isn't bothered by anonymous comments/empty shit-posting, then you'll be fine popular or unpopular.
As far as advice goes, I say continue to talk to your lolita idols and if you find that they're not as nice as you had perceived, then just let it go and nothing will be hurt. If they are really nice, then they'll talk to you more and you can build a relationship with them just like any other person. Lolita "celebrities" are not real celebrities by any means, we're all just average people in a hobby, so you should look at them exactly as that.