Is it normal to feel inadequate because of this?

It's not necessary to be "popular" or part of a group. Be satisfied with your own opinion of yourself, not the views of others. One or two good friends are far better than a whole bunch of casual acquaintances. If some people dislike you, so what? And as for "fitting in" - be unique, be yourself. If some don't like it, that's their bad luck.