Is it rude to not accept compliments ?

I think it's very rude not to accept compliments with a graceful thank you because by refusing to agree with the compliment you are suggesting the person in question has poor taste or doesn't know what they are talking about. If you have self esteem issues then you need to work on them. Of course compliments don't solidify how you feel about yourself. They are fleeting. How you feel about yourself comes from you, nobody else. I think you should focus on what you have to offer as a person rather than worrying about your looks.