My doctor thinks that I have Asperger's Syndrome?

You have it, you are in denial. But it's ok you don't need a doctor to tell you how to live your life as long as you are happy a diagnosis shouldn't matter.