Basically, illegal drugs are just the drugs that the wealthy do not use?

No, the wealthy definitely use drugs. I bet almost every celebrity in hollywood does some form of illegal drug.