No… you are not crazy. See another neurologist (they prescribe medications), see a neurosurgeon (they do surgery), see the balance and dizzy exercises here on the site (might have to do them regular-like as your brain continues to be stressed). Basically, find people who can help.
I have found that it is more useful for my well-being to thank an unhelpful medical person for their time and excuse myself when I can see that the visit is no longer fruitful. I have to remember that it is not personal for them. They just do not know what is wrong and doctors do not like that feeling so it must be you and your mental health that is the problem!
If the neurologist really thought that a psychiatrist was the answer, ethically they should have referred you on. Otherwise, I suspect they themselves do not know what is wrong with you. Take care to not dismiss your mental health as an undiagnosed, wonky symptom illness can be rather concerning and flare up anxiety and stress.
I have found that it is helpful to ask medical folk what the symptoms of Chiari are in their eyes. I also suggest to view your MRI’s with them - both the sagittal and the horizontal views. Research yourself what are the anatomical structures that can be compromised with Chiari. What are the effects of compression on these structures? Can the doctor answer your questions? Just be careful of putting people on the spot as that is not recommended.
Carry on with the journey and know that most everyone here has had a callous appointment. It is unfortunate but also the way of the little known diagnoses.