I don't feel that you overreacted because you are entitled to your feelings as he is to his. I'm sorry to write that I think he only wanted what you gave him and now this is his way of letting you down easy.
He told you HE WANTS A CAUSAL RELATIONSHIP, you said you don't do casual relationships, so your views and feelings seem to differ from his and you don't want to accept it.
You can continue wanting for him all you want, but the FACT remains that you will only get what he wants to give...He only wants a casual relationship!