Why is he so straightforward? he is trying to scare me?

My guess is that you like him because you are attracted to him and you want more than just a ual relationship. Let him go.