Thorny tree i don't know what it is?

I have a tree growing on my side of the house and when I went to go look at it. it was sort of thorny and skinny and long. It makes some great shade but when I was looking at the leaves very closely they were bearing small fruit! It was kind of small like the size of a fully grown man's thumb. But i not going to eat it if i don't know what it is. It was ripe yet but when in the summer it turns red and a little bit bigger. I don't think it is an crab apple.