What to do with my friend with benefits?

I would tell him that you're not ready to move into all of that. Say that you want to keep it casual, but I wouldn't completely deny his feelings and hurt him, because in the future, you guys may be good together.