Should I keep hanging out with my best friend?

You should be able to enjoy your life and not have a friend hold you back from it. I went through something similar to that and I had to let him go because it was too much for me.