Should I just forget about it?

Lay down the law, just make it clear that you don't want it to be one of those relationships. If he still wants you or is acting badly, etc. THEN you have the complete right to forget him.