Can someone please help me? Is this guy a jerk?

Yes he is a Jerk and persuing him will inevitably result in emotional turmoil. If a physical relationship ensues then his rudeness toward you will almost certainly develop into utter contempt resulting in both verbal an physical abuse. So there are only two ways out of your limbo; you can share your feelings with him and more than likely end up with a broken heart and/or bones or you can cut him out of your life completely and eventually replace him with someone who treats you with the courtesy and respect you deserve.