Im almost 19 and this guy in my fraternity asked me out (im a girl). hes super hot and sweet BUT ..?

there is history with him a my friend for a bit. I don't know exactly how it ended but now its kinda awkward. this all happened in a day span, which is lame cuz no guy has ever asked me out or called me hot and super nice or anything. he keeps texting me like "i just wanna see you". he asked me out this morning and stuff but yeah im scared he has a hidden agenda. ALSO he's in my family (like fraternal family) and i DO NOT want to cause drama because i hate drama and im new to this family. I just feel like its a lot of stomach knots and worries but i don't know if its normal or anything. hey, im new to this stuff. what should I do? I couldnt have just said no when he asked me out- i think I like him too, and now its too much (or Im thinking it is- i over think way too much :P)