Am i a decent looking guy or maybe look like a terrorist LOL?

Hello everyone, Im just curious to know if im a decent looking guy. I can sit on the bus and people would rather stand than sit beside me. I smile, say hello, and sometimes nod my head. I dress casual, normally in a work shirt with t-shirt underneath, and jeans, running shoes and baseball cap. I know i tend to let myself get scruffy, could that be the reason?? Sometimes i will get "the look" I THINK but no one has the guts to come say hello or even wink or a nod back to let me know they are possibly interested. I am 150 pounds and athletic build, mixed race of lebanese and Irish. Anyways let me know what you think, or if im doing something wrong. Out of my 28 years of existence not even one woman has asked me out, so my self esteem is kinda low at the moment, if your comments are rude please don't bother.