I would have to agree with your statement, overall. That being said, I, personally, do not rush into a physical relationship unless I want to. I prefer to take my time. Furthermore, I have found that if a man really likes me, he will wait. However, the male needs some affection, i.e., hand holding, hugs, a gentle touch on his arm or his face. Otherwise, he tends to feel insecure... or 'strung along.' The important thing is to communicate your cultural difference to him. Let him know you come from a culture where becoming overtly physical rather quickly is not the norm. Tell him it is a matter of respect. He should be able to understand that. If he doesn't, that is his problem, not yours. Find someone else to get to know who is more respectful and understanding.
In America, ever since the sexual revolution of the 60's, sexual norms have changed. It is commonplace for dating partners to have sex early on, but that does not mean you or anyone else has to make the same choice as most people. I respect that you prefer to wait and I personally think you are smart to do so. Try not to worry too much. Things have a way of working out once we communicate our feelings and believe we can have what we need.