The Practice Of Soft Eyes

Strange, we are at ballroom dancing. Every time I get to dance with this person he looks directly into my eyes. He has a very pleasant and soft look and I get intimidated and look away. What should I do, I know it is not polite to react like that.