Yeah, i have heard the same thing and i think it is even on the website of USCIS. It states that one needs to apply Refugee Travel document, if you are travelling out of United States. We are not suppose to use Nepali passport. If we use it, it is like seeking protection from that country.

I am not an expert about it. Just sharing what i know.

Best Wishes!!