I have seen this argument too many times.

First of all, I support your claim on getting a passport; even though from a nation's point of view, if my citizen is leaving me and seeking asylum from another country, I really shouldn't care about giving him/her any document, be it passport or anything else. I supported it because genuine asylum seekers will be at a serious jam for no fault of their own.

Now talking about envy and people criticism, well you should expect that. I wouldn't necessarily call it envy. Say, there is an apple tree and everyone is eligible for the apple as long as they put in an honest day of work. You work your ass off and go collect your apple, while Chankhey there is just sleeping idly through out the day. Then he goes and gets the apple, lying that he also was working the whole day. Be honest, you will feel a little mad about Chankhey gaming the system and getting the apple. That's not envy. Sure if the gardner is dumb enough to believe Chankhey and grant him the apple, it's his fault, but you still feel a little irate, woudn't you?

As for Criticism, you can't expect people to keep quiet when somebody asks a question like how an asylee can get entry back to his country w/o losing the asylum status. As much as you have the right to that status, the critics have right to criticize the way you have gotten it.

Hope you got my gist.