I don't think there is any risk, at least from the US side, as long as you have the travel document (Advance Parole) with you.

I was stopped of all places at Kathmandu airport when leaving Nepal because they could not figure out what the document is.  I am not sure if they were angling to extort some money or they genuinely had not seen a US travel document before.  However, later the so-called haakim gave the green light stating, "khoi... Homeland Security ko chaap cha, thikai hola ni."

At the port of entry in the US, they might ask you to step aside to verify the document, which is routine.