Although I am not a lawyer, it is going to be problematic, that is for sure. Logically, one is given a GC to stay in the country, not out of the country, unless you have a pretty good reason to stay out of the country.