They denied your asylum means they think you do not have any risk of going back home. So t hey cant punish you for something they already have decided. Besides your GC is from your work, so should not be any issue.