I believe they look for your work history for the past couple years through your tax returns. As long as you haven't worked using SSN illegally with the past 3-5 years, you need not worry. I got my GC with similar situation as yours without any issue.