You may not have problems returning to the US without AP if you have a H1B visa, but USCIS will abandon your I-485 case if you don't show up for the scheduled biometrics appointment. You'll have to start over in that case.