you don't need your passport! You can show your EAD which is a proof of your immigration status along with your identity itself.

I have renewed my DL with just i-94 itself back in 2019.