@advice_7 in that case you can let it be. They will send the EAD to the address that you filled out in your application. The EAD is taking so long this time, so I think you can just wait it to be delivered to the secure address that you say you've used and not risk changing the address in USCIS to your current address as you're saying it's temporary as well.
I have done similar thing few years back. I moved and I didn't change my address in USCIS and used my friend's address for delivery of any notice of actions or EAD card. It worked, it was delivered to my friends and he sent it to me.
Good luck.