nobody can answer u correctly unless u get through it by yourself..but yes you have some red flags, for me, without knowing you, without being bias, i can make an assumption that u married that guy to get a green card, this is how i look, so will be the impression of official when looking at your USCIS database at a glance,

as u might ve aware that condition green card is bit unbreakable and can be revoked easily, good idea wil b wait for some time..also u have to analysis the fact that what u gonna do if u stuck in Nepal for at least 2 years?? hows u guys gonna mention ur relationship, will he gonna wait for u until then.. so many things has to be taken care of.. also is it justifiable to make him wait for infinity years until u come back n settle..
these r some worst scenario that might happen in ur case