All good, as far as USCIS cares, you have a valid legal status here from marriage. They would not give you a green card if the asylum case had any effect. Have fun, get married.