I think I'm on the same boat as the thread-started.

I had been ridiculed in my secondary school in Nepal because of my English accent by my schoolmates. Oh how I desperately wanted the non-Nepali subjects like Maths, physics, and other courses to be taught in English and how I would ask in English to the teacher lol. Apparently there weren't many students who'd ask in English in the class, even though the school was a descent one. This continued in the High-school and a couple years of college there. Those are indeed nice memories.
Now when I have conversation in here, and in between the conversations people usually ask me if I grew up in here.

About your question, I think I'd take it as a compliment.