You can use your single entry visitor visa multiple times (within validilty period- usually six month) if you travel from US to Canada (FROM RECENT PERSONAL EXPERIENCES) 

But If you use it to enter from any other country except US, it's gone. You'll need a new visa to reenter (this is WHAT I HEARD from my international advisor and canadian consul at BUFFALO,NY)