Lol I would take it as a compliment if someone was mistaking my accent for Swedish or South African! The South African accent is lovely and I always find that the Swedish have the best English accent of all the non-native English speakers.

But yeah it's weird. When I was in Australia about 5 year back ( time surely flies!) first people thought I had a German or a Dutch accent. That was gradually changing to various Scandinavian accents, until after half a year they thought I was from New Zealand (and in New Zealand they figured I was from Australia). Which is about the best compliment I had on my accent .