Australia converted to metric when I was in early primary school, so that's what I've grown up with and am comfortable with. But I think if you use another system for any length of time, it becomes natural also. At work things are in feet and nautical miles (but kilograms for weight!), and that is what seems normal and right. If I have to fly somewhere like China or Russia then altitude is in metres, which is completely unnatural despite my metric upbringing. When I started back into CL I was thinking "what the heck is an ounce", but through frequent use, ounces are fine now. Same with balsa - 1.5mm is about 1/16", 3mm about 1/8", etc, and I don't really have to think about it.
I think that if you really want to be comfortable with metric, you just have to force yourself to use it and think in it for a while, and it will become natural. Otherwise, just keep doing whatever you're happy with, and that's fine as well.