Basically yes, can be used in such a situation.
) in the expression is sometimes written as (with the pronunciation ), _homeland_. So can be used as long as the speaker perceives it as his/her homeland.
As such in some cases may not be used or can be ambiguous - if A was born in the US and moved to Japan at the age of three, then A wouldn't seriously say to mean going to the US. Or if a 50-year-old American person B has lived in Japan for thirty years and he says somewhere outside Japan and the US, then it can be ambiguous - going to Japan or to the US (To me it sounds more like to the US, though).
* * *
**Added** If a Japanese says , then usually it means going back to his/her hometown for a long term/permanently.