I would have to say no.
refers only to the kiwifruit to at least 99% of Japanese-speakers -- perhaps even more.
Those who have lived in New Zealand or Australia **_might_** refer to a New Zealander as among themselves, but that kind of private usage still would not count as an established meaning of the word within the Japanese language.