From your problem, you know that every person has to get an orange and one other fruit. Then your problem reduces to "In how many ways can we give two bananas to 4 people?" In this case is equivalent to "In how many ways can we give two lemons to 4 people?"The answer is $$\binom 42=6$$