In order to implement an "outgoing connections only" policy the firewall needs to keep track of the connections initiated internally so it can allow responses back in without opening up the floodgates. There is no fundamental differance here between IPv4 and IPv6.
Whether your particular hardware supports that for IPv6 I cannot answer.