The non technical explanation of the reason we like to use them "or need them" is not only encryption but within that tunnel we can supply routes to your computer or remote site that are private networks through the tunnel. This allows Site A to not only connect to Site B but I can have routes to other internal networks at Site A from Site B over a public circuit like the internet.
Examples, with normal communication I can connect to a remote ip address but not access all the internal private ip addresses because the internet doesn't support those addresses of course.
If I put a tunnel between two sites I can access networks like 192.168.1.0 for example even though it's in a diffrent location. It's almost like combining Lans.