There's not really a hierarchy. It's really more of a web. There are national (or international) ISPs that connect to a large number of other ISPs. There are smaller ISPs that connect to only a few other ISPs. Then there are large companies that have their own backbone (Google, Microsoft, Amazon, Facebook, etc).
There's no "rule" about who can connect to whom. Small ISPs do not have a national or international presence, so at some point they need to connect to larger ones to have world-wide connectivity. But they also can connect to other small ISPs. ISPs negotiate connectivity with each other as their business needs require. Since it costs money to "peer" with another ISP, each one tries to get the most connectivity for the least cost. The "Tier" designation is kind of arbitrary.