There are protocols like AoE (ATA over Ethernet) that allows communication without IP. The problem is that such protocols aren't that common. In fact, I can't see any at the moment, except for dinosaurs such as the old file sharing protocols of yore like Banyan Vines, DECNET, etc.
There's a reason why IP took over after all. The overhead doesn't represent much anymore to our hardware, and adds flexibility.