It is indeed a crayfish hole (sometimes referred to as a "snakehole" in Michigan, even though it is not from a snake), albeit it has eroded from weather. If you have one in your yard, you likely have dozens, and they will range in their appearance due to soil and weather conditions.
Example 1 and Example 2.