a stumbling block
a problem which prevents someone from achieving something.
Lack of willingness to compromise is the main stumbling block to reaching a settlement. (often + to)
Money, obviously, is a major stumbling block in any project of this size.