I'm answering my own question since it hasn't gotten any answer and the solution suggested on the comments worked like a charm.
I solved this by enabling `CONFIG_NUMA` in my kernel configuration and rebuilding it. After booting my new kernel I could enable `sysctl vm.zone_reclaim_mode=1` without a hitch.