I had a similar issue on FreeNAS 9.3 and could not find a remove button. I got it to disappear by going to the jails volume, and removing the directory which held the jail:
# rm -fr /mnt/black/jails/.couchpotato_1.meta/
This also removed the complaints during boot. No negative side effects seen yet.