Do I need a telephony router to use CUCM My Cisco telephony router is loud and is currently using CME, I wondered if using CUCM I can use my 1841 router that doesn't support telephony Or does cucm need a telephony/voice router to work?

CUCM is not a single device, it is a software suite for controlling large enterprise telephony. You still need gateways, etc., so your router will not be enough.

It would be like building a railroad when a bicycle would suffice.