I'm not religious, and I find most English-language religious lyrics embarrassing to even read. But somehow I don't mind when it's in Latin. I've never quite understood why - perhaps I can treat it more abstractly as "that's what those people, of a different culture than me, believed, and used to create fabulous cultural objects".