For instance, `nmod_mat_one` does not work with modulo 1. I'm sure that this is the only modulus that is problematic. Personally, I don't think we should allow modulo 1 since that only yield trivial results. Not sure how wide-spread this is. Edit: `nmod_mat_randfull` is also problematic.