Fix more size_t/int implicit conversions

Now the conversions are explicit and do checks. Not sure it's
the best way but at least we can see them now in the open.