Can I set minimum and maximum values on a number custom field?

Yes. A Number field can be "Decimals" or "No Decimals", and you can set optional "Min" and "Max" values. If the minimum is not lower than the maximum, you get the error "Min value must be less than max value". On public forms, number fields only accept numeric input within those limits.