Can customers attach files when submitting a public form?

Yes, if the form includes a file upload field. Create a File Upload custom field (Configurations > Custom fields), enable "Allow in external forms" on it, and add it to your form in the form builder. Customers then get an upload control on the public form.