I made a new QuickForm contact form. The form submit button is creating an extra useless button. The working submit button has the value of the Submit Button's Label field.
The useless button has the content of the Value field. If that field is left blank, the button still shows up, but appears as a small circle on my template because there is no content, but the button is still there. Clicking on the button does nothing. The attached images have either a value of Bad Button, or the field being empty (so you can see that the button is still created.