Extra box above button widget

I’m trying to add a couple of buttons throughout a page, including in the hero. Every time I add a button, the button itself looks fine, but there also is an extra box that appears above the button. How do I remove that extra box?

Thanks.