I noticed when checking a customer's checkout information, that one of my Checkout Questions appeared double. On the product setup page, I do not have said question listed twice, nor on any other product page.

On other products where the product specific question isn't even listed, it does still show up somehow at checkout.

Edit: As a test, I removed all the checkout questions from all my Products.

If I add any item to my cart, the questions still appear. Any question that was set as "StoreWide questions" before removal, are still visible and I'm not able to do anything about it.

Is there anything I can do to fix this?