If you choose to remove the Subscribe app from your Facebook page follow Facebook's Help Center instructions on How To Remove an App from Facebook.

 

To help you find it quickly, here's an image of the app.