How to Fix Firefox's "Connection Not Secure" Issue on Your Website

Disclaimer: This is a fix for a specific problem I had. Your mileage may vary.

Problem: The website is set up for HTTPS but Firefox is showing part of the connection is not secure. Its usually symbolized by a yellow triangle with an exclamation point over the lock in the URL.

Firefox's Connection Not Secure Message

My Setup: