Strangely seeing nginx welcome page on http with letsencrypt

Actually, I spoke too soon. Now I get this after I clear my browser cache:

400 Bad Request

The plain HTTP request was sent to HTTPS port

I don't have much experience with letsencrypt, so I will need to do some more research.