This line here was my problem:

Cache-Control "public,max-age=86400,s-maxage=86400,max-stale=3600,stale-while-revalidate=86400,stal>
}

If you want cache control you can just lower the values, I chose to just remove the setting altogether and the problem was solved.

Nailed it, that was the issue. Missed the line of code that had my cache options set too long. Thank you!