Significance of the HTTP Date header
I have been doing some work over the last week that involves serving files with ActionController’s #send_file method. One problem I stumbled upon was that my
Cache-Control headers didn’t get respected and I was getting
X-Cache: Miss from cloudfront repeatedly when doing requests through CloudFront.
It turn’s out that the problem is that
#send_file doesn’t include a Date HTTP header when creating the HTTP response headers. The Date header is used to tell the client at what time the response was generated and it is this value that the client uses when calculating how long the local cache of the response is going to be valid. If it is not included the clients browser will not cache the response according to the
Cache-Control header and CloudFront won’t know how long to save the file.
It’s easy to fix, just add a Date header to the response where you use #send_file. For example:
It is important that your use
#httpdate when setting the date header so the returned string can be understod by the client.
You can read more about the Date header in RFC 2616.
UPDATE - October 30th 2011
After a bit of research I found that this issue looks to be related to that I am using passenger and nginx in the project where I noticed the missing Date header. I looks like the passenger guys agrees that this is an issue and plans to fix it.
This issue is kind of interesting; for example unicorn sets the Date header and thin doesn’t. It raises the question: What part of the stack is responsible for setting what response header?
The answer is pretty easy for most of the response headers but with Date I am not so sure. If I use
expires_in in my Rails app I expect that the Date header is set but if I just do a plain
response['Cache-Control'] = "public, max-age=3600" in a Sinatra app I am not sure if Sinatra should be responsible for the Date header. Maybe it should be the front webserver that ensures that the Date header is always set? I guess some more research is needed.
UPDATE - November 12th 2011
I did a patch for Rails last week that ensures that the Date header is sent when you use
expires_in. You can check out the pull request over at github.
If you got any comments or thoughts on this issue, let me know as I think it’s quite a interesting topic and would like to hear what other people think of this.
UPDATE - February 18th 2012
The patch was accepted and merged today. Yay!