Resources:
Jeff Dean: "Achieving Rapid Response Times in Large Online Services" Keynote - Velocity 2014
Achieving Rapid Response Times in Large Online Services (Slides)
Basic latency reduction techniques