Chief among the challenges of operating large-scale MapReduce pipelines in production is managing the performance of the underlying distributed file system. When processing more than 30 petabytes of data a day, as we do here at Quantcast, file system performance is critical. We’ve previously discussed a few things we’ve done to help ensure that our