The perf drops are not that that radical. As the data grows, the number of ops performed increases linearly. Dividing by the number of operations, the per operation duration drops at a certain point but only five fold.