A few months ago, I was confronted at work with the following use case: “Analyse the data of some selected clients”. It seems easy, but not if there are billions of data and there can be millions of clients to analyse and it needs to run as fast as possible!

In this post I’ll describe the solution I found but most importantly, how I came to this solution.