SigLens: An OSS observability solution built from scratch, 1000x faster

Log management data is growing exponentially. As more and more businesses digitize, move to cloud, move to containers/kubernetes it puts a burden on the log management databases. Existing log management databases require thousands of machines to store and query the data. In this presentation we walk you through SigLens is an OSS observability solution, built from scratch. We have invented 3 new technologies that we built inside this database. 1) Dynamic, adaptive columnar compressions. 2) Dynamic micro-indexing, 3) Agile Aggregation Trees. These 3 inventions helped us achieve several magnitudes more performance than existing solutions.