Loki 3.0 Released
5 points by sandstrom 1 year ago | 1 comment- sandstrom 1 year agoKey features mentioned in the release notes are:
Personally, I'm thrilled that the problem with high-cardinality labels will [hopefully] get addressed after 6 years (that's the top item, with bloom filters).- Bloom filters for queries ('needle in haystack' problem) - Native OpenTelemetry support - Updated helm charts - Lambda/Promtail support dropping labels - Docs improvements
The architecture Loki has chosen is great for keeping costs down and using simple blob-storage (S3) for data. However, it makes it hard to quickly query unique keys such as trace IDs or user IDs. But bloom filters will hopefully will do the job.
I raised the needle in haystack problem back in 2018, so it's great to see this landing:
https://github.com/grafana/loki/issues/91
For anyone that's curious, bloom filters is a clever technique: