Which root cause analysis tool do you find useful?

[CarlosDubois]

Has anyone seen a great product for “root cause analysis”? (understanding why a metric has suddenly fallen 5%, or why variant A of an experiment is outperforming variant B etc).

I understand that it is a hard problem to solve with a lot of variables but I want to know what are the available state of art tools. Thank you!

[YuriRoman]

It’s called a data analyst

But seriously, Amplitude just released their beta feature called Root Cause Analysis. It works only for anomalies now (when there is an unexpected spike or a data gap). It scans the anomaly across all other available events and properties to help you locate the pattern, or a cause.

https://sisudata.com/ also claims to do this but I have not used it.

[CarlosDubois]

Thank you!

Does anyone have any feedback on sisu?

[RobMartin]

I have used SISU and there were a few challenges we faced:

1. It requires careful thought process on input variables. Similar to what Ankit mentioned, you need to rely on a bit of intuition on variables that could’ve possibly impacted the KPIs
2. Redundant output. Making it up let’s say - CVR was impacted due to steep CVR drop among 1. Males x Texas and 2. Males
3. Output may not always be actionable