Hello all,
The company I work for has a SaaS B2B product, and I would like to monitor the web dashboard usage. For example how many users download a specific type of report or how many users view specific types of data in our web app.
Can someone recommend me a tool that can be relevant?
Thanks!
Mixpanel can be used here. You can check how many times any CTA was used between a time period. This way you can see how many times a report was downloaded or a filter was used on the analytical dashboard.
How difficult would it be to implement Mixpanel?
@AngelaBlue, Iâm going to disagree with the person you are replying to. They canât accurately guess effort here.
If your product is a data dashboard, Iâm guessing itâs a rich application making heavy use of JavaScript. If that is true, you likely have to do a moderate amount of work to meaningfully track user actions (events like viewing a dashboard, downloading a report) and relevant metadata about them (e.g. âspecific types of data.â) Google Analytics and Mixpanel track only universally available information out-of-the-box like URLs, page titles, browser info, but anything more complex than that is not going to be automatically tracked by their default installation. You should loop in an architect or the lead front-end developer early in your consideration since only they can advise on how difficult it will be to meet your requirements - this should be treated like an integration.
I would also advise not to skip this advice and simply ask your dev team to copy/paste the installation script as these tools frequently suggest. Worst-case scenario, you will be getting a bunch of invalid and hard-to-interpret data, like a bunch of sessions that appear to only have one page view to your homepage and 100% bounce rate because Google couldnât pick up on new history states of your application.
Lastly, Google Analytics does not give you a single view of any one customer, so drawing meaningful conclusions about user behavior takes a lot of guess-work and requires you to start first with a hypothesis and then try to figure out how many sessions met that criteria. Mixpanel is better in this regard since they do let you narrow in to the individual and find unpredictable behavior among each (like navigating back-and-forth between reports,etc.)
Tools like Heap, Fullstory, and Logrocket do autotracking, which means they automatically track everything they can about the state of the page the user was on every time they clicked or meaningfully interacted with something on your site. The downside (per the above article) is that everything is getting sent to a third party, so you need to make sure data that shouldnât get tracked to a third party is explicitly excluded. Itâs also a bit obscure to try to model all of the clickstream data they capture from their tool into meaningful metrics for long-term reporting, and they may not actually retain data very long because they capture so much. Your rules can also break as soon as your developers change something about the front-end that you were relying on staying the same. For instance, you can set up a metric that counts how many people clicked a button with the inner text âLog inâ or how many people clicked a link with the HTML class âdownload-reportâ, but if those attributes change on your site later, those rules will break.
The upside is you can learn a TON about your customers if you are willing to spend time with the tool and you donât need a significant developer resource to install them since they do a lot out-of-the-box.
If the question is âhow do I know what users are using on my applicationâ I frequently advise something that looks like this:
Install an auto-tracker with session recording built-in, like fullstory or Logrocket
Check in on day 2 to make sure it installed OK, but then let it collect some data for a few days
Come back and spend a day observing user sessions. Take lots of notes - what is remarkable and noteworthy about each session? What surprised you? Which behaviors would you like to measure over time, and do you want to know that per-page, per-session, or per-user?
Build your tracking requirements off of this - youâll probably find a lot of events and application states you didnât think of
Install something like Mixpanel or GA off of those requirements so you can reliably track those data points and events over time, and use those tools for your trend analysis, cohort analysis, acquisition and attribution analysis, etc.
Check in on your session recording tools a few weeks before you plan your next release so you know there arenât any new surprises, and monitor them for hypercare after any higher-risk release.
What a great answer! @Michael, This is great. Can you also use HotJar for step 1?
@DonovanOkang, HotJar is the example I give of why the MVP mindset doesnât always work in a high-competition space. I got an invite to their product when it first came out and it had so many limitations that it wasnât a good substitute for any other UX tools in our stack. Like you could only collect X session recording per sample and had to install new code if you wanted more. It is probably better now but I already wrote them off.
It looks like they have some of the functionality of the aforementioned tools. Session recordings, yes. Event filters? From what I can see of their docs thereâs no autotracking, so you would still need to be explicitly passing in event data to meaningfully filter sessions. And thatâs only with their most premium tiers and without any metrics functionality. So you could watch your hundred sample sessions and make your generalizations, but then trying to size up that behavior in Hotjar to verify itâs âworth formal trackingâ is going to be a bit harder
Itâs not much difficult. Mixpanel has support documents for the team to add the code and test it. A dayâs work.
Mixpanel is a little difficult to implement as you have to send all the important events using code to it. You can try Browsee as they have a good free plan as well It is a session recording tool that automatically tracks all the user events and gives an exhaustive search over them. Also, it has a lot of options for privacy settings where you can choose what to record and what not to record.
Thank you! I will check it out.
Amplitude
Google Tag Manager + Google Analytics
Do you have any good resources on implementing this approach. Iâve joined a company with Google analytics which is fine for getting hits on pages but Iâd like to see more details like where they fall out of workflows, etc. Not sure Google analytics is suited to that.
In our platform we have inbuilt events, which are added to track the things weâre interested in, such as user creates an account, user creates or modifies a widget, counts of usage of a new feature. This is all pushed into a central postgres database and I have built a daily report in PowerBI which we use to monitor how things are going.
Part of each new development process is some thinking about how we track its usage.
Anything more specific we can ask the development team for a SQL query to be added to the schedule, so we can track non event data via the same DB into PowerBI.
Customer Satisfaction is the end goal we all want. Software tools that track clicks are the most obvious options but end users have to pay a heavy price usually in terms of the performance and then there is also the cost factor if you have to deploy it to a lot of customers.
We have instead resorted to:
@MarcoSilva, The performance point is moderately ridiculous. Most trackers including the default Google Analytics and Adobe Analytics pixels get loaded asynchronously and send data asynchronously. The libraries are under 100kb and get cached the first time a user loads your site, and the data requests are typically under 2kb unless youâre sending huge payloads. But again, all of this is happening async, so your only consideration is if you are serving to users on a metered connection.
@Michael
There are two primary goals to measure product usage - Room for improvement in your tech solution & room for improvement in user behavior(clicks to perform a particular operation). Once products start to mature, Product strategist and PMs are forced to spend bulk of their time to make existing features one bit better with each release. New innovation is hard to come by. Take for example Apple - They are differentiate iphones by the number of camera and for that matter, smart phone industry hasnât seen any revolutionary innovation in the past 5 years or so.
Google analytics doesnât even scratch the surface when it comes to the detailed sequential field level tracking across multiple screens needed to understand user behavior when trying to bring change in behavior. Lots of companies, including mine are focused on saving every single click. And If the nature of workflow requires a doctor to click 20 times to load screens, not counting the clicks for documentation, every additional micro sec will count. Lots of software companies boast about their product performance and I am fairly positive this is important in many other industries. I donât think a stock trading software showing live values would want to put additional load on the processors by deploying a click tracking tool. But then again, I am learning new things everyday and so I could be wrong.
@MarcoSilva, Did you develop this in house? Was this a lot of effort?
First we developed our own internal CRM software and then built all reporting on top of it. Our company believes in doing it ourselves. They even tried to develop a word editing tool instead of using word⌠lol That didnât go that far!
So this seems to have been somewhat alluded to, butâŚ
Find out whatâs being used now. And sort out the usefulness of the numbers you want so when you make your ask of the dev team, youâve got all your actual product needs covered; rather than just a simple count.
@NaomiNwosu, Thanks for the response.
Nobody does usage monitoring here.
When a customer purchase license, he receives credentials and can access our Web Application which is unique per customer, different dashboards and data. I would like to monitor features inside the Web Application and if possible even per customer. I am not sure this is possible with tools such as Google Analytics / Adobe.
I plan to work with R&D but first before I come up with tickets to develop something in house, I want to check if there is already available solutions that can save us the time to develop it in house and spend time on development that sometimes can be very expensive.
I am not sure exactly what I want to monitor, once I will have the tool I will add the tracking wherever I want, for example, to count how many users download a specific type of report, visit a specific page, use a specific button.
With most tools, there are ways to get around internal permissions, including Google Analytics. Thereâs just a little more work to do so.
When you say you want to count report downloads, use a button, etc. Iâd also suggest you develop an âEven Taxonomyâ for such things. That is, there are some singular events of importance, (like a report download), that are maybe somewhat different than specific UI / UX button click events, which you might want to roll up into other category level reports.
The really fastest, cheapest way to do this sort of thing is Google Analytics. Again, I kind of prefer to own my own data, even if that means more expensive Enterprise software buys. But⌠if that means youâd have to run the procurement gauntlet and justify the price⌠just slap Google in there and be done with it. Youâll also get the funnel reports, can set up goals, etc. And it should not be hard for dev to implement all this.