Divergent Events Labeling, Google Analytics, Sheets, Scripting

I’ve been assigned to a project at work that is going to require a significant amount of quantitative and qualitative user data to complete. Our main product is an app that was released in 2012, it’s on it’s 3 major version. Some significant bits about it:

  • Localized in 18 languages.
  • Content in 1600+ languages.
  • 120,000 total videos.
  • Android and iOS app.
  • Separate contractor development teams.
  • Managed by same internal person.
  • Android: 65% of users (~67,000 in 2017)
  • iOS: 35% of users (~36,000 in 2017)

Analytics Platforms

  • GA
  • Adobe
  • Crashalytics
  • ME2
  • Flurry
  • Currently testing AppSee and UXCam

As I’ve dug through data, I’ve begun to realize that our event reporting is inconsistent between OSes. Event labels have not been given precise and clear definitions. This is going to be a significant hurdle, so I’ve been seeking to sort that out first.

Signs of Trouble

The first sign of problems was discovered during the final feature build before the research project was to begin. One part of the feature integration was adding an icon/button to an already-crowded interface. The new feature was one that was to be highlighted as it was a part of an integration with an app that we wanted to promote the use of. It was clear that we were going to need to consider placing one or two previously-existing icons within a context menu to make room for the new one. We did not have the time resources to run a round of user testing to help determine how which ones were going to be harder to find, so I was asked to make recommendations based on analytics alone.

From the collected event data in GA, I discovered the following anomalies:

  • Of all of the events possible to perform with the icons on the taskbar in question, the “Sharing – Generic” action was reported as 90% of all actions.
  • Of the “Sharing – Generic” actions, 90% of those were Android (Android user share was ~65%).
  • For all other actions on this taskbar, 90% of the events were iOS.
  • “Sharing – Generic” was 98.5% of all Android actions for this taskbar.
  • “Sharing – Generic” was 30% of all iOS actions for this taskbar.

The UI for the two OSes are different but do not seem different enough to warrant such vastly different event reporting numbers.
I met with the development teams and discovered that they were using “Share – Generic” in completely different ways. For Android every single time a user touched this button it logged “Share – Generic” and only that event. For iOS they were logging it only if it was successfully shared using an app outside of the ones that had their own specific sharing event assigned, e.g. “Sharing – Facebook”, and some recent versions of the app logged the string of the app name, e.g. “com.apple.reminders.RemindersEditorExtension”.

Digging into the data

Prior to this point, I didn’t have access to some of the analytics platforms. I had previously been assigned only as a UI designer and was still onboarding into the UX role. I was granted access to Adobe Analytics and Flurry. The learning curve on AA was too steep for the quick turnaround that was necessary for the project, and I discovered that Adobe wasn’t consistently logging events to Flurry at all.
I decided to stick with GA to pull out the data that I could to begin a full event-logging audit.

I generated two reports and pulled them into a spreadsheet:

  • All events logged in 2017.
  • All events logged by any app version released 1 January – 31 May  2018 (This was to ensure completely different data sets.)

Using Google’s scripting features I scripts determine & extract:

  • “All Event Labels 2017” – Unique event labels and total events logged for each across all OSes and Versions used in 2017.
  • “All Event Labels 2018 Releases” – Unique event labels and total logged in each app version released in the first 5 months of 2018.
  • “Android Only”/“iOS Only”/“Both” – Which events were common or unique to either OS, that is which events were only logged in only Android, only iOS, or to both.
  • “None in 2018” – Which events were logged last year, but not logged at all in the first 5 months of 2018

I line-by-lined through “None in 2018” comparing it with “All Event Labels 2017” to determine which ones were likely to be deprecated intentionally, and which ones seemed to be accidentally dropped. Some of these were confirmed with conversations and live-testing in GA’s “Live View.” (Neither developer team had a comprehensive list of currently integrated events.)

Pursuing Solutions

I compiled a spreadsheet with the following categories:

  • iOS Only Reported
  • Android Only Reported
  • Both Reported
  • Reported in 2017, but not 2018
  • Confirmed Deprecated
  • Not reporting, but should be

I have asked the developers to look through the lists and confirm which ones should belong where along with notes of data parameters that are currently being collected with each.

After determining which ones are currently in use, I will work with the developers to define clearly what should trigger each event, which events need to be added, and how to sync up the two platforms to make sure they’re reporting the same, or at least functionally equivalent data.

Sooner be infidels

Once more—what a rebuke is our text to those professors who dishonor the name under which they profess to live! The Spaniards in America acted so cruelly, and with such a dreadful lust for gold, that when they sent their missionaries to convert the Indians, the Indians wished only to know whether the religion that was taught them was the religion of the Spaniards; for if it were, they should like to believe something the very opposite! And if there was no Heaven but where the Spaniards went, they would sooner go to Hell than be with them! Truly some professors’ lives give much the same savor to the Christian religion. Men say, “Are these Christians, these mean, covetous, quarrelsome, domineering, boastful people? Then we will sooner be infidels than Christians!”

Spurgeon, Method and Music, Or the Art of Holy and Happy Living

Law in a cheap mask

A friend of mine posted a review of the book PROOF: Finding Freedom Through the Intoxicating Joy of Irresistible Grace.

While I sometimes struggle with this particular doctrine, I find it often very encouraging. I would like to share one of the quotations that he also shared. One of these days I might ask him to borrow this book.

[su_quote]Whenever we find ourselves face-to-face with a living example of one-way love with no strings attached, our tendency is to change the subject – or to switch the story so that God’s grace doesn’t land in the lap of an active slave trader or our delusional next-door neighbor or a dancer in some sleazy downtown club. We live by law but call it grace. Such grace isn’t amazing because it isn’t grace at all; it’s law in a cheap mask. And whenever you show up at a party that’s hosted by the law, you’re the one who’s left with the bill.[/su_quote]

Sandy Hook, Franklin Regional, Fort Hood, KinderCare

A picture in front of KinderCare last night. Taken by @MarinaMarraco.

A picture in front of KinderCare last night. Taken by @MarinaMarraco.

Fia is a funny little kid, a few weeks ago she asked me to “put talking on” – we were listening to her favorite Spotify mix, but she wanted some NPR.

On Monday I dropped off my daughter at the preschool/daycare she goes to two mornings each week, this morning there was some piece about Sandy Hook on as we were pulling into the parking lot of her daycare in Winter Park, FL and I thought of all of those parents who sent their kids to school that day and never heard their voices again. Fia walks and runs like a champ, but she wanted to be carried in that day and I was more than happy to hold and hug her tight on our way in.

Wednesday afternoon, after we’d picked her up from daycare, after hearing about the stabbings west of Pittsburgh, I got a call from a friend asking where Fia’s preschool was and if she was there. He said something about a car running into a daycare in Winter Park and that kids were hurt. Even though I could see her curly mop focused on Daniel Tiger’s Neighborhood, my heart dropped out.

The Winter Park KinderCare is less than a 1.5 miles from Fia’s school. As we drive there, I know that we pass cars carrying kids that are headed to KinderCare. There are definitely children that live in our neighborhood, it’s just too close for there not to be.

As I carried my first baby in on Monday I thought about how much her absence would wreck me, not just her being at school absence or her one day going to college absence. But, if she was gone. If she was taken like little Lily Quintus is, the child killed by some big jerk with a big ego in a big truck, one of two things would likely happen. I’d either turn into Liam Neeson from Taken, but without the “particular set of skills,” or I’d end up a kind of empty shell for a while. I’d snap out of it eventually, I’d have a wife to love and comfort, a son to raise, and most importantly I have a God that is merciful. I’d eventually get to the point that King David did when his first son died, believing that I will see her again.

I don’t have a point that I’m aiming at. I’m just processing a little.

I used to get mad at these kind of things happening (I still do), but more and more often they lead me to hug my wife, my daughter and my son tighter and to try to soak up every minute we have.

I hope they find Robert Corchado, if it turns out that he really is the guy that caused this I hope they throw the book at him. I hope he goes to prison and is known as the guy who killed a 4-year-old. Eventually, my anger turns to mercy, my rage to forgiveness, my desire for justice for my desire for the same mercy that has been shown me by this God that sees the depths of our hearts and still calls to us.

Driving cars off the road. Shooting kids. Stabbing classmates. Escalating fights to the point of violence at work.

But for the Grace of God, there goes Jayson Whelpley.