Uber is to YouTube as Conservation Scientists are to Mathematicians

Recently I organized sessions at two strikingly different conferences (1) The Society for Mathematical Biology (SMB) meeting and (2) The International Congress for Conservation Biology (ICCB). Both featured quantitative approaches, but presentation styles and modeling philosophies differed remarkably between the two conferences. You might be surprised to find out that the conservation scientists at ICCB were, on average, using more “complex” mathematical models than the mathematicians at SMB. How can this be? Shouldn’t mathematicians be analyzing more complicated equations? Answer: No, and it has to do with a trade-off between model “complexity” and model “transparency/tractability,” which I will explain below using YouTube video and Uber driver ratings.

Uber utilizes a 5-star rating system. When you take a trip in an Uber vehicle, you rate the experience from one to five stars (five being good and one being terrible).  Uber then displays the mean rating across the driver’s most recent 1000 trips. Similarly, drivers rate passengers the same way. These ratings are then used to determine whether drivers and passengers are allowed to remain on Uber.

YouTube’s rating system is quite different. They simply ask you to rate a video “thumbs up” or “thumbs down.” Youtube then displays the number of people who chose each option.

Why are these two rating systems so different and what do they have to do with model “complexity” and “transparency/tractability”? Uber’s model of a driver’s performance is complex: there are five choices for how to rate your driver, meaning each rating provides more detailed information than the like/dislike approach employed by YouTube. This creates a new challenge. Uber must now present more complex data to their customers. They opt for taking the mean, which removes information. Surely, a driver with 1 star and 1,000 trips means something very different from a driver that has 1 star and only one trip. But displaying the mean makes it easier for riders to digest the meaning of the rating.  One could potentially opt for a complex display that doesn’t remove such info, [e.g. a frequency distribution (histogram) of star ratings for each driver]. This type of information is provided by some websites, such as Yelp and Amazon, but in general, this approach is mostly avoided because a distribution is more difficult to understand than a single number such as 4.6-star rating.

XKCD comic on the 5-star rating system https://xkcd.com/1098/

The added complexity of the star rating system creates another issue. What exactly does a 4-star experience entail? One person might give 1 star for a small mistake. Others might reserve a one-star rating for things as extreme as physical violence. Model complexity introduces a new form of ambiguity, undermining the true meaning of a displayed star rating.

YouTube initially started with a 5-star rating system, but then they realized that the vast majority of people were rating a video either 1 or 5 stars anyway. So they ditched their 5-star rating system for the thumbs up, thumbs down approach. Netflix and other companies have followed suit. So what makes this system so great. (1) the viewer of the rating gets complete information and (2) there is less ambiguity as to what the rating means.

You might be thinking at this point, “why would Uber opt for this more complex and less transparent rating system?” I can’t answer this question, but I can take a guess based on my observations of conservation scientists and mathematicians at my last two conferences. Mathematicians are obsessed with understanding “why” things are true, while conservation scientists are obsessed with projecting the consequences of our actions onto the future state of the environment. For a decision maker, “understanding” only really matters when it leads to better decisions. Model complexity may in some cases improve predictability even if it is too complex to understand completely.

Since Uber uses its ratings to determine the fate of a driver’s employment, they are likely interested in predicting who will be a good long-term driver. A fine grain rating system might be required to make these predictions well (and there may be far more sophisticated things, behind the scenes, rather than calculations of mean star ratings, to do such predictions). At Uber, users can’t select drivers based on their rating so transparency to users may not be so important anyway.

To summarize Uber may be more like a Conservation Scientist and YouTube might be more like a mathematician.

 

 

 

 

 

 

Advertisements

3 thoughts on “Uber is to YouTube as Conservation Scientists are to Mathematicians

  1. Neat comparison!

    I’d like to push on one theme I’ve been wondering about in ecology generally. Reading this post, one question comes up: Why are more empirical ecologists / conservationists less interested in understanding how their systems work?** This probably sounds harsh, and I think many more basic-oriented ecologists would are working to learn how their systems work using empirical approaches. But regardless of basic vs. applied areas in ecology, I feel that more empirically grounded researchers generally have less appreciation for the internal understanding of a system which math can confer. Partly this arises from mechanistic and predictive (e.g. statistical) models often being lumped into the single topic of “modelling” (e.g., ESA session titles). But I guess my main question is whether the value of math as a tool for internal understanding (in the long term) is becoming more appreciated in ecology or not?

    **This gets to another fun question: to what extent do ecologists feel that the ultimate goal of our field is prediction or internal understanding? Its fun to think about where these goals are inseparable vs when they are distinct.

    Like

    • I think it is important that we separate general “math anxiety” from “wanting to understand their system”. I would suspect that most, if not all empirical ecologists want to understand their system. They may not have an appreciation for the understanding math can provide, or they may not think that learning math themselves is worth the effort. While every ecologist should be numerically literate, I’m not convinced that every ecologist needs to learn advanced mathematics as long as they are open to collaboration. I do not learn nearly all lab & field skills that experimentalists know, so why should I expect experimentalists to know the ins and outs of dynamical systems or probability.

      I’m not sure if math is becoming more appreciated or not. Nearly all of the theory journals have a declining impact factor, theoretical biology, theoretical ecology, mathematical biosciences, am nat, theoretical population biology, j mathematical biology, the bulletin of mathematical biology etc. all seem to have been declining in citations. I’m not sure why. I think there are two possible explanations, 1. modelers are more appreciated as they can now get their papers in higher impact (non-theory) journals, and hence the best modeling papers are no longer in theory journals or 2. people are reading/citing the theory journals less because there is a decreased appreciation for pure ecological theory. I hope the answer is 1, but not so sure.

      ESA sticking all the statistical modeling and dynamic/simulation modeling together has always been an extreme pet peeve of mine (as I got stuck in one of those sessions the first time I presented there). My recommendation is that for dynamic modelers to request the following sections: 1. Theoretical ecology or 2. a section that fits the basic research question, regardless as to technique used. I would tell all dynamic modelers to avoid any modeling section at ESA, as modeling is mainly statistical modeling.

      Like

  2. Pingback: Friday links: P values vs. your salary, MOOCs are dead, and more | Dynamic Ecology

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

w

Connecting to %s