| | |

Sample Size of One: The Rose Negotiations

ByShrutin Shetty

Image: source

The Replication Crisis is an ongoing crisis where it has been difficult or impossible to reproduce findings of scientific studies.

The field of behavioural science too, has had its challenges with replicating past research findings. Some years ago, peer-reviewed scientific journal, Nature Human Behaviour, attempted to replicate 21 social and behavioural science studies published in the top peer-reviewed journals, Nature and Science. It could replicate only 13. Other such studies conducted too, resulted in disappointing results.
 
Is it surprising if behavioural science and behavioural economics research findings are difficult to replicate? Till recent decades, many studies were undertaken by professors on captive university students; a long shot from representing world diversity. Findings from one country could throw up different results in another country based on many variables like the history of that nation, recent and current economic progress, poverty levels, trust levels, level of ethics in government, enforcement and business, among other factors. We see diversity even in our interactions with foreigners on social media.
 
And yet, we as humans, are always trying to find a simple common denominator. A thumb rule. A recipe or formula that we would like to think would apply to the world population.
 
Instead, what if we looked at behavioural science endeavours the other way around? Why struggle to have larger and more diverse sample sizes to represent world diversity and improve study accuracy? Instead, what if we started with a simpler sample size? One that we are more sure of, and that offers more accurate data points. What if we start with us as individuals? The observations, feelings, rationale or reactions of the individual (hence ‘Sample Size of One’)? And from there, cautiously see if and to what extent, it applies to other individuals or groups?
 
Whenever we experience a situation, we could try and assign values to various parameters. Then, similar situations created for others in other parts of that city, country or the world, would give us more data sets. We could then look for a single line passing through diverse cultures, or spot similarities in diverse groups. Similarities in similar groups from contrasting countries too? Or not.
 
What we will have, is readings across these situations or experiments across countries and cities. At present, if an experiment with a sample size of 10,000, finds 70% respondents behave a certain way in a scenario; we extrapolate it and believe 70% of world population might behave in a similar way.
 
Instead, what if we had that scenario, but had different data sets for different locations? That way we might find clearer patterns (there goes the human in me again) among groups in diverse cultures where a certain improvement intervention might respond similarly to another one which had similar outcomes from an experiment.

This thought occurred to me during a recent festival and an interaction with a flower woman in the market. Here’s the story.

Sample Size of One: The Rose Negotiation

My family is a bit religious. During Dussehra puja a few weeks ago, I was back at the market, buying flowers and fruit.

A woman in the market has a flower stall and sells bouquets. I always buy roses from her. On regular days, a rose costs INR 10. On festive days, she sells them for either INR 12 or 15.
I asked her how much for one.

“INR 15”, she smiled and replied, “but you can have them for INR 12. How many do you want?”

I asked for ten. Like always, I asked her to cut them to a particular length. I said I’ll pick up the other stuff on my list and come back for the roses.

Back at her stall 15 minutes later, she said the total was INR 150.

I said, “but didn’t you say you’d give them at INR 12 a piece?”

Now she seemed confused, like she had goofed up the prices.

In the past too, I have always paid her the full price, whether she offered a discount or not. After all, these vendors pay a premium to buy flowers during special occasions. And on that day too, I had intended to pay her the full INR 150 either way.

But there’s the funny thing.

When she first offered a discount and later forget about it, I felt a mild disappointment or something. And it is possible others might have felt the same way in that situation. It is odd, since I was ready to pay full price, right? A loss aversion of sorts.

Trying to quantify my feeling on a Disappointment-Delight scale [-10 to +10] (-10 being very disappointed, 10 being very delighted), I got:

  1. If I go to the stall on a regular day, and I am charged INR 10 for a rose: 0 (on the scale)
  2. When the woman first quoted the festival price of INR 15: -5
  3. When she said she’ll let me buy them at INR 12: 5
  4. When I made a mental note to still pay her INR 15 a piece: 9 (it is always priceless to expect and see smiles on the faces of those who work hard to make a living, when you pay them full price and not be the asshole who squeezes an extra buck out of them)
  5. Her later quoting the original rate of INR 15 a rose: -8
  6. Me then paying her the original rate of INR 15: 3

Despite my intended payment amount and her final quote being the same, my delight level dropped from a 9 (in pt. 4) to probably a 3 (pt. 6).

-End of story-
 

What do you think? Could experiments/ experiences like this one, experienced by a single person, be then gauged on a list of parameters for other people in the same city, country, and in other parts of the world? The objective not being to find a single global thumb rule or measure (like 70% or 8/10 on delight). But rather, to see how different groups of people fare on each such experiment/ experience. It need not be a labour-intensive effort. Data could be crowd-sourced.

Could this approach be a little less presumptive and a little more accurate than prevailing forms of research studies?

Read about a possible alternate solution that I propose, here: Sample Size of One: Towards a Possible Solution
 
#SampleSizeOfOne #BehaviouralScience #BehaviouralEconomics

Similar Posts

| | | |

Dr. John Virapen on the Greed of Pharmaceutical Companies

ByShrutin Shetty

Dr. John Virapen on the Greed of Pharmaceutical Companies Sometimes when you think about one particular country or another, and admire it for a great government, a transparent press, a robust healthcare ecosystem, and so on. Or when you believe the doctor when he tells you your child has an attention-deficit disorder, as he or…

|

The Race Against..You.!

ByShrutin Shetty

The Race Against..You.! In this post, I am sharing my experiences while preparing for a cycling event held in Bombay last December. While it’s a little overdue, but whether you’re a cyclist or not, I am sure you’ll have some takeaways from this one. I was working in Pune till last July, and had just returned to Bombay….

Why…Not…Serious.??

ByShrutin Shetty

Nobody panics when things go “according to plan.” Even if the plan is horrifying! Look at what’s happened in India over the past two decades. We’ve had bomb blasts ripping through cities, over and over again.
The news channels have ‘field days’. Give it a few days, and everyone has put the incident into some low priority folder in their heads, and gone about with their routine like it never happened.
Now while resilience is a good thing, everyone’s missing the bigger point. Why can’t the security forces, the police, the intelligence agencies, and even the common man become more responsible.

| | | | |

Gucci’s Packaging – Not so Gucci

ByShrutin Shetty

Gucci’s Packaging – Not so Gucci I recently conducted an interactive session on Design Thinking at a leading investment bank. It might be easy to assume that applications of design thinking at an investment bank are limited. It is quite the opposite though. And the applicable scope of design thinking just seems to grow bigger…

| | | |

Product Design should factor Human Forgetfulness

ByShrutin Shetty

Product design should factor for human forgetfulness where possible. This is a picture of the detergent tray from a leading brand, top-loading washing machine. The hole in the tray is where detergent, mixed with water, drips into the drum during a wash cycle. However, when the tray is opened to fill detergent, you notice it…

The Different Same

ByShrutin Shetty

On October 31, 1984, a lady was assassinated by 2 men from the Sikh community. What ensued was over 3000 Sikhs being massacred by a crazed people, in a span of under 4 days. Think about it, under 4 days, 3000+ innocent Sikhs were killed, because 2 “other” Sikhs killed that lady. And what about justice? 49 of…

4 Comments

  1. Insightful read, Shrutin. Give how human we all are, I wonder if our inability to replicate has less to do with the experiment and more to do with our ever changing human behavior, driven by context, thereby almost never being exactly the same in similar scenarios. Unless you create an experiment which itself nudges the recipient to make one of the many choices as intended from the experiment(what’s the point, then?)

    Secondly,
    If only all the vendors knew about passing on the effects of peak end rule to their customers

    Reply

    1. Thanks for reading, Deepti. Glad you found it insightful.
      You are absolutely right about ever-evolving human behaviour being difficult to condense into a rule or template.

      I do have some broad thoughts around the idea of an evolving experiment that you mentioned. Let me make a little more sense of it and then post it here. Soon.

      Haha, well, guess the peak-end rule works both ways, for customers and vendors. Though quotes like “the customer is always right” sometimes tilts the scales and raises our entitlement levels as customers.

      Thanks again for your comment. It did get me wondering about the next steps in terms of what an experiment then might look like.

      Reply
  2. Pingback: Sample Size of One: Towards a Possible Solution – Crystal Planet
  3. Pingback: The ‘Sample Size of One’ Concept Simplified – Crystal Planet

Leave a Reply