2

Lesson 2 of 20 · Evidence & Research

Scenariointermediate

See It to Believe It?

What You'll Learn

Can you always trust what you see? Optical illusions trick your eyes! Sometimes you need more than just observation — you need multiple types of evidence. At this level, observational vs other evidence requires you to move beyond surface-level thinking and engage with complexity, nuance, and ambiguity. At this level, you're ready to move beyond surface-level thinking and engage with complexity. Real-world problems rarely have simple answers, and developing comfort with ambiguity is a crucial skill. Here's a framework for approaching observational vs other evidence: 1. Frame the question precisely. Vague questions lead to vague answers. Instead of "Is this good?" ask "What are the specific benefits and drawbacks, and for whom?" 2. Examine the evidence critically. Not all evidence is equal. Consider the source, the methodology, the sample size, and potential biases. Strong evidence comes from reliable sources with transparent methods. 3. Consider multiple perspectives. Every issue looks different from different viewpoints. Before forming your opinion, genuinely try to understand why someone might disagree with you. This isn't about being wishy-washy — it's about being thorough. 4. Watch for thinking traps. Confirmation bias (only seeing evidence that supports your existing belief), anchoring (being overly influenced by the first piece of information), and false dichotomies (assuming there are only two options) can derail even careful thinkers. 5. Build your argument with structure. A strong position has: a clear claim, supporting evidence, logical reasoning connecting the evidence to the claim, and honest acknowledgment of limitations or counterarguments. 6. Apply second-order thinking. Don't just ask "What happens next?" Ask "And then what happens after that?" Many unintended consequences become visible only when you think two or three steps ahead. Use this framework as you work through the scenario and questions below.

Key Concept: Observational vs other evidence

🎭

Think About This

A historical event involved a failure of observational vs other evidence. Analyze what went wrong, what cognitive biases were at play, and what could have been done differently.

Thinking Steps

🔍

Frame the Question

Define the core question about observational vs other evidence precisely. What assumptions are built into how it's framed?

🧪

Assess Evidence

What evidence exists? Rate each piece as strong, moderate, or weak. Note gaps.

🧪

Generate Hypotheses

Develop at least 3 possible explanations or solutions. Include one unconventional option.

⚖️

Evaluate Systematically

Test each hypothesis against the evidence. What are the trade-offs? What are the risks?

⚖️

Think Ahead

If your conclusion is correct, what are the second-order effects? What implications follow?

🎯

State Your Position

Present your conclusion with confidence level (%), key reasons, and what could prove you wrong.

🪞

Metacognitive Check

What biases might have influenced you? Did you use the right thinking framework? What would you research further?

Key Points

1

Master observational vs other evidence

2

Apply evidence & research in real situations

3

Build habits of evidence & research

Key Vocabulary

Steelmanning

Making the strongest possible version of an opposing argument

Epistemology

The study of how we know what we know

Falsifiability

The ability of a claim to be proven wrong — a requirement for scientific validity

Dialectic

Finding truth through examining opposing viewpoints

🌍

Why This Matters in Real Life

The evidence research frameworks you're learning are applied daily in business strategy, scientific research, public policy, and personal decision-making.

Talk About It

Discuss these questions with a friend, parent, or classmate.

  • 1Find a current event that illustrates observational vs other evidence in action. What can we learn from it?
  • 2What are the limitations of this thinking framework? When might it lead you astray?
  • 3How would someone from a completely different background or culture approach this differently?
  • 4Design a challenge or game that would help someone practice this skill.

Check Your Understanding

Question 1

1 of 3

What is the main idea of observational vs other evidence?