Friday, November 13, 2026

SearchResearch (11/13/26): New series on "Getting the most out of your AI-powered searches" - #1 - Be careful of those summaries

 Let's start up something new! 


I've been busy with teaching my AI class at the University of Zürich, taking advantage of being in central Europe by visiting various places for fun or for work.  Strassbourg, Munich, St. Gallen, Brugg in the past few weeks, with Graz (Austria), London, Cambridge, Basel, and a few others still to come.  (In other words, I'm a bit busy.)  

I'm constantly asked questions like "What's the one thing I need to know to make my AI-powered searches better and more accurate?"  

The short answer is... there is no short answer.  That shouldn't be a surprise--the AI-powered world is even more complicated that the old regime. 

I thought I'd try to improve the state of the world a bit by doing a bunch of short tips in the blog.  

So.. my plan is to do a bunch (at least 5 or 6 over the next couple of months) and see if I have more to say when I get to the end of the short list.  We'll see.  

Let's start off with a pro tip:  

Be careful with those article summaries! They sometimes leave out important content! 


People use AI for summarization all the time--it's probably the most common use case.  Google Scholar, Acrobat, YouTube... basically every publishing platform offers some kind of summarization shortcut.  Don't have the time to read the whole article?  Do this instead!  

But (and you knew I'd say this), you have to recognize that what the AI thinks is obvious and can be skipped in a summary, YOU might not know about.  

Example: you might say to to summarize this paper (Bastani, et al., 2025)about the use of AI in education) in 3 bullet points.  Here's what you get: 

 • In a field Randomized Controlled Trial of ~1,000 math students, unrestricted ChatGPT (GPT Base) boosted practice scores by +48%, but reduced subsequent closed-book exam scores by −17% relative to a no-AI control group.

• A safeguarded version (GPT Tutor), prompted with teacher-designed hints instead of direct answers, boosted practice performance by +127% while protecting long-term student learning.

• Takeaway: Deploying pedagogically guarded AI tutors eliminates the crutch effect and maximizes math achievement.

 

Suppose I ask you this key question:  Should your students use this computational tutor?  It's clear that freshmen score higher on their closed-book final exam than traditional unassisted practice.

Does GPT Tutor beat unassisted practice on the exam?

The summary is kind of okay, except that it leaves out important details.  Look at the original prose: 

“In stark contrast, in the subsequent unassisted exam, student performance in the GPT Base arm degraded by 0.054 (out of 1) relative to that of the control arm. In other words, GPT Base diminished the average control student's performance on the unassisted exam by 17%. Student performance in the GPT Tutor arm was statistically indistinguishable from that of the control arm, and the point estimate was smaller by an order of magnitude (−0.004). The fact that students in the GPT Tutor arm performed similarly to students in the control arm on the unassisted exam may be surprising since they performed so much better on the practice problems. This difference may be partly explained by the fact that students with access to GPT Tutor during the practice session could ask it to check their answers, whereas students in the control arm were only shown the solutions after they had already submitted their answers.”

See the problem?  

Based on the AI summary, would you recommend that the students use GPT Tutor to improve their scores?  Suppose it cost $100,000 for your school to subscribe.  Would it be worth it? 

There's an interesting nuance here.  The summary makes it seem that the AI tutor leads to a huge gain.  Of course it would be worth the $100K.  

But read that summary carefully: Putting the '+127% practice' beside 'protected learning' caused readers to interpolate an exam boost. In reality, GPT Tutor merely had the same score as pen-and-paper (−0.004), as is clear from the full text.

Why does +127% improvement yield 0% transfer in the end?  

A: Because of a nuance in the text.  This difference may be partly explained by GPT Tutor letting students check & repair answers BEFORE submitting (and thereby inflating practice scores), whereas control students had to commit before seeing feedback.  That's a big difference.  

The big problem with AI summaries is that they don't know what's important, just what is most probable... 

As you know, everytime you squeeze a book to condense it, summarize it, or AI-ify it, there are things that get lost along the way.  It's a bit like taking a vitamin pill instead of the meal: You get the extracted nutritional "takeaways," but you lose the fiber, the satiety, and the pleasure that made the meal worth eating in the first place. 



In another case that happened to me recently, I read a summary of a technical paper about the way in which AI image editing (e.g., to remove someone from a pic you took) can lead to false memories. 

That's quite a finding, so I read the paper carefully. And in the process found something really interesting:  the summary did NOT mention that Elizabeth Loftus was one of the co-authors of the paper.  That doesn't sound important, but Loftus is one of the giants of this field (of false memories). NOT including her in the summary is like summarizing the American Revolution and not mentioning George Washington. 

The point is that AI summarization doesn't know what's important to keep, toss out, or highlight.  

So while AI summaries are incredibly handy (I use them every day), if you care about really knowing something, you still have to read it with care and attention.  

Be careful with those AI summaries!

Keep searching.  (And keep reading!)  



____________

That paper I mentioned above about AI image editing and false memories is: 

Pataranutaporn, P., Archiwaranguprok, C., Chan, S. W., Loftus, E., & Maes, P. (2025, April). Synthetic human memories: Ai-edited images and videos can implant false memories and distort recollection. In Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems (pp. 1-20).


The paper I mentioned about measuring the effects of AI on education is: 

Bastani, Hamsa, et al. Generative AI without guardrails can harm learning: Evidence from high school mathematics. Proceedings of the National Academy of Sciences 122.26 (2025): e2422633122.






Sunday, October 18, 2026

SearchResearch (10/28/26): How do you know when the AI is wrong? What then?

You can't fact-check everything... 


... there's just too much.  It's the proverbial drinking from a fire hose... even if you're just a dog on the internet.  (Slightly obscure reference.)  

The past few posts have been on a related problem--how to use AI to help find relevant information and check on the accuracy of things.  

But if everything is suspect and you're drowning in content, how do you know when to spend the time and effort on checking?  


You might remember this example from a while ago. Here's the photo I took: 


When I asked Google Lens what this tree was couple of months ago (July, 2026), here's the answer I got... 


I know for certain that this a California Buckeye (Aesculus californica)--you can get all of the details from the authoritative source, CalFlora.  

As I said back then, Google search-by-image (aka Google Lens) gets it wrong. I can't really blame it because it looks a lot like a California Sycamore (Plantanus racemosa) in its fall foliage.  But it's only early July, so that can't be right.  

Even stranger, when I ask Google Lens today (Oct 18, 2026), the answer is different yet again... now it says it's a 

"... a small deciduous tree, which appears to resemble a distressed or stressed Japanese maple (Acer palmatum) or a similar small ornamental tree with thinning, browning foliage."  

That's also very wrong.  

Regular Reader Ramón pointed out that "...you know a lot about trees, so you know that it's wrong... but I don't live in California--how would I know that the answer is wrong?"  

Great question. 

To generalize a bit: When should you trust ANY AI-generated result? 

The teacher in me wants to say "never--just check it all!"  But that's not realistic.  Like the dog in the top image, there's just too much stuff flowing across your screen to check it all.  

Here are four heuristics I've found to help you decide when to turn off the fire hose and pull out the magnifying glass:


1. The "Load-Bearing Fact" Test

Ask yourself: If this fact is wrong, does my entire argument or project collapse? If an AI tells you the capital of North Dakota is Bismarck to settle a trivial debate, a hallucination just costs you pride. But if you are using a specific fact or observation as the foundational premise of a research paper, a syllabus module, or a legal argument, it requires deep verification. Fact-check the structural beams, not every speck on the wallpaper.


2. Missing the Meta-Context 

As demonstrated by the Buckeye masquerading as a fall-foliage of the Sycamore in the middle of summer, AI often ignores the meta-context. 

If an AI generates an answer that conflicts with the physical laws of time, space, or seasonality, dig deeper. Large language models lack common sense about the physical world; when an answer feels disconnected from basic reality—like a pristine winter coat recommendation for a July hike in the Swiss Alps—trust your intuition and verify. (Note that your intuition is based on what YOU bring to the table. The more you know, the better your intuitions will be.)  


3. "Too Neat and Tidy" Warning

Real-world data is messy, contradictory, and full of caveats. AI systems, however, hate that.  They're statistically tuned to be highly agreeable and narrative-driven. If an AI provides an answer that perfectly resolves a notoriously complex debate, or gives a suspiciously clean historical timeline without any friction, it is time to stress-test the source. Reality rarely fits into a perfectly symmetrical box; if the answer reads like a Hollywood script resolving a plot hole, it’s highly suspect. Verify.  


4. The SIFT Trigger: High Emotions Cause Checking

Applying the principles of the SIFT verification method (hat tip to Mike Caulfield), pay attention to your own internal reaction. Does the AI's response immediately validate your deepest held beliefs, or make you unexpectedly outraged? 

Or... When you feel a strong emotional surge of "I knew it!" upon reading a result, that is precisely the moment you need to stop, step back, and triangulate the claim with an authoritative, independent source. When YOU feel completely validated is exactly the moment your guard needs to go up.  Verify that feeling.  

In both cases (very positive or very negative high emotions), you should breathe in and start a bit of checking.  


In short..  

You don't need to fact-check the weather forecast for your afternoon walk. But when the stakes are high, the context feels slightly off, the answer is too perfect, or your emotions spike, that’s your cue to stop reading and start researching.

And, as I've said before--the more you know, the better your intuition will be.  I have pretty good knowledge about plants and trees, so I can smell a suspicious result when it comes over the digital transom.  

Pro tip: To inoculate yourself against AI errors, spend the time to become fairly knowledgeable about the topic.  You need to know enough to know when things seem shady, weird, or just a bit too-perfect.  

Because... the more you know, the more you know.  



Keep searching. 





Sunday, October 11, 2026

SearchResearch (10/12/26): How to Verify Assertions in an Age of Infinite Noise

We live in a golden age of information...

Diogènes, the seeker-of-truth. Painting by Jean-Léon Gérôme (1860). P/C Wikimedia.
... and an equally catastrophic era of unverified claims.

Every day, we are bombarded with sleek infographics, AI videos, confident tweets, corporate press releases, and persuasive AI-generated assertions.

They sound authoritative. They look polished. But how often do we stop and ask: Is this actually true, correct, and valid?

In the past couple of weeks, two Regular SearchResearchers (thanks, Ramón and jeffp!) have asked versions of "but how do I know what's true and verifiable?"

It's a great question. So let me try another version of an answer. (I will note that many others have written about this "how to determine.." question as well. See citations below for more perspectives on this.)

In our rush for answers, we often confuse fluency with factuality. A well-written sentence feels true because our brains love cognitive ease.

But the reality is that every day I read assertions that sound authoritative: a statistic in a news story, a quote on social media, a confident paragraph from an AI chatbot. Some are true. Some are almost true. Some are true but don’t support the conclusion they’re attached to. The trouble is that all three look identical on the screen.


So here’s this week’s Challenge:

When someone hands you a claim, how do you decide whether it’s true, correct, and valid?

I’ll give you my answer below, but try think about your own verification routine first. I suspect most people discover they don’t have one. Do you? 


Notice: True, Correct, and Valid are three different questions

We tend to lump them together as “is it right?”, but each one fails in its own way, and each needs a different check.


True, correct, and valid are three different questions

We tend to lump them together as “is it right?”, but each one fails in its own way, and each needs a different check.


What you’re really asking

How it typically fails

True

Does the claim match the world? Did this thing actually happen, does this person exist, was this said?

Fabricated quotes, misattributed photos, events that never occurred

Correct

Are the details accurate and complete? Right number, right date, right units, right context?

A real statistic from the wrong year; a real quote with the crucial second half cut off; percent vs. percentage points

Valid

Does the conclusion actually follow from the evidence offered?

Correlation sold as causation; one study generalized to everyone; a true fact used to support an unrelated claim


A claim can pass one test and fail the others. “The popularity of the first name Killian is highly correlated with Automotive recalls on air bags” is true and correct, but “kids named Killian causes air bag recalls” is not a valid conclusion. A misremembered or misunderstood statistic might support a perfectly valid argument, but the argument is still built on a wrong number.

A great example of a "spurious correlation."
This website by Tyler Vigen has wonderful (and crazy) examples.

The practical upshot: before you verify anything, decide which of the three you’re checking. Most verification failures I see come from checking the easy one (does a source say this?) and assuming the other two come along for free.

A six-step verification process for claims and assertions

Here’s the routine I actually use. It’s not fast for every claim, but it scales in a reasonable way: a trivial claim takes 30 seconds, a contested one takes an afternoon.  Here’s a good process to follow: 

  1. Pin down the claim. Try rewriting it as one precise, checkable sentence. “Coffee is bad for you” isn’t checkable without a major research effort. “Drinking more than 4 cups a day raises heart-attack risk in adults” is. Vague claims can’t be verified, only argued about. Also note who is asserting it and what they want you to do with it. Also notice if the claim is somehow connected to the person making the claim. Do they have an interest in having you believe it?

  2. Stop and notice your reaction. If the claim makes you feel vindicated or outraged, slow down. Strong emotion is the single best signal that you’re about to skip a step or jump to an unwarranted assessment of accuracy.

  3. Trace the evidence upstream. Follow the claim back to its origin: the original study, dataset, transcript, filing, or photo. Every hop between you and the source is a chance for a claim to drift or context to vanish. If you can’t find an origin, that’s a finding in itself.

  4. Read laterally. Most people practice vertical reading—staying on a single page, scrolling up and down, reading an article from top to bottom to judge its credibility. Don’t judge a source just by staring at it in isolation. Open new tabs and see what other people say about the source and the claim. Who runs this site? Who funds this group? What do people with no stake in the outcome say about the claim?

  5. Triangulate. Look for independent confirmation. In particular (as I’ve said many times) find sources that don’t just copy each other. Ten articles citing the same press release are one source, not ten. And look actively for disconfirming evidence.  This is the step everyone skips.

  6. Check the reasoning, then calibrate. Now test validity: does the evidence support this conclusion, or something narrower? Then decide how confident you are, and say so in words: confirmed, likely, unsupported, false. “I couldn’t verify this” is an honest and useful answer.

Steps 1 through 5 mostly test truth and correctness.

Step 6 is where validity lives, and it’s the one that requires thinking rather than searching.


The special case: verifying what an AI tells you

Asking for AI answers break the usual cues. They’re fluent, well-formatted, and uniformly confident, so the usual signals we use to judge a web page tell you nothing.

The routine still works, with a few adjustments:

  • Treat every citation as a claim, not as evidence. Open the link. Check that the page exists, says what the AI says it says, and is about the same thing. Mismatched or invented citations are still common.

  • Watch for the plausible detail. AI errors cluster in specifics: dates, names, page numbers, exact figures, quotations. The gist is often right while the details are wrong, which is precisely a correctness failure.

  • Don’t ask the AI to grade itself. “Are you sure?” mostly produces either a cheerful confirmation or a nervous reversal. Neither is verification. Check against an independent source instead.

  • Ask for the upstream source. “Where does this number come from originally?” turns an AI answer into a starting point for step 3 rather than an endpoint.

Used this way, AI is a terrific lead generator and a poor final authority. That’s not a criticism; it’s just recognizing what your tools can do for you. 

 

Teaching this so it sticks

The research here is fairly clear: checklists don’t transfer to students, practiced moves do. Sam Wineburg and Sarah McGrew’s studies at Stanford found that professional fact-checkers outperformed both historians and Stanford undergraduates at judging websites, largely because they left the page quickly and read laterally instead of scrutinizing it. Mike Caulfield’s SIFT method (Stop, Investigate the source, Find better coverage, Trace claims to the original) packages those moves into something teachable.

Here’s what I’ve found works when I teach these skills in a classroom:

  • Teach moves, not checklists. Long evaluation checklists (check the URL, the design, the About page...) take ages and reward the wrong things. A handful of quick moves, practiced until they’re habits, beat a 20-item rubric.

  • Use real, messy claims. When you teach this skillset, use examples from this week’s feeds, including ones that turn out to be true. If every exercise is a hoax, students learn cynicism, not judgment.

  • Separate the three questions explicitly. Give students a claim and have them label each part: what would make this true, correct, valid? Then have them find a claim that passes one test and fails another.

  • Think aloud, then hand it over. Model a verification live, narrating your doubts and dead ends. Then let students do one while narrating theirs. The dead ends are the lesson.

  • Time-box it. Give a 3-minute limit for a quick check. It forces prioritization and shows that most claims can be triaged fast. It also teaches you that not everything can be done rapidly.

  • Grade the reasoning, not the verdict. A student who says “likely, but I couldn’t find the original” with a clear trail has done better work than one who guessed right.

  • Close the loop with AI. Have students verify a chatbot’s answer, including its citations. It’s the most memorable lesson in calibrated trust I know. I've used this is my graduate AI classes... and have had students be surprised by the results.

Above all, make verification feel normal and quick, not like a special forensic event. The goal is a reflex: before I share or rely on this, let me take a quick look.

SearchResearch lessons

  1. Decide which question you’re answering. True, correct, and valid fail in different ways. Name the one you’re checking.

  2. Go upstream. The original source beats any number of summaries of it. If you can’t find the origin, say so.

  3. Leave the page. Read laterally to learn what others say about a source before trusting what it says about itself.

  4. Count independent sources, not total sources. Ten copies of one press release are one source.

  5. Say how sure you are rather than just showing the answer. “Confirmed,” “likely,” and “couldn’t verify” are all legitimate, useful answers, and calibrate the degree of certainty.

Now it’s your turn. What’s your verification routine, and what’s the best lesson you’ve used to teach it? Leave it in the comments. I’ll collect the best ones for a follow-up post.

Keep searching!


--

Citations:

Wineburg, S., & McGrew, S. (2019). Lateral reading and the nature of expertise: Reading less and learning more when evaluating digital information. Teachers College Record, 121(11), 1–40.

Caulfield, M. (2019). Web Literacy for Student Fact-Checkers. Pressbooks.















Saturday, September 26, 2026

SearchResearch (9/25, 2026): Decoding the Inscrutable – Using AI to Crack Open Complex Ideas (and Knowing When You've Reached Your Limit)


How does one… 

Gemini's view of how the CRISPR process works to edit DNA in vivo.


… understand the really big, complex, fascinating topics?  

If you’ve been following my explorations here on the blog for a while, you know that my obsession has always been sensemaking—the process by which we gather fragments of information and stitch them together into a coherent mental model. 

And for decades, the dominant paradigm for online sensemaking was keyword search with fancy notetaking: we’d type a few terms, sift through a list of blue links, read the documents, and synthesize the answers in our own heads, maybe using some tools on the side.

But that paradigm is shifting. We are no longer just navigating to information; we are working with and using agentic AI systems and large language models as interactive partners in the synthesis process itself.

Recently, I’ve been thinking a lot about how we use these tools not just to find quick facts, but to learn deeply complex, highly technical concepts that sit far outside our existing domains of expertise. How do you learn something when you don't even know enough to understand the vocabulary?

To explore this, let’s look at one of the most consequential scientific breakthroughs of the 21st century: the CRISPR-Cas9 gene-editing system.  I’ve heard about this for a while and I have a vague understanding of it—but what would be the best way to learn the details?  

The Wall of Jargon: The CRISPR Paper


Suppose you decide you want to truly understand how CRISPR works. You might do the academically rigorous thing and pull up the seminal 2012 Science paper by Jennifer Doudna and Emmanuelle Charpentier: "A Programmable Dual-RNA–Guided DNA Endonuclease in Adaptive Bacterial Immunity."

You read the abstract and hit a brick wall. The language is full terms like crRNA, tracrRNA, endonuclease, protospacer adjacent motif (PAM), and target-site recognition.

If you aren't a molecular biologist, your working memory is instantly overloaded. In the old days, you might have opened twenty browser tabs, individually searching for the definition of each term, trying to hold them all in your head while reading the original sentence. 

It’s a frustrating, high-friction process that often leads to cognitive fatigue and abandonment.  What can we do to make this better?  

The Dialogic Method: Breaking Down Complexity with AI


This is where AI changes the game. Instead of treating an LLM like a glorified encyclopedia, we should treat it like a tireless, infinitely patient tutor. The key is to break the complex idea into interactive, iterative components.

Here are three distinct ways to use AI to penetrate a complex paper like the CRISPR publication:

1. The "Translate and Map" Technique: Instead of asking the AI to "Explain CRISPR," which will just yield a generic Wikipedia-style summary, give the AI the specific, dense text that is blocking you. 

Prompt: [I am reading a biology paper. I have a strong background in computer science but no background in molecular biology. Please translate this specific paragraph about tracrRNA and crRNA into a systems-architecture analogy. What are the 'software' instructions, and what is the 'hardware' execution?" ] 

By anchoring the AI to your existing mental models, it builds a cognitive bridge. Suddenly, the guide RNA isn't abstract biology; it's a search string. The Cas9 protein is a text-editor executing a "find and delete" function.

2. The Socratic Deconstruction When you encounter a complex mechanism, ask the AI to walk you through it step-by-step, but instruct it to pause and wait for your confirmation before moving to the next step. 

Prompt: [ Explain the exact sequence of events when Cas9 binds to DNA. Explain only step one, then wait for me to summarize it back to you before you explain step two. Correct any misunderstandings I have.]

This turns passive reading into active, conversational learning. You are forced to interact with the material, ensuring you actually grasp the base mechanics before layering on more complexity.

3. Parameter Adjusting (The "Dial-a-Level" Approach) If an explanation is still too dense, or perhaps too simple, you can adjust the "resolution" of the information. 

Prompt:  [ You just explained the PAM sequence at a high-school biology level. Now, dial the complexity up to an undergraduate genetics level. Introduce the specific chemical or structural reasons why the Cas9 protein requires this exact sequence to initiate a cut. ]


Epistemic Humility: The Illusion of Knowing


BUT…here’s the most critical part of this new learning method—and the most dangerous trap of the AI era.

When you use an AI to unpack the CRISPR paper using brilliant analogies and perfectly tailored summaries, you will experience a rapid, intoxicating rush of comprehension. Because the AI's prose is so fluent, and because it has successfully connected the concept to your existing knowledge, you will feel a profound sense of mastery.

Do not trust this feeling.

Cognitive psychologists call this the Illusion of Explanatory Depth. 

We frequently overestimate our understanding of complex systems. We think we know how a bicycle or a zipper works until we are handed a piece of paper and asked to draw the mechanism from scratch. Then, suddenly, you don’t know anything.  AI exacerbates this illusion. When the AI does the heavy lifting of synthesis, it feels like your brain did the work.

To be an effective learner, you must practice epistemic humility. 

You must acutely understand the boundaries of your knowledge. Just because you understand the computer-science analogy of CRISPR does not mean you understand the biochemical realities of it. You know the map, but you do not know the territory.

So... How do you establish where your knowledge actually ends? 

One way is to force the AI to test your boundaries with you.  

The Boundary Test Prompt: Here’s a test prompt for you…  

Prompt: [I believe I understand how CRISPR uses guide RNA and the PAM sequence to target and cut specific DNA. I am going to explain it to you in my own words. After I do, I want you to do three things:
1. Tell me where my explanation is factually incorrect.
2. Tell me what critical nuance I am missing.
3. Ask me one challenging question about a scenario where this system might fail or behave unexpectedly, to test if I actually understand the underlying principles.
]

Now... Close those windows you have open with the descriptions of the mechanism. 

Then, when you try to articulate the concept to an empty room, you will quickly discover the gaps in your mental model. The places where you stumble, use vague words like "stuff," or hand-wave a mechanism—those are the boundaries of your knowledge.

Stay on this cycle of question-asking and explaining until you’ve reached the saturation point.  You’ll know it when you get there.  

The Future of Sensemaking


We are moving away from an era of searching for documents and into an era of searching for understanding. The tools at our disposal are miraculous. They allow us to peer into disciplines—like molecular genetics, quantum computing, or macroeconomics—that were previously walled off by decades of specialized jargon.

But using these tools requires a new kind of discipline. We must become expert prompt engineers, not just to get the AI to generate text, but to guide our own cognitive processes. We can use AI to deconstruct the inscrutable, but we must also use it to ruthlessly interrogate our own assumptions. Beware the Illusion of Understanding!  

The goal isn't to know everything. The goal is to deeply explore the complex, expand our mental models, and—perhaps most importantly—retain the wisdom to know exactly what we still don't know.

Keep searching. Keep researching.

Friday, September 11, 2026

SearchResearch (9/11/26): New AI ways of finding hard-to-find things

 I'm sure this has happened to you... 


... you vaguely remember something that you read, possibly from years ago.  You can mostly remember it, but there's no way you'll dredge up the exact reference or the exact details from your memories. You're trying to find exactly the right wire to pull from a tangled mess.  

We all take notes, but if you can't remember enough of the details to search your notes, you might not be able to retrieve that thing that sits there on the edge of memory, a slightly faded dream-vision that's just beyond your grasp.  

Now, of course, we have AI-augmented search. Here's a nice example of one such search I did this week.  

Case in point:  While talking with a colleague at work, I semi-remembered a fascinating paper about how the results of a behavioral study would change significantly if you have an all-female lab assistant crew caring for and tending lab mice versus an all-male crew.  

With Gemini, you could just do a simple description of this half-forgotten result and get the answer back immediately.  Here's what I did, asked a short and sweet question:   


This isn't even an especially coherent statement--it just has all of the parts needed.  ("Testosterone" "male" "lab animal studies" and "profoundly affect the outcome")  

The result was quite good: 


And of course, I clicked on the links (ScienceDaily and Gwern.net) to get to the original source papers. They are: The scent of a man: Gender of experimenter has big impact on rats' stress levels, explains lack of replication of some findings (published in Science Daily, 2014) and  Olfactory exposure to males, including men, causes stress and related analgesia in rodents (published in Nature America, 2014) 

Why is this important? The study sent shockwaves through the clinical research community because it helped explain long-standing issues with the reproducibility of behavioral and pharmacological studies. It demonstrated that something as simple as the gender of the lab assistant could profoundly alter experimental outcomes, leading many scientific journals and labs to subsequently mandate the reporting of experimenter sex in behavioral studies.

More generally.. .One of the consequences of fast/cheap/easy search tools is that you can dig more deeply into the material than was plausible before.  Do so!  

For instance, I'm now re-reading East of Eden, by John Steinbeck (first time since high school). I found that I've forgotten most of the story, and I find myself constantly stumbling over terms and concepts that I'm sure I didn't know in high school, and almost certainly never looked up at the time.  Words like timshel or paregoric just slipped beneath my radar.  But being able to quickly dive more deeply into these concepts certainly makes the rest of the story more meaningful.  

Search is awfully handy, and AI-based search lets you pull out exactly the right wire you've been looking for in the rat's nest of mental cabling.  


SearchResearch Lessons 

1. You can often retrieve even vaguely remembered articles with a straightforward AI search.  The cost and time of tracking down important ideas is very low--do it, rather than relying solely on fallible memory.  

2. IMPORTANT: Sometimes the AI can get it wrong--you still need to verify the finding.  

3. Don't over-specify the details of the thing you seek.  Note that I did not say "in mice" in my query, but just left it as the more generic "lab animals."  


Keep searching.