Wednesday, November 6, 2024

SearchResearch Challenge (11/6/24): How long did they last?

Traditions die hard. 

P/C David McEachan, from Pexels.com


P/C Bera Yannick, from Pexels.com

But it's clear that some traditions can last a long, long, long time.  But how long?

I remember reading that ancient Egyptians would bring offerings of food, drink, clothing, and ointments to their departed leaders (as seen above). This ritual would happen daily when priests would attend to the tomb and make sure that those who have passed on would have sufficient food and goods to make it through the afterlife. 

Since pyramids (and smaller mastabas) were intended to last forever, one has to wonder, how long did people keep bringing offerings to the tombs?  

As we know, the "forever" thing didn't quite work out.  The Great Pyramid of Giza was built as the tomb of pharaoh Khufu, who ruled during the Fourth Dynasty of the Old Kingdom. Built around 2600 BCE over a period of about 26 years, it was apparently plundered by 1570 BCE.  That leaves the obvious question--were priests and family members STILL making offerings? 

Wondering about this leads to today's Challenge: 

1. After the Pharaoh's death, how many years did people keep bringing offerings to the pyramids?  Was it just a few years and then they gave up?  How long did the offerings keep coming?

2. A related question: How were the people who were the bringers-of-offerings organized?  Was there a central church organization or division of the government that handled such long-lasting affairs?  What were these organizations called?

I'll show you my work next week, but in the meantime, do let us know how you did your research!  We all want to learn the methods you used to get to the answer.  


Keep searching!  




Wednesday, October 30, 2024

Answer: How is it made? (flannel and snake oil)

 Flannel up! 

Image by Gemini. [young woman wrapped in flannel blanket at window, pre-Raphaelite]

We've had a string of chilly mornings, perfect for answering a couple of SRS Challenges. Get that cup of tea and start searching!   

But back to flannel... how?  

1. Can you find out how flannel cloth (e.g., that used for comfy sheets or shirts) is actually made?  How is that distinctive nap made?  

Quick answer:  it's brushed by a mechanical device that raises the nap of the underlying cloth.  

A quick: 

     [ how is flannel made ] 

teaches us that "Flannel may be brushed to create extra softness or remain unbrushed. Brushing is a mechanical process wherein a fine metal brush rubs the fabric to raise fine fibres from the loosely spun yarns to form a nap on one or both sides. If the flannel is not napped, it gains its softness through the loosely spun yarn in its woven form."  Wikipedia on Flannel 

Reading that made me realize that the word napped suggested that there was probably a process for doing the napping.  So my next query was: 

     [ process of raising the nap on cloth ] 

which took me to the "Napping of Cotton Fabrics" technical document, which goes into great detail about how flannel is actually made.  In there, they point out that: 

NAPPING - A mechanical finishing process in which fibers are raised on the surface of a fabric by means of teasels or, on contemporary equipment, by rollers covered with steel napper wires. Other names for napping are Gigging, Genapping, Teaseling, and Raising.

That makes sense.  Of course, once you've napped the fabric, you need to trim it back down, so that means: 

SHEARING - This process normally follows napping, and involves the mechanical cutting or trimming of fibers projecting from the surface of the cloth to produce a uniform and level pile.

They also tell us all the details: 

"Different napping results can be obtained by varying the speed of the napper rolls relative to the speed of the fabric. A positive napping action occurs when the points of the napper wire travel at a speed greater than the speed of the fabric. Additionally, the pile versus counter pile roll speeds can be varied. In general, greater pile energy produces a loftier nap, while greater counter pile energy produces a shorter, thicker nap. When the napper roll wires travel at a speed slower than the speed of the fabric, a tucking or felting effect of the fabric pile occurs. When a napped fabric is felted, the raised fiber ends are tucked back into the base of the fabric, producing a smoother fabric with better appearance retention after washing." 
A double-action napper device made by Gessner.


Of course, I wanted to see this in action, so a jump over to YouTube and a search for: 

     [ machine making flannel cloth ] 

led to a bunch of videos... many of which look good, but you have to watch them with care to find a segment that actually shows the napping (or "brushing") process.  Here's one that I found (link to video).  


At the 8 second mark, you can see the red fabric running through the rollers with the napping wires.  

Interestingly, Regular Reader Arthur Weiss got much the same results by using Perplexity (see his comment in the original post).  The LLM also gave a few additional pages that I didn't see in my regular Google search, so there is a breadth and diversity of results here, which is good to see.   

And since multiple web pages mentioned teasels as the original tool used to make flannel, I did a search for: 

     [ teasels used to make flannel ] 

and found this device: 


A "teasel cross" National Trust Inventory Number 117317.14On display at Lavenham, Suffolk.


Here's a closeup of what the teasel seed head looks like: 

Teasel seed head closeup.  A few of the seeds are geminating after recent rains. p/c Wikimedia



2. Is snake-oil a real thing, or is the falsity of "snake oil" that it doesn't really exist?  How much fat is on a snake that could then be rendered into oil?

Snake oil has come to mean something fake, often a medicine that's passed off as something efficacious, but actually has no real merit.  

The Wikipedia article is interesting, telling us that there really IS a kind of snake oil that's traditionally made from Chinese water snakes.  

But in the US, there was a famous case that in 1917, when Stanley's Snake Oil was discovered to contain no actual snake oil, creating the notion that bottles of snake oil (and their salesmen) were essentially fraudsters.  

To our question, though, how much fat can a snake have that might then be rendered into oil?  

A quick query for: 

     [ fat on snakes ] 

leads to any number of discussions of how to deal with your obese pet snake.  Curious about how and where fat is stored on a snake, I did a follow-up query: 

     [ fat snake dissection ] 

and found a large number of dissected snakes showing exactly where the fat stores are kept.  (Often in the tail, but fat nodules can be found anywhere!)  It's remarkable how many images there are online.

So, much to my surprise, snakes CAN be fat.  It's not incredibly common in the wild, but it clearly does happen when a snake lives in a meal-rich environment.  

How about the utility of real snake oil?  

     [ snake oil effective ] 

led me to a large number of articles about the legacy of snake oil salesmen, but also to a number of discussions of the amount of Chinese snake oil may have had.  There seem to have been real benefits due to its high concentration of the omega−3 fatty acid eicosapentaenoic acid (EPA)—more than that of salmon

So... I learned a bunch here.  Real snake oil can be useful, but it's nearly impossible to buy actual snake oil these days (and apparently even more difficult in the past).  

SearchResearch Lessons 

1. Finding a video of the actual operation of "how it's made" devices can be difficult.  There is not, as of yet, a great video search system.  I found LOTS of "how flannel is made" videos that didn't actually show you anything of interest.  At this point, dedication is still required.  Hang in there. 

2. Using an LLM as a "lead generator" is a good idea.  It's yet another way to broaden the set of leads you follow when pursuing a particular topic.  

Keep searching.  

Wednesday, October 23, 2024

SearchResearch Challenge (10/23/24): How is it made?

 It's that time of year... 

Image by Gemini. [young woman wrapped in flannel blanket at window, pre-Raphaelite]

... "thou mayst in me behold / when yellow leaves, or none, or few, do hang..."  

Or, less poetically, the time of year when the flannel comes out.  

As I put on my beloved flannel overshirt on this chilly morning, I got to thinking about the fabric.  While I have a pretty good idea about how most fabric is made, I really don't know the mechanism of flannel.  It's warm and comfy, but how do they DO that?  How do they make it so soft and warm?  

More generally, how things are made is always a great SRS topic.  As a flute player, I've wondered how flutes got built.  There are several great YouTube videos showing the entire construction process.  (Here's an older video showing all of the steps.)  Fascinating--and now I know.  

But back to flannel... how?  

1. Can you find out how flannel cloth (e.g., that used for comfy sheets or shirts) is actually made?  How is that distinctive nap made?  


To continue the theme of how-things-are-made, the other day I happened to see a snake zipping down a forest trail in front of me.  A bit later, I saw a reference to someone as a "snake oil salesman."  I understand what that means, but every snake I've ever seen has not a gram of fat on it.  So... how? 

2. Is snake-oil a real thing, or is the falsity of "snake oil" that it doesn't really exist?  How much fat is on a snake that could then be rendered into oil?

When you search these things out, be sure to track HOW you found your answers and let us all learn how you did it.  

Still wondering about flannel creation... 

Keep searching.  

Wednesday, October 16, 2024

Answer: Finding similar content?

 Finding something similar... 

P/C Gemini. [create an image of a hall of mirrors with trees and mountains]

... but not exactly the same is a common SearchResearch thing to do.  As I'm doing my own research work, I'll want to find another take on a topic, and would really like to know how to find a similar / closely-related page or site.    

This common research step is our Challenge for this week: 

1. How can you find related sites (or content) to something that you know about?  Suppose you want to learn more about Search and Research methods:  Can you find similar or related websites to our trusty SearchResearch1.blogspot.com?  

Last week I gave you a BIG HINT:  If you do the obvious search e.g. [how to find related sites on Google], it will tell you that you should use the related: operator has been deprecated since June, 2023.  Don't believe it: It is no more--it has ceased to be. (See the note from Google's SearchLiaison.)  

Why is it so mistaken?  A: There are thousands of pages that discuss how to use the related: operator... but only a very small number that tell you that it no longer works.  Unfortunately, both search engines and LLMs work with the vast majority rather than actual bits of knowledge.  You could say that the site: operator no longer works (don't worry--it still does!), but it would take the LLMs just about forever to figure this out. 

Alas, Google currently tells you when you ask [how to search for related pages on Google]  

WRONG!
Searching for how to find related sites on Google.  It gives you a bunch of bogus information.  If I were a linguist, I'd put a giant asterisk next to this set of results.

What IS a reasonable "find related" strategy?  

I asked a couple of LLMs "how to find sites that are similar to X," and while a lot of the advice wasn't great, I DID extract a few gems.  

SimilarSites.com - doesn't work for our SearchResearch1.blogspot.com site (but see below--it DOES work for 3blue1brown... bear in mind -- your mileage may vary).  

SimilarWeb.com - DOES work for SRS, but the similar sites are mostly math or education sites (e.g., 11011110.github.io or blog.discoveryeducation.com).  Those are fine, but not quite on topic.  

If you're a Regular Reader, you know that what our SearchResearch site is REALLY all about is how to be a better searcher.  We cover a lot of other ground in our quest to improve online research skills, but at heart, we're a team that knows about how to do online search.  

But the blog is a long series of Challenges followed by Answers. What is it about?  

To get the gist of SRS, I took a few posts (in particular, the last 8--four Challenges and four Answers), copy/pasted them into a single file, uploaded it to Gemini and asked it: 

This file is a sampler of several pages from the searchresearch1.blogspot.com web site.  Can you summarize these pages and tell me what this website is all about? 

It's not a perfect summary, but it's not bad.  Here are a couple of excerpts:  

This website, searchresearch1.blogspot.com, is a blog dedicated to exploring the intricacies of online search and research methodologies. It delves into the art of utilizing search engines effectively, with a particular focus on Google, and provides valuable insights into how to conduct research efficiently and intelligently.

The blog's author, Dan Russell, frequently presents "SearchResearch Challenges," thought-provoking questions designed to test and enhance readers' search skills. These challenges range from identifying the oldest city in the Americas to finding related websites with similar content.

A recurring theme throughout the blog is the concept of "unanticipated consequences," highlighting the unexpected outcomes that can arise from research and the importance of being prepared for surprises. The author emphasizes the need for persistence in research, advocating for continuous learning and exploration.

Overall, this website serves as a valuable resource for anyone looking to improve their online search and research capabilities. It encourages critical thinking, effective search strategies, and a deeper understanding of the complexities involved in finding and evaluating information online.

But from this summary, we could extract a couple of decent search queries to find related sites.  I extracted two: 

     [ art of utilizing search engines effectively,
       valuable insights into how to conduct research
       efficiently and intelligently ] 

     [ anyone looking to improve their online search
       and research capabilities. It encourages critical
       thinking, effective search strategies, and a deeper
       understanding of the complexities involved in 
       finding and evaluating information online.] 

Yes, I know those are very long queries, but the old advice has to be updated: One used to look for short, precise queries that would get you just a few, highly targeted results.  But THIS Challenge is asking a broad question that has multiple aspects to it.  For questions like this, longer queries actually work very well.  Here's some of the results:  

Note that not all of the query terms are in each result.  Doesn't matter. 
We're looking for related sites, not exact duplicates.


These two queries led to quite a nice collection of sites that are closely related to SRS. Here's a short list of interestingly related sites that I didn't know about!   

Zampila (on research methods), UniversalClass (on how to do online searches), Marcos Esteve blog on data science and search... There are a bunch!  


2. Same question, but about a different website:  Again, one of my favorite sites, www.3blue1brown.com (an excellent science/math/tech site with lots of exquisite videos illustrating complex topics).  

SimilarSites.com works for 3blue1brown, and points to sites like TomRocksMath.com and BetterExplained.com -- those are great sites that ARE very similar to 3blue1brown.  

Doing our "summarize the website" works less well for 3blue1brown since it's primarily a video site, but you can still patch together a set of writings (such as the "About" page for the site) and ask for another summary, then use that for your search.  When I did that, it led to me to: 

Mathologer: This YouTube channel delves into fascinating math puzzles and concepts with a focus on visual proofs and surprising connections.

Numberphile: Another YouTube channel, Numberphile explores a wide range of mathematical ideas through interviews with experts and engaging visuals.

Desmos: This free online graphing calculator allows you to visualize functions, explore geometric concepts, and create interactive mathematical models. It's a fantastic tool for hands-on learning.

GeoGebra: Similar to Desmos, GeoGebra offers powerful tools for visualizing geometry, algebra, calculus, and statistics. It's great for dynamic exploration and creating interactive simulations.

Overall, this approach works rather well.  


In the comments, remmij reminds us that for any question, there is a pretty decent chance that there's a Subreddit about.  In this case, searching on Reddit for "3blue1brown" quickly leads to "Looking for more channels like 3blue1brown" and a lot of suggestions for similar sites.  

Mott Given wrote in to point out https://explore2.marginalia.nu/ -- a site that finds nearly related sites.  

Regular Reader Krossbow pointed out the Yogurrt "discovery engine" (which didn't work so well for me, but YMMV).  

There are probably more such tools out there.  Let me know and I'll add them to this page.  


SearchResearch Lessons 

1. Be wary of the specific details about how to use software given to you by search engines or LLMs.  They're often out-of-date--partly because operations change quickly, and partly because there might be millions of citations about how something works, but only ONE reference to that function being deprecated.  Unfortunately, that's not the way LLMs work--you can't just say "this doesn't work anymore" and have it "learn" that!  

2. There are tools worth knowing: SimilarSites.com and SimilarWeb.com both give decent results. 

3. Creating a longer summary description of the site and asking your search engine to do a search on that description often gets you into the neighborhood. As I mentioned, that was a crazy method to do a couple of years back, but these days, it often works just fine.  

4. Don't forget to look specifically for recommendations for "more X like Y"--you never know when Reddit will have exactly the thing you seek.  

5. Ask your friends...  That's how we found a few additional "related" tools--friends comments left here!  

 


Keep searching.  


Wednesday, October 9, 2024

SearchResearch Challenge (10/9/24): Finding similar content?

 When you like something... 

P/C Gemini. [create an image of a hall of mirrors with trees and mountains]

... you probably want some more.  And sometimes you want something similar--not quite the same thing, but something that's close, but perhaps with a slightly different take.  Maybe something that's a refracted / reflected / slightly transformed version of your original idea.  

This happens to me when I'm researching a topic and want additional information that's not just a duplicate of what I've already got.  

And this is our Challenge for this week: 

1. How can you find related sites (or content) to something that you know about?  Suppose you want to learn more about Search and Research methods:  Can you find similar or related websites to our trusty SearchResearch1.blogspot.com?  

2. Same question, but about a different website:  Again, one of my favorite sites, www.3blue1brown.com (an excellent science/math/tech site with lots of exquisite videos illustrating complex topics).  

I know you can find these sites, but HOW can you do it?  

BIG HINT:  No matter what Google tells you when you search for similar sites, e.g. [how to find related sites on Google], the related: operator has been deprecated since June, 2023.  It is no more--it has ceased to be. (See the note from Google's SearchLiaison.)  

What would you tell a friend about how to do this kind of search? 

Let us know in the comments.  

Keep searching.  


Wednesday, October 2, 2024

Answer: How literate are people wrt road signs?

 We live in a world full of symbols... 


Many of which are essential for living a safe life--such as the signs you see on the roadside every day.  

But a real question is to what extent people actually understand common signs and symbols they see every day.  

I assume that you understand all of the signs above, but it's not clear that not everyone shares your skill.  

What's the difference between the first symbol in row 2 vs. the third symbol in row 2. Do you know?   (Answer: "curving road" on the left, "slippery road" on the right.)  

So the Challenge this week is not to identify these signs, but to understand the larger question:   

1.  How many of the most common roadside symbols DO people understand?   

We're looking for a study of how many road signs people understand.  How do you approach such a question?  

Added later:  I should have made it clear that I was asking only about road sign understanding in the US.  As several readers pointed out in the thread over on LinkedIn, different countries have VERY different expectations about how much training one needs before even taking a driver's test.  The US seems to have a fairly low bar for passing the drivers' test!

This is a fairly open question, but I know we're looking for a study of "road sign literacy" that would measure how many people recognize (correctly!) a set of common road signs.  

My first query was: 

     [ how well do drivers understand road signs ] 

Giving this as the first result: 


That's really interesting.  But when you click through to the article, (Many Americans Struggle to Identify Road Signs) you'll quickly find that it's a summary of other work that's just published on the Automotive Fleet website.  (A website for car fleet management.) It's not bad as a summary, but I like to read the original work and get more of the context. 

In this case, that web page summarizes a report by MyVision.org on road sign readability, "Read the Road: Sign Struggles and Dangerous Distractions." Their analysis is pretty good and filled with interesting results. But again, MyVision.org is a LASIK eye surgery provider, not a specialist in reading or automobile safety.  

The main claim in this study is that 20% of respondents did NOT know what these signs mean when based on shape alone,  although they understand "merge" and "yield" correctly. For example, when looking at road signs based on their shape and color but without any text, only 73% of Americans could accurately identify a road construction sign. Obvious question: Do you know what sign this is?  


But as I read this article I find myself filled with questions:  Who did this study?  They say that"We surveyed more than 1,060 drivers"--how did they select the drivers?  Who is "we" in that sentence? How was the survey given to them?  Why did they test road sign shape without text? Questions abound!  We must go deeper.  Does this article lead anywhere useful? 

I have to tell you that I failed to figure out who/when/where the original article was published.  It sounds good and look interesting, but there's no there there.  (I even emailed the people listed as the contact point--no replies yet.)   Update: I got an answer back from the original authors who say that the MyVision.org web page is the only available version of their report; no other methodological details are available.

So we have to take those results with a grain of salt.  They might be great, but who knows? 

I shifted my search to a Scholar.Google.com search: 

     [study understanding road signs] 

And quickly found a relevant article "Comprehension and Training of International Road Signs" published in the very reputable Proc. Human Factors and Ergonomics Society (2004).  (Note: you might have to pay for access.) In this study (done in North Carolina), testing of 100 people (60 women, 40 men) on 100 international road signs discovered that understanding varies a lot!  

Examples: different signs and recognition rates--Stop sign (100%), Road works (92%), road narrows (42%), road closed (29%).  

They also tested the participants after a short training on what the signs mean. Good news: training really works, improving recognition rates to nearly 100%.  (That's not surprising, but what they SHOULD have done was to re-test participants after a couple of weeks to see if the training actually lasted for more than a day.)  

With this search query I also found a fascinating document: The Development and Evaluation of Effective Symbol Signs (1982), a truly masterful study produced by the US National Bureau of Standards to identify the issues around making effective signage that people would understand. (For both road and non-road signs.) In one study (dating from the late 1970s) people were asked to determine what  symbol they were looking at:  

“... the authors found that some symbols, such as ‘telephone,’ ‘no smoking,’ and the conventional U.S. ‘exit’ sign, were understood by almost all the subjects tested. Yet other symbols, such as ‘blind alley,’ ‘do not block,’ and ‘break glass,’ were understood by only 20-25 percent of the subjects. Not only were some symbols not understood, several symbols were given a meaning opposite to that which was intended. Thus, ‘no exit’ or ‘blind alley’ was interpreted as ‘exit’ or ‘safe area’ by almost all subjects who gave a definition for this symbol.”

Ooof.  That's consistent with other studies, but is frightening.  Not only are many road signs not understood, by everyone, but people will latch onto the OPPOSITE interpretation of a sigh.  Bad idea.  

Shift in strategy:  Even though I used the word "literacy" and "understanding" in my framing of the challenge, it became clear by reading these articles that the preferred terms are "comprehension" rather than literacy, and "traffic sign" rather than "road sign" or "symbol."  

New query: 

     [traffic sign comprehension] 

And that in turn leads to a few more studies: "Comprehension of traffic signs with symbolic versus text displays" Transportation Research Part F: Traffic Psychology and Behaviour (2013) This study in Israel shows that symbols alone (that is, without text) are understood about 51% of the time, while symbol + text is nearly 100%.

That's better than the North Carolinian results. BUT they also found that interestingly, signs that were misunderstood to mean the opposite of their true meaning (as in the previous study) were generally not less familiar than signs that were answered incorrectly or partially correctly. Thus, familiarity alone was not a guarantee of good comprehension.

I can go on--but after looking at several studies, the overall conclusion is best summarized as "people mostly recognize the common signs, but rare signs are often not understood, or worse, are thought to mean the opposite of their intended meaning!"  

You could design your own study... if you're curious, here's the master list of all US traffic signs   


A small section of the US DOT master signage list.


SearchResearch Lessons

1. Persistence!  As usual, the quick and obvious search often gives you information that looks good, but usually requires a bit more digging to validate.  Be one of those searchers who persists.  

2. Learn the preferred terms of art as you read.  As you saw, I shifted my terms as I read the papers.  Pay attention as you search to the language you're seeing.  It can inform your later searches with much better terms.  


Keep Searching! 


The basis of reading literacy is glyph recognition. Just sayin'... 
BTW, this is the throne name cartouche of Thutmose III,  the sixth pharaoh of the Eighteenth Dynasty,Details here.  (Men kheper Ra, "Lasting is the Manifestation of Ra" as seen in the Abydos Canon no. 70 and  Saqqara Canon no. 8  Cf: Beckerath, “Handbuch der ägyptischen Königsnamen”, 2nd ed. MÄS 49 (1999). 136-137, 6:T1


Wednesday, September 25, 2024

SearchResearch Challenge (9/25/24): How literate are people wrt road signs?

I've wondered for a while... 


... to what extent people actually understand common signs and symbols they see every day.  You probably understand all of the symbols in the above image, but based on some of the stellar driving skills I see, it's pretty clear that not everyone shares that skill.  What's the difference between the first symbol in row 2 vs. the third symbol in row 2. Do you know?  

That brings up an interesting SearchResearch Challenge for the week.  How literate are we? The goal of a roadside symbol is to be rapidly understood--you see it / you understand it.  It's supposed to be automatic.  But... 

1.  How many of the most common roadside symbols DO people understand?   

Don't just give me your estimate but find where this has actually been studied, and what the results are.  Are you surprised by what you found?  Do you think the study (studies) are valid and sound?  

Does this make you feel better or worse about your fellow drivers? 

As always, tell us HOW you found your results. 

And... 

Keep Searching! 


The basis of reading literacy is glyph recognition. Just sayin'... 



Wednesday, September 18, 2024

Answer: What is the oldest city in the Americas?

 Simple questions are

sometimes harder... 

Mythical ancient city by Imagen

... than you'd expect.   

This Challenge is like that.  It's a very straight-forward question that might not have the simplest answer.  It's up to you to figure this out! 

1.  What is the oldest city in the Americas? 


You'd think that just asking a search engine or an LLM would give you the answer and you'd be done.  Right?  

Well... if there's any deep lesson from SearchResearch, it's that things are never as simple as you'd expect... there's always something deeper and more interesting behind the question.  

Every question, even something as straight-forward as this, needs a bit of definition help.  The answer--no surprise--is going to depend on how you define "city" and how you define "oldest."  

First things first: How do we define a city?  Is it just population or "level of sophistication" or some combination?  

By the dictionary definition, a city is just "a large number of people who live fairly close together."  True, that, but not particularly precise.  What's "large" and "close together"?  

Remember that in the year 0, Rome was around 1 million people in size, while London was only around 1.4 sq km (0.5 sq mi) and home to less than 5,000 people.  Of course, by the year 537 AD, Rome's population had fallen to around 30,000 souls, while London had risen to around the same number.  

Populations come and go--cities are built, grow, prosper, decline, and sometimes lose everyone becoming less than a hamlet.  

So we have a couple of definitional questions to answer before we get to the key Challenge. 

a. how many people make up a city? 

b. how large an area does a city have to be?  (Or does population density make a city?) 

c. does the length of time a city is occupied make a difference in our question?  

I mention all of these variables because in order to answer the question, we need to pick some values.  (In some sense, it doesn't really matter which values you pick, as long as most people will agree that "this is a city at this time.")  When Rome fell to 30,000 people, was it still a city?  I'd say so, partly because of history, but also because they were fairly densely packed together.  

So, for our purposes here, a city is an assembly of more than 2000 people living in a small area that supports commercial activity, with some kind of government or ceremonial / religious functions.  (We'll ignore continuity for the moment.  If the city lasted for more than 5 years, it is--or was--a city for our discussion.)  

Once you get beyond definitions, you might think you could just ask all of the ChatBot LLMs and Search Engines this question, "What is the oldest city in the Americas?"  

When you do that, this is what you get:  



The answers vary based on differing assumptions that each system makes.  

Bing, for example, only shows St. Augustine, FL... but the first organic result points to the Wikipedia article on "List of cities in the Americas by year of foundation" (we'll look at that in a minute).  

Some of the systems expose their assumptions.  Gemini's reply includes the supposition for each: 

"If you consider the oldest continuously inhabited city founded by Europeans, it's Santo Domingo in the Dominican Republic, established in 1496.    If you're looking for the oldest continuously inhabited city in North America founded by Europeans, that would be St. Augustine, Florida, founded in 1565. However, if you're talking about the oldest city in the Americas overall, the answer is Caral, Peru. It's an archaeological site dating back to around 3500 BCE, making it one of the oldest cities in the world."

That's a good response, but it does NOT expose any of the other cities that might qualify.  (And is pretty North American biased as well since it lists Euro-towns before the older places in Peru, but I digress.)  

If you just look at the cities listed here and collect their founding dates (as given by the search/AI systems), you'll have this:


THIS is why doing a comparison table is a great idea--you can see the different options and the different assumptions that were made.  With this table we can look at each of these claims one at a time.  Let's do a little digging for each of these claims.  

Tlapacoya is claimed by Perplexity to date to 7500 BCE.  That's quite a claim.  By doing a bit of Google searching, it's clearly a city by 1500 BCE, but there are some artifacts going waaay back, including some rather controversial ones dated to 25,000 BCE.  (They're so controversial that we're going to ignore them here.) But where did the 7500 BCE claim come from? 

When I pushed Perplexity on this [why did you say that Tlapacoya dates to 7500 BCE] it rapidly backpedaled and claimed--falsely--that "I did not mention that date."  Harrumph.  Yes you did.  I have the screencapture to prove it.  Sigh. So this seems bogus... The actual founding date of Tlapacoya seems to be 1500 BCE.  

Footnote:  I figured out where the claim of 7500 BCE for the start of Tlapacoya comes from... it was scraped from the Wikipedia article, List of Cities in the Americas without careful verification.  Oops!  There is an error on the internet... Perplexity just forgot what it was trained on.  

Aspero was pretty clearly a city (with major buildings, large temples, and agricultural fields) by 3000 BCE.  It was part of the Caral-Supe civilization which goes back even farther. (The Caral-Supe culture seems to date to 5000 BCE, but cities started later and can be reliably dated to ca. 3700 BCE.)  
Huaricanga was also connected with the Caral-Supe culture and dates to 3500 BCE.  There are more major buildings and temples and possibly a connection to Aspero.  

Caral seems to have had several thousand inhabitants starting around 2600 BCE, centrally located to all of the Carl-Supe sites.

HOWEVER... while reading about Caral, I stumbled across a mention of site that was possibly older--a place called Bandurria.  Curious about this place (which wasn't mentioned by any search engine or LLM), I did a bit of searching and found dates for Bandurria that are around 3000 BCE--older than Caral, but newer than Huaricanga. (See Paleodiet in Late Preceramic Peru: Preliminary Isotopic Data From Bandurria)

Odd, isn't it?  A major city that is contender for oldest city in the Americas, and it doesn't show up in any of the search/LLMs.  

There are a couple other sites that are quite old e.g., Puerto Hormiga in Columbia, or Celilo Falls (aka Wyam) in Washington state--but both of these seem to be ephemeral villages or trading locations--they have long histories as temporary settlements, but never quite made it to city status.  

Bottom line:  The "oldest city in the Americas" tag has to go to Aspero (3710 BCE), with Huaricanga (3500 BCE) and Bandurria (3000 BCE) close behind. All of these cities had more than 2,000 inhabitants, lasted for many years, and were centers of commerce and religion.  

And our new table has moved Tlapacoya to the fifth position, and added Badurria into position three.



SearchResearch Lessons

1. Compare and contrast different sources.  You know, we've talked about "second sourcing" your results. In this case, I compared eight different systems (search engines + LLM chatbots).  As you can see in the table above, the answers are VERY different from each other.  In some cases, the results are just plain wrong.  (Interestingly, not because they're hallucinating, but because they trained on data that was incorrect, which then surfaced in their outputs.)  

2. Building a comparison table is handy. Not just because you can then use the table to work through the different results, but also so you can see the huge variety of results.  When the "answers" are this different from each other, you have to be fairly skeptical... which we found was the right thing to be.  

3. Remember that search results might be incomplete!  I found Bandurria because I noticed the unusual name when scanning the results.  Checking into it, I found the 3rd oldest city in the Americas... and a result that NONE of the systems surfaced!  

4. When doing search comparisons like this, make your definitions clear so people will know what you're comparing. 


Keep searching!