Thursday, July 18, 2024

Answer: How can we find the best way to track developments in AI?

 Tracking is an important skill to have... 

Not an actual server farm, but one imagined by Meta's gen-AI.

... and we need to get good at it.  

This week we asked ourselves, "How can we best teach ourselves about current developments in AI?"   In other words, how can I be an autodidact about AI, a field that's changing rapidly?  

So... this Challenge is really about what you do when you've got to drink from the raging torrent of your latest topic area.  Here's some practical advice that might help you out...   

1.  What should I do to stay on top of / learn-about / understand the development happening right now in AI?  Some of the tactics we talked about last week kind-of don't work well (the textbooks haven't been written yet), and even taking a course means re-taking that course a year later when everything changes.  So... what's a SearchResearcher to do?  What advice would you give?  What resources have you found that help answer this Challenge? 

This kind of rapid following / tracking is an important skill, perhaps now more than ever.  

Here's my summary of what I do to try and stay on top of the AI game.  (You can substitute your favorite fast-changing topic for "AI" in all that follows.)  

1. Track the news through blogs.  I sign up for new AI-tracking blogs when I see new posts, but I also fairly actively prune away the ones that aren't satisfying my interests.  I currently follow: 

Ben's Bites - mostly AI product launches

MLearning.ai - lots of how-to articles, a few good in-depth reporting articles 

Jakob Nielsen on UX - but these days, mostly about the UX of AI 

TLDR - 1 post/day, AI, ML, data science news 

OpenAI blog - somewhat irregular

Google's Gemini blog - 1/week; lots of Gemini promotional stuff

Perplexity's blog - also somewhat infrequent 

MIT AI News - academic, but really interesting

But note that this list will change as I add new blogs and delete ones that have drifted away from my interests.  Don't just keep adding stuff to your list! Keep looking for newer / better / more aligned with your interests.  (And be ruthless about getting rid of the deadwood.)  

SRS Regular Reader Arthur gave some good advice in his response: 

So I try to drink from that fire hose through blogs (AI Secret, There's an AI for ThatThe Rundown AI, and also posts from Perplexity's blogYou.com and others that say what's happening. I file these in a dedicated folder that at some point I can use AI to summarise and draw out the gold. (I haven't yet - but it's an option).

More importantly when something new grabs my attention I try it out. Whether it's Claude3.5, Llama3, DBRX on HuggingFace, ChatGPT4.5o and so on.

Arthur's advice is good:  pick a few blogs to follow and try out new capabilities as you read about them.  (Don't wait!)  Experience beats reading in this regard.  

2. Set up Google Alerts.  We've talked about this before, but it's worth a reminder.  You can set up alerts to run a daily query for you and then email you the latest results.  Set up one or two and try it out at Google Alerts. You can set up an alert to track a specific company (e.g., OpenAI) or a specific site that publishes a lot of breaking results (e.g., arXiv.org).  

3. Set up Google Scholar Alerts.  We've also talked about this before...  You can set up alerts to run a daily query for you just on Google Scholar contents and then email you the latest results. Very handy for tracking the academic work that's going on in your area of interest.  Check out this great article about setting up a Scholar Alert from the University of Tennessee.  Note that these results are completely disjoint from the regular Google Alerts.  

4. Set up Google YouTube Alerts.  Yes, YouTube has its own series of alerts.  (Here's how to set them up. Yes, they are also disjoint from regular Alerts.)  You can go set them up to be notified when a favorite Tuber drops an explainer or demo.  (These can really be quite good: take a look at some of these papers.)  Channels like "AI Explained" and "Two Minute Papers" provide accessible explanations of complex AI concepts and recent developments

5. LinkedIn. Remarkably, LinkedIn has become an incredibly valuable source of up-to-the-second information.  I have a lot of connections that help keep me on top of the news, but I have found that following some folks like Ethan Mollick, Gary Marcus, Andrej Karpathy, and Eric Horvitz.  You'll find more people that align with your interests.   

Most importantly: I spend around 1 hour / day just doing my AI/UX reading--it's baked into my daily routine.  It's really the only way to keep on top.  Pretend you're taking a course on AI technology and this is your study time.  

But don't fret if you miss a day or two--it's not worth your time to feel guilty about missing a few things.  It really is a fire hose out there, and your FOMO is just a burden.  Delete all the notifications you received (or give them a quick once-over before deleting) and get back to your normal practice.  

Keep Searching! 

18 comments:

  1. Thank you, Dr. Russell.

    I'll visit those other blogs. About AI,.I read yesterday that YouTubers content was used to train AI without their consent.

    I like the advice to use one hour to be updated.

    Finally, about YouTube alerts. I hope they get better. Why? Because they only send alerts when a channel posts a video. No alert if the content is a short or a post. And I feel that fantastic videos are now in shorts format that people misses thinking there is nothing new.

    How do you feel about searching on TikTok? Is it a good source or the allegedly problems with the security and The United States makes them not the best option?

    ReplyDelete
    Replies
    1. Out of topic. Connected with Dr. Russell's upcoming book: Unintended Consequences.

      I just read with Monterey Bay Aquarium this:

      That Rockfish are back...the Sebastes populations are rocking on!

      I'm sure Dr Russell will be happy too. And the story of this good news is full of unintended consequences. This time for good. The return of this fish what will bring?

      Delete
    2. Out of topic

      I was thinking this weekend about weather temperature. And I don't know how to search for the answer.

      We are in North Hemisphere with 10C in temperature at 8 am. However, in Winter many times we have the same temperature and it feels much colder. Why is that?

      I'm sure it's a dumb question. I thought it should be the same feeling in equal conditions. That is no rain or wind. And it's not.

      Delete
    3. Today I remembered our Bougainvillea Challenges. Like this (https://searchresearch1.blogspot.com/2017/11/searchresearch-challenge-111517-what.html?m=1)

      I was thinking why light color bougainvillea blooming is less abundant than the classic dark color ones? And why they don't grow as faster as the dark colored?

      Someone posted one white today. He told me theirs also have these behaviours. He live in Europe.

      Bougainvilleas are amazing and mysterious. Do you know something about this, Dr. Russell?

      Delete
    4. tried [10c seems warmer in summer than winter why]
      doesn't address same location specifically, but may have clues?
      "experts consider more than 100 additional metrics for studying temperature’s effects on people"
      https://www.scientificamerican.com/article/why-does-the-same-temperature-feel-hotter-or-colder-in-different-places/
      ツ 🤷
      https://www.vedantu.com/question-answer/the-color-of-the-bougainvillea-flower-is-due-to-class-11-biology-cbse-5f832a2fa6aa52304a5fcd63
      https://en.wikipedia.org/wiki/Bougainvillea

      Delete
    5. Good day, Remmij. Thanks for the links and everything you share. It's always very interesting

      Delete
    6. The Olympic Games Paris 2024 connected to SRS Challenges

      Phryges
      https://www.bbc.com/mundo/articles/c97dy16zj18o

      Delete
    7. 🥇 🇫🇷 ◯‍◯‍◯‍◯‍◯ 👍 for catching that, Ramon!
      https://parisjetaime.com/eng/article/phryges-mascots-of-the-paris-2024-olympic-and-paralympic-games-a1118
      https://press.paris2024.org/themes/redcurrentsredcurrents/olympics-games/images/assets/paris2024_logo_v2.gif
      "These two red mascots - called the Phryges - symbolise freedom and revolution and will accompany the public to the Paris 2024 Games. The two Phryges, one Olympic and the other Paralympic, with different but complementary characters, have a common mission: to encourage and embody sport in a French and inclusive spirit. With the Phryges of Paris 2024, the revolution through sport is underway!"
      and they are for sale… as always
      The Olympic Phryge : cocarde in the colours of France, olympic mascot plush, to offer from birth...
      The Paralympic Phryge : conveys joy and confidence, ideal souvenir gift, 'Paris 2024' in braille under the sole...
      https://timesofindia.indiatimes.com/life-style/spotlight/meet-paris-2024s-mascot-the-olympic-phryge/articleshow/111956891.cms
      https://www.nbcbayarea.com/news/sports/beijing-winter-olympics/why-theres-no-olympic-rings-emoji-and-which-ones-you-can-use-instead/2801122/
      https://x.com/Olympics?ref_src=twsrc%5Etfw%7Ctwcamp%5Etweetembed%7Ctwterm%5E1489449583352729601%7Ctwgr%5E094845d9ff44a459641adf8756890eeef664d082%7Ctwcon%5Es1_&ref_url=https%3A%2F%2Fwww.nbcbayarea.com%2Fnews%2Fsports%2Fbeijing-winter-olympics%2Fwhy-theres-no-olympic-rings-emoji-and-which-ones-you-can-use-instead%2F2801122%2F

      Delete
  2. As AI explores… (learn, unlearn, relearn)
    https://en.wikipedia.org/wiki/Neuroplasticity
    https://en.wikipedia.org/wiki/Neural_coding
    https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3222570/
    https://www.ncbi.nlm.nih.gov/books/NBK557811/
    some recent:
    https://www.npr.org/sections/shots-health-news/2024/07/18/g-s1-11501/psilocybin-psychedelic-drug-brain-plasticity-depression-addiction
    https://www.nature.com/articles/s41598-024-67469-w
    https://www.stjude.org/media-resources/news-releases/2024-medicine-science-news/lab-grown-human-neuron-assembloids-effectively-model-synaptic-plasticity.html
    https://www.nbcconnecticut.com/news/business/money-report/this-1-factor-increases-risk-of-memory-loss-in-older-adults-new-study-shows/3337296/
    https://www.psypost.org/music-composers-have-more-efficient-neural-pathways-in-specific-brain-regions-study-finds/#google_vignette

    ReplyDelete
  3. "cyber-tribal-techno-cognitive-anthropologist"
    … need more views - (52 currently)
    https://youtu.be/4-t2YAfQ510?si=7euu7UAFJL9pg41U

    ReplyDelete
  4. for grins - one of many BP posts
    Pareidolia - 27:17, your keynote
    https://www.boredpanda.com/interesting-pareidolia-pics/
    https://www.nngroup.com/books/turn-signals-are-the-facial-expressions-of-auto/
    https://en.wikipedia.org/wiki/Computer_Power_and_Human_Reason
    https://en.wikipedia.org/wiki/ELIZA
    fade to black
    https://medium.com/kubo/are-dark-mode-ui-ux-designs-really-progressive-or-are-they-a-fad-9c08ee0d98d6
    https://www.economist.com/leaders/2024/02/08/killer-drones-pioneered-in-ukraine-are-the-weapons-of-the-future

    ReplyDelete
  5. I'm no Alan Fred Titchmarsh - as much as I water this server farm, it just isn't growing fast enough, nor is it 'green'!

    Dr. Teevan - (led to Ada):
    https://www.microsoft.com/en-us/research/project/the-new-future-of-work/
    https://www.microsoft.com/en-us/research/people/teevan/
    https://en.wikipedia.org/wiki/Foundation_model
    https://www.adalovelaceinstitute.org/resource/foundation-models-explainer/
    https://en.wikipedia.org/wiki/Ada_Lovelace
    "Died 27 November 1852 (aged 36)"
    UK spin - https://www.adalovelaceinstitute.org/blog/ai-public-sector-white-heat-hot-air/
    https://www.nuffieldfoundation.org/
    https://en.wikipedia.org/wiki/Nuffield_Trust
    https://www.google.com/search?q=define+metaphysician&rlz=1CAACAC_enUS1032&oq=define+Metaphysician&aqs=chrome.0.0l6.5283j0j7&sourceid=chrome&ie=UTF-8
    J. Teevan had Satya's ear…
    https://timesofindia.indiatimes.com/etimes/trending/microsoft-ceo-satya-nadellas-net-worth-educational-qualification/articleshow/111857391.cms
    UI -
    https://www.datacenterdynamics.com/en/news/us-data-center-power-consumption/
    https://www.energy.gov/eere/buildings/data-centers-and-servers
    fwiw; cowcod/rock fish dine on octopus - unintended consequence?

    ReplyDelete
    Replies
    1. down the garden path -
      https://www.poetryspace.co.uk/2018/03/the-glorious-garden-by-alan-titchmarsh-and-debbie-wiseman/
      https://youtu.be/deHSAya0cWU?si=hiZge3JX5gbLZV-Y
      https://www.youtube.com/@GooglePlayBooks_GPB/featured

      Delete
    2. while floating on the San Juan…
      https://en.wikipedia.org/wiki/List_of_fjords_of_the_United_States
      https://en.wikipedia.org/wiki/List_of_fjords_in_Canada

      Delete
    3. Fjards vs. fjords vs. förden vs. rias:
      https://en.wikipedia.org/wiki/Fjard
      https://climateactiontool.org/ecogroup/coastal-estuaries-embayments
      https://en.wikipedia.org/wiki/Somes_Sound
      https://upload.wikimedia.org/wikipedia/en/e/ee/LaneFitzHughEntranceOfSomesSound.jpg
      https://acadiamagic.com/photo-017.htm
      see Somes images:
      https://www.flickr.com/photos/jsjgeology/with/50085629946/


      Delete
  6. https://en.wikipedia.org/wiki/List_of_fjords_of_Greenland

    https://en.wikipedia.org/wiki/Fjords_and_channels_of_Chile

    https://en.wikipedia.org/wiki/List_of_fiords_of_New_Zealand
    https://upload.wikimedia.org/wikipedia/commons/thumb/6/6e/Milford_Sound_New_Zealand._%2816508409635%29.jpg/1024px-Milford_Sound_New_Zealand._%2816508409635%29.jpg

    "Fjords are found mainly in Norway, Chile, New Zealand, Canada, Greenland, and the U.S. state of Alaska. Sognefjorden, a fjord in Norway, is more than 160 kilometers (nearly 100 miles) long. Fjords were created by glaciers. In the Earth's last ice age, glaciers covered just about everything."

    ReplyDelete
  7. Reddit /r/localllama, Medium towardsdatascience, Google Discover feed. In general, slow search is good for discovery, e.g. https://www.microsoft.com/en-us/research/wp-content/uploads/2016/04/hcir13.pdf

    ReplyDelete
  8. will insurance cover it? as a medical condition
    and is there a support group or pill?
    https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8283615/

    ReplyDelete