High Output AI
By High Output AI
High Output AISep 08, 2023
AI impresonating humans, how will we prove we are real? | EP045
What happens when AIs become indistinguishable from humans? Elliot & Tom tackle the question of will we need to prove life in a digital world? Show Notes - Bots beat CAPTCHA results https://qz.com/ai-bots-recaptcha-turing-test-websites-authenticity-1850734350 - On the internet, nobody knows you are human https://www.theverge.com/2023/2/24/23608961/tiktok-creator-bot-accusation-prove-theyre-human - AI detection tools falsely accus international students of cheating https://themarkup.org/machine-learning/2023/08/14/ai-detection-tools-falsely-accuse-international-students-of-cheating Runsheet 00:00 The Fun begins 01:45 The problem of AIs replicating humans and becoming indistinguishable 05:00 Are AIs replicating humans an issue at all? 10:20 Should we have the right to know we are conversing with a human or and AI? 11:30 Do we have a right to know about AI generated content? 17:00 Are AI detectors failing? 23:30 Moving towards a zero trust world, only relying on certain logos and URLs 26:30 Will financial verification be a form of proving life? 28:10 How will creators proving your work is your own? 32:15 Will AI create it's own style attributable it? 34:50 How will social media juggle creative bots vs bad bots? 40:10 How will places deal with autobanning or shadown ban real humans? 43:00 Wrapping up
Computational pathology and the future of AI cancer detection - Dr Thomas Fuchs - EP044
Dr. Thomas J. Fuchs is the Founder and Chief Scientist at Paige. He is a pioneer in the groundbreaking field of computational pathology, using artificial intelligence to analyze images of tissue samples to identify disease, recommend treatment and predict outcome and was named one of the Top 100 AI Leaders in Drug Discovery and Advanced Healthcare in 2019. He is also the Dean of Artificial Intelligence and Human Health and Co-Director of the Hasso Plattner Institute for Digital Health at the Icahn School of Medicine at Mount Sinai. Show Notes - https://paige.ai/ - https://www.linkedin.com/in/fuchsthom... - https://www.accessdata.fda.gov/cdrh_d... - https://pathsocjournals.onlinelibrary... Runsheet 00:00 Intro to our wonderful guest 01:18 What did rockets and the Mars rover teach Thomas about machine learning? 05:20 Where did the spark for Paige come from? Where is Paige today? 08:00 The AI that makes Paige what it is today? 12:48 Are pre-trained transformers effective in the application of AI in the medical sphere? 15:30 How do deal with data quality and bottlenecks in Paige? 19:00 How does Paige prioritise what AI models to build and what questions to ask? 21:45 What are some of the biggest accelerants for Paige and AI at the moment? 26:30 Where are areas being overlooked in the medical AI field? 31:15 How should a an engineer balance their clinical and technical skill development? 34:00 What are some of the biggest challenges that Paige faces? 38:15 What opportunities do you see to work directly with the patient through Paige? 41:30 What does the next 10 years look like for Paige? 44:30 How do you consider distributing Paige to parts of the world that need it but don’t have the infrastructure? 49:00 How do you keep on top of all the information in your fields? 53:25 Wrapping it up
Where are VCs investing in AI? | EP042
This week Tom and Elliot talk through the most active VCs in the AI space. Exploring what the big players, the old players and the new players are all doing. ⌚Time Stamps⌚ 00:00 The fun begins 01:00 Where are VCs investing in AI? 04:00 What is the top 5 VCs strategy when it comes to AI? Who are the most active? 22:00 What does the YCombinator cohort look like? 35:00 What are the new AI focussed funds? ⚡Show Notes ⚡ - https://www.sequoiacap.com/our-companies/?_categories=ai-ml&_sort=stage_at_investment-asc - https://www.nea.com/news/press-releases/nea-closes-on-two-funds-totaling-6-2-billion - https://techcrunch.com/2023/05/09/sound-ventures-has-already-plugged-half-its-new-240-million-ai-fund-into-three-companies/ - https://www.ycombinator.com/blog/meet-the-yc-winter-2023-batch 👋CONTACT Any feedback? Leave a comment or hit us on twitter/mastodon @tom_k_white, @elliotcsmith@mastodon.social 👋Come Chat Join our Discord https://discord.gg/YhCTTEF9#podcast #tech #ai #startup
Which AI Startups Would We Invest In? | EP041
This week Tom and Elliot talk through some active startups using AI in their products. We discuss which ones we would invest in if we could. With so many startups to choose from we had to filter the list. ⌚Time Stamps⌚ 00:00 The fun begins 04:00 Scale-ups building AI 22:20 Early Stage companies building AI 27:00 Early stage companies using AI 44:00 Scale-ups using AI 48:00 What big tech is building and buying ⚡Show Notes ⚡ - https://neeva.com/blog/may-announcement - https://www.askfelix.ai/ - https://www.crunchbase.com/organization/builderai - https://www.hippocraticai.com/ - https://orby.ai - https://gan.ai - https://www.safely-you.com/ - https://www.spellbook.legal - https://www.mosaicml.com/ - https://beta.character.ai/help - https://www.harvey.ai/blog - https://www.deepl.com/en/blog/how-does-deepl-work - https://shield.ai/ 👋CONTACT Any feedback? Leave a comment or hit us on twitter/mastodon @tom_k_white, @elliotcsmith@mastodon.social 👋Come Chat Join our Discord https://discord.gg/YhCTTEF9 #podcast #tech #ai #startup
Can we regulate AI? | EP040
Is AI a Product or a Feature | EP039
This week we discuss if AI is going to be a product on its own or a feature in every product. What are the ramifications of this for big tech, consumers and AI startups. Enjoy! ⌚Time Stamps⌚ 00:00:00 - Start 00:04:13 - Is AI A Product or a Feature 00:12:17 - The AI Value Chain 00:24:45 - The Need for National AI Capacity 00:38:19 - Are the big tech companies going to win or lose? 👋CONTACT Any feedback? Leave a comment or hit us on twitter/mastodon @tom_k_white, @elliotcsmith@mastodon.social 👋Come Chat Join our Discord https://discord.gg/gAsSnctwCx #podcast #tech #ai #startup
The current state and future of Open Source AI | High Output AI EP038
Tom and Elliot talk about open source AI. We discuss where it is today, how Github and Hugging Face have helped shape it and where it's likely to go in the future. ⚡Show Notes⚡ - https://thesequence.substack.com/p/open-source-generative-ai-is-experiencing - https://cognitiverevolution.substack.com/p/openais-foundry-leaked-pricing-says - https://twitter.com/EMostaque/status/1649881019053404163 - https://redmonk.com/jgovernor/2023/04/13/the-great-flowering-why-openai-is-the-new-aws-and-the-new-kingmakers-still-matter/ - https://stability.ai/blog/stability-ai-launches-the-first-of-its-stablelm-suite-of-language-models 👋CONTACT Any feedback? Leave a comment or hit us on twitter/mastodon @tom_k_white, @elliotcsmith@mastodon.social 👋Come Chat Join our Discord https://discord.gg/gAsSnctwCx #podcast #tech #ai #startup
Are Foundation Models the Future of AI? | EP037
This week Tom and Elliot talk all things Foundation models. Which models are next? Are foundation models the infrastructure layer for AI? Is there room to compete on foundation models? We cover news, deals and papers all focused on this one question. We're trying something new with the format, focusing our chats around a single idea each week. Let us know what you think! ⌚Time Stamps⌚ 00:00 The fun begins 01:20 The New Format 02:45 Are Foundation Models the Future of Artificial Intelligence? 04:00 What is a Foundation Model? What are the characteristics that define a Foundation Model? 08:00 Is GPT-4 a Foundation Model? Examples of current Foundation Models 10:15 Meta's Segment Anything Model - is it a Foundation Model? 18:30 Is Bedrock a genius move by Amazon? 23:45 THe Llama effect 30:45 The future. Are Foundation Models the Future of Artificial Intelligence? ⚡Show Notes⚡ 📰Are Foundation Models the Future of Artificial Intelligence?📰 - Facebook Releases the Segement Anything Model (SAM) https://ai.facebook.com/blog/segment-anything-foundation-model-image-segmentation/ - Amazon announces 'Bedrock,' its ChatGPT and DALL-E rival https://www.businessinsider.com/amazon-bedrock-aws-ai-chatgpt-dall-e-competitor-2023-4 - The LLama Effect: How an Accidental Leak Sparked a Series of Impressive Open Source Alternatives to ChatGPT https://thesequence.substack.com/p/the-llama-effect-how-an-accidental 💲Dealbook💲- - Fixie.ai raises $17m seed round https://blog.fixie.ai/the-future-of-software-development-with-llms-is-here-announcing-fixies-developer-preview-and-17m-cf6fca0c4041 - Chroma raises $18m seed round - Anthropic plans to raise $5b to take on OpenAI https://techcrunch.com/2023/04/06/anthropics-5b-4-year-plan-to-take-on-openai/ ⚡Show Notes⚡ 📰Topic📰 - Facebook Releases the Segement Anything Model (SAM) https://ai.facebook.com/blog/segment-anything-foundation-model-image-segmentation/ - The LLama Effect: How an Accidental Leak Sparked a Series of Impressive Open Source Alternatives to ChatGPT https://thesequence.substack.com/p/the-llama-effect-how-an-accidental - Amazon announces 'Bedrock,' its ChatGPT and DALL-E rival https://www.businessinsider.com/amazon-bedrock-aws-ai-chatgpt-dall-e-competitor-2023-4 💲Dealbook💲 - Fixie.ai raises $17m seed round https://blog.fixie.ai/the-future-of-software-development-with-llms-is-here-announcing-fixies-developer-preview-and-17m-cf6fca0c4041 - Chroma raises $18m seed round - Anthropic plans to raise $5b to take on OpenAI https://techcrunch.com/2023/04/06/anthropics-5b-4-year-plan-to-take-on-openai/\ 👋CONTACT Any feedback? Leave a comment or hit us on twitter/mastodon @tom_k_white, @elliotcsmith@mastodon.social 👋Come Chat Join our Discord https://discord.gg/gAsSnctwCx#podcast #tech #ai #startup
A Letter to Stop AI & Tonnes of New Papers, 1 Year of HOAI 🎂 | Podcast EP036
Tom and Elliot talk latest AI news, what deals happened recently, a few new papers and a deep dive into a big topic in the AI world ⌚Time Stamps⌚ 00:00 The fun begins 03:00 News of the week 11:00 Dealbook 20:00 Papers 55:00 Random Lex Friedman & Sam Altman detour 59:00 Signing off ⚡Show Notes⚡ 📰News📰 - The Letter to pause AI development for 6-months https://futureoflife.org/open-letter/pause-giant-ai-experiments 💲Dealbook💲 - Perplexity raises $26.5m https://www.bloomberg.com/news/articles/2023-03-28/ai-search-startup-raises-26-million-to-offer-rival-to-google 📜Papers📜 - HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in HuggingFace https://arxiv.org/abs/2303.17580 - BloombergGPT: A Large Language Model for Finance https://arxiv.org/abs/2303.17564 - DiffCollage: Parallel Generation of Large Content with Diffusion Models https://research.nvidia.com/labs/dir/diffcollage/ - Text2Video-Zero https://huggingface.co/spaces/PAIR/Text2Video-Zero - Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Prior https://arxiv.org/abs/2303.14184 - GestureDiffuCLIP: Gesture Diffusion Model with CLIP Latents https://arxiv.org/abs/2303.14613 - ChatGPT or Grammarly? Evaluating ChatGPT on Grammatical Error Correction Benchmark https://arxiv.org/abs/2303.13648 👋CONTACT Any feedback? Leave a comment or hit us on twitter/mastodon @tom_k_white, @elliotcsmith@mastodon.social 👋Come Chat Join our Discord https://discord.gg/gAsSnctwCx #podcast #tech #ai #startup
How GPT-4 stacks up + Deals, Deals, Deals | EP035
Tom and Elliot talk latest AI news, what deals happened recently, a few new papers and a deep dive into a big topic in the AI world
⌚Time Stamps⌚
00:00 The fun begins
03:00 GPT-4 Released
⚡Show Notes
📰News📰
- Comparison to GPT-3 https://neoteric.eu/blog/gpt-4-vs-gpt-3-openai-models-comparison/
- Funny overstated GPT-4 tweets https://twitter.com/alvinfoo/status/1634777513787379714
- DuoLingo releases AI https://blog.duolingo.com/duolingo-max/
- Grammarly has introduced GrammarlyGO! https://9to5google.com/2023/03/09/grammarly-ai-generative/?utm_source=substack&utm_medium=email
- Tuned to your specific writing style
- Google and Microsoft add AI to their office suite https://www.vox.com/technology/2023/3/16/23643806/ai-microsoft-word-powerpoint-office-google-artificial-intelligence-chatgpt-automation-jobs-work & https://www.youtube.com/watch?v=6DaJVZBXETE
- Google announces an API for PaLM and MakerSuite - https://developers.googleblog.com/2023/03/announcing-palm-api-and-makersuite.html
- US Copyright Office Issues Statement on Copyright and AI - https://www.federalregister.gov/documents/2023/03/16/2023-05321/copyright-registration-guidance-works-containing-material-generated-by-artificial-intelligence
- Samsung tries to defend its Moon AI - https://www.samsungmobilepress.com/feature-stories/how-samsung-galaxy-cameras-combine-super-resolution-technologies-with-ai-technology-to-produce-high-quality-images-of-the-moon/
- AI Fools the ATO - https://www.theguardian.com/technology/2023/mar/16/voice-system-used-to-verify-identity-by-centrelink-can-be-fooled-by-ai
💲Dealbook💲
- Adept Raises $350m https://www.reuters.com/technology/adept-raises-350-mln-series-b-funding-2023-03-14/
- Salesforec investment fund https://betakit.com/cohere-among-first-investments-from-salesforces-new-250-million-ai-fund/
- AI version of crappy product Tom & Elliot tried to make https://www.hearth.ai/category - Honestly this looks like rekin + AI
- New AI search engine https://you.com/
- Another 300M for Anthropic https://news.crunchbase.com/ai-robotics/anthropic-raise-google/
- Built NYC has released a fund https://www.builtinnyc.com/2023/03/13/nyc-tech-news-031323?utm_source=linkedin
- Amelia pulled in $175M https://www.prnewswire.com/news-releases/amelia-announces-175-million-strategic-investment-from-buildgroup-and-monroe-capital-301764483.html
- Candidly scored $20.5M https://www.builtinnyc.com/2023/03/08/candidly-gains-20m-student-loan-payments
- Humane raises $100m https://techcrunch.com/2023/03/08/humane-the-secretive-ai-startup-founded-by-ex-apple-employees-raises-another-100m/
- South Korea Government to build the world's largest chip center in Seould -? $230b in investment https://edition.cnn.com/2023/03/15/tech/korea-chips-investment-hnk-intl/index.html
- UK Government is to invest 900m pound on a supercomdputer as part of their AI strategy https://www.theguardian.com/technology/2023/mar/15/uk-to-invest-900m-in-supercomputer-in-bid-to-build-own-britgpt
👋CONTACT
Any feedback? Leave a comment or hit us on twitter/mastodon @tom_k_white, @elliotcsmith@mastodon.social
👋Come Chat Join our Discord https://discord.gg/gAsSnctwCx
#podcast #tech #ai #startup
Cover art generated by Midjourney.
New AI APIs, VC Deals Everywhere and New Papers from Meta | Podcast EP034
Tom and Elliot talk latest AI news, what deals happened recently, a few new papers and a deep dive into a big topic in the AI world
⌚Time Stamps⌚
00:00 The fun begins
⚡Show Notes
📰News📰
- ChatGPT & Whisper APIs https://openai.com/blog/introducing-chatgpt-and-whisper-apis
- Reid Hoffman steps down from OpenAI board https://www.cnbc.com/2023/03/03/reid-hoffman-steps-down-from-openai-board-to-avoid-potential-conflicts.html
- Bain & Co partner with OpenAI https://www.bain.com/vector-digital/partnerships-alliance-ecosystem/openai-alliance/?utm_source=substack&utm_medium=email
- Hugging Face & AWS partner https://huggingface.co/blog/aws-partnership
💲Dealbook💲
- https://www.ft.com/content/b230eb4c-ed53-45ff-8b64-c286a4b98fc1
- https://techcrunch.com/2023/03/02/indent-raises-8-1m-funding-to-continue-developing-its-ai-powered-customer-video-review-tool/
- https://www.uktech.news/ai/colossyan-funding-20230228
- https://fortune.com/2023/03/04/stability-ai-raise-funds-4-billion-valuation-artificial-intelligence-captivates-investors/
- https://news.crunchbase.com/ai-robotics/venture-funding-ai-startup-typeface/
🎓New Papers🎓
- https://github.com/yu-takagi/StableDiffusionReconstruction
- https://ieeexplore.ieee.org/abstract/document/9996741
- Meta's Minotaur https://arxiv.org/abs/2302.08063
- Meta's Lever https://arxiv.org/abs/2302.08468
👋CONTACT
Any feedback? Leave a comment or hit us on twitter/mastodon @tom_k_white, @elliotcsmith@mastodon.social
👋Come Chat Join our Discord https://discord.gg/gAsSnctwCx
#podcast #tech #ai #startup
Thumbnail image imagined with midjourney.
Browser AI Wars begin, AI Theory of Mind & Getty Lawyers Up | Podcast EP032
Tom and Elliot talk latest AI news, what deals happened recently, a few new papers and a deep dive into a big topic in the AI world
⌚Time Stamps⌚
00:00 The fun begins
02:18 News
21:41 Dealbook
28:15 Papers
59:22 Wrapping Up
⚡Show Notes
📰News📰
- Getty Images files Infringement against Stability in the US https://copyrightlately.com/pdfviewer/getty-images-v-stability-ai-complaint/
- Stable Attribution https://www.stableattribution.com/
- Google unveils Bard https://blog.google/technology/ai/bard-google-ai-search-updates/
- Microsoft unveils new edge & bing upgrade by ChatGPT search https://www.theverge.com/2023/2/7/23587454/microsoft-bing-edge-chatgpt-ai & https://blogs.microsoft.com/blog/2023/02/07/reinventing-search-with-a-new-ai-powered-microsoft-bing-and-edge-your-copilot-for-the-web/
- https://twitter.com/marvinvonhagen/status/1625852323753762816
💲Dealbook💲
- Goolge Cloud invests ~$300m into Anthropic https://www.ft.com/content/583ead66-467c-4bd5-84d0-ed5df7b5bf9cx
- Overview of Claude by Anhropic https://scale.com/blog/chatgpt-vs-claude#Analysis%20of%20fictional%20works
🎓New Papers🎓
- BioGPT - https://academic.oup.com/bib/article/23/6/bbac409/6713511?guestAccessKey=a66d9b5d-4f83-4017-bb52-405815c907b9&login=false
- Steps towards prompt-based creation of virtual worlds - https://arxiv.org/pdf/2211.05875.pdf
- Theory of Mind May Have Spontaneously Emerged in Large Language Models - https://arxiv.org/pdf/2302.02083.pdf
- Deep learning for twelve hour precipitation forecasts - https://www.nature.com/articles/s41467-022-32483-x
👋CONTACT
Any feedback? Leave a comment or hit us on twitter/mastodon @tom_k_white, @elliotcsmith@mastodon.social
👋Come Chat Join our Discord [https://discord.gg/kjKT5vp4
#podcast #tech #ai #startup
AI Video Effects, LoLNERF & the Foundational Transformer Paper | EP031
Tom and Elliot talk latest AI news, biggest deals, new papers and a deep dive into a topic.
⌚Time Stamps⌚
00:00 Episode 31
02:45 Metaphysics announced as the AI VFX provider for the movie Here
10:45 ElevenLabs gets ruined by 4chan
19:45 ChatGPT integrations in Microsoft Teams Premium
29:15 DreamIx Paper
30:30 DeepMind's Sample Efficient Deep Reinforcement Learning via Local Planning
34:45 LoLNerf by Google
39:00 Attention is all you need, the foundational paper for Transformers DeepDive
⚡Show Notes
📰News📰
- Metaphysics has been announced as the AI VFX provider for the upcoming film 'Here', https://metaphysic.ai/ai-hollywood-miramax-here/#
- ElevenLabs' tech being used to deepfake celebrities https://beta.elevenlabs.io/about, https://www.vice.com/en/article/dy7mww/ai-voice-firm-4chan-celebrity-voices-emma-watson-joe-rogan-elevenlabs
- Microsoft Teams Premium https://www.microsoft.com/en-us/microsoft-365/blog/2023/02/01/microsoft-teams-premium-cut-costs-and-add-ai-powered-productivity/
💲Dealbook🤑
- ValueBase, https://www.valuebase.co/, raised $1.6m from Sam Altman, https://techcrunch.com/2023/02/01/valuebase-backed-by-sam-altmans-hydrazine-raises-1-6-million-seed-round/
🎓Papers🎓
- Dreamix https://dreamix-video-editing.github.io/
- Sample Efficient Deep Reinforcement Learning via Local Planning https://arxiv.org/pdf/2301.12579.pdf
- LoLNeRF https://ubc-vision.github.io/lolnerf/
🔬DeepDive🔬
- Attention is all you need https://arxiv.org/abs/1706.03762
👋CONTACT
Any feedback? Leave a comment or hit us on twitter/mastodon @tom_k_white, @elliotcsmith@mastodon.social
👋Come Chat
Join our Discord https://discord.gg/kjKT5vp4
#podcast #tech #ai #startup
Stability sued, Microsoft's largest investment & DeepMind DeepDive ft. Google | Podcast EP030
Tom and Elliot talk latest AI news covering the first legal action in the generative image space against Stability and also Microsoft's investment into OpenAI. They then dive into Google's AI capability and all the different teams producing fantastic work.
⌚Timestamps
00:00 Episode 30
⚡Show Notes
Coming soon
👋CONTACT
Any feedback? Leave a comment or hit us on twitter/mastodon
@tom_k_white, @elliotcsmith@mastodon.social
👋Come Chat
Join our Discord https://discord.gg/kjKT5vp4
#podcast #tech #ai #startup
VALL-E, OpenAI Investment and a GAN deepdive | Podcast EP029
Tom and Elliot talk latest AI news and investments then dive into GANs, their history and their legacy. Hope you enjoy!
Timestamps
00:00 Episode 29
00:18 Introduction
03:37 VALL-E
12:22 Open AI Investment Rumor
22:54 HPE Buys Patchyderm
24:36 Deep Voodoo from the Southpark team
28:00 Rapid Silicon and AI FPGAs
32:08 What's a GAN, Man?
51:02 Closing Thoughts
👋CONTACT
Any feedback? Leave a comment or hit us on twitter/mastodon
@tom_k_white, @elliotcsmith@mastodon.social
👋Come Chat
Join our Discord https://discord.gg/kjKT5vp4
#podcast #tech #ai #startup
2022 in review & 2023 predictions | EP028
The review of all that happened in 2022 in the AI & Machine Learning world. Elliot & Tom discuss the biggest developments and have talk about what they think will come next year.
⏲️Timestamps⏲️
00:00 Intro & beverages
More to come soon.
⚡Shownotes⚡
👋CONTACT
Any feedback? Leave a comment or hit us on twitter
@tom_k_white, @elliot_c_smith
👋FRIENDSSSSSS
Join our Discord https://discord.gg/kjKT5vp4
#podcast #tech #ai #startup
Meta's data2vec and which jobs survive ChatGPT | EP027
This week Tom and Elliot talk about Meta's data2vec release and also start to see what the world looks like after the ChatGPT dust has settled.
⏲️Timestamps⏲️
00:00 Intro & beverages
More to come soon.
⚡Shownotes⚡
Coming soon....
👋CONTACT
Any feedback? Leave a comment or hit us on twitter
@tom_k_white, @elliot_c_smith
👋FRIENDSSSSSS
Join our Discord https://discord.gg/kjKT5vp4
#podcast #tech #ai #startup
The ChatGPT Episode | EP026
AI Takeoff Speeds Episode 002 Recast | EP024
Tom and Elliot discuss how quickly AI might become super intelligent. Taken from Episode 002, excuse the audio quality as we warm up to it.
⚡Show Notes⚡
- https://astralcodexten.substack.com/p/yudkowsky-contra-christiano-on-ai?s=r
- https://en.wikipedia.org/wiki/GPT-3
- lesswrong.com/
- http://gwern.net/
- Hammock Driven Development: https://www.youtube.com/watch?v=f84n5oFoZBc
- Manager vs maker: http://www.paulgraham.com/makersschedule.html
- Do the real thing: https://www.scotthyoung.com/blog/2020/05/04/do-the-real-thing/)
- Cal Newport coffee shops: https://www.calnewport.com/blog/2013/08/14/deep-work-and-the-good-life/
👋CONTACT
Any feedback? Leave a comment or hit us on twitter
@tom_k_white, @elliot_c_smith
#podcast #tech #ai #startup
Explosion of AI content & energy consumption | EP023
This week Tom and Elliot talk about a broad range of topics continuing on the news from previous weeks and also discussing new things on the scene. They hit the topics of the explosion in AI generated content, Meta's shareholders wanting them to double down on AI, the US creating a bill of rights to protect humans from AI and the increase of energy consumption to train models. Hope you enjoy.
⏲️Timestamps⏲️
00:00 Intro & beverages
02:50 Todays’s runsheet
03:20 AI generated prose & Tweets
16:50 Shutterstock now selling AI generated images and “sharing” the revenue with creators
29:00 Canva & Microsoft’s AI image generation tools
31:00 Meta shareholders ask them to double down on AI
41:25 US Blueprint for an AI Bill of Rights
48:55 Humans & AI competing for resources
52:57 Sovereign compute & bandwidth
57:55 AI Energy consumption and the future battle for resources
1:08:25 Lude image detectors by Bumble
1:11:55 Conclusion
⚡Shownotes⚡
- Moonbeam text creator https://www.gomoonbeam.com/
- AI Twitter creator, Tweet Hunter https://tweethunter.io/
- Lex writer block tool https://every.to/cybernaut/an-ai-might-have-written-this
- Cal Newport digital minimalism for parents https://www.calnewport.com/blog/2019/03/01/digital-minimalism-for-parents/
- AI created characters https://beta.character.ai/
- Balaji, Lex F interview https://www.youtube.com/watch?v=VeH7qKZr0WI
- Shutterstock now sells AI generated images https://www.theverge.com/2022/10/25/23422359/shutterstock-ai-generated-art-openai-dall-e-partnership-contributors-fund-reimbursement
- Bill Garaghty’s open letter to Meta https://medium.com/@alt.cap/time-to-get-fit-an-open-letter-from-altimeter-to-mark-zuckerberg-and-the-meta-board-of-392d94e80a18
- Meta creates AI that translates languages without written content https://mashable.com/article/meta-ai-oral-language-translation-hokkien-english
- DeepMinds case studies in the digital transformation https://www.deepmind.com/blog/digital-transformation-with-google-cloud
- US Bill of Rights for AI (actually for humans) https://www.whitehouse.gov/ostp/ai-bill-of-rights/
- AI energy consumption https://medium.com/@ali_razavian/ai-crypto-and-the-great-blackout-91cfecf8ae9b
- GitHub repository for Bumble's "Lude Image Detector" https://github.com/bumble-tech/private-detector
👋CONTACT
Any feedback? Leave a comment or hit us on twitter
@tom_k_white, @elliot_c_smith
👋FRIENDSSSSSS
Join our Discord https://discord.gg/kjKT5vp4
#podcast #tech #ai #startup
$100M+ seed rounds for Stability & Jasper AI | EP022
This week Tom and Elliot talk about the $225m that flew into the seed rounds for Stability AI and Jasper AI. They also touch on the rumours about OpenAI's discussions with Microsoft about further financing.
⏲️Timestamps⏲️
00:00 100% more audio introduction
01:30 The three big invesments pieces of news this week
05:00 Two of the biggest seed rounds
06:10 Stability AI's seed round & the universe
12:45 Making an episode fully AI
13:35 Detailed information on the Stability AI round
15:00 Don't pick the hype for your PhD
17:40 The Hedge Fund Play by Stability AI
18:30 4000 GPUs from Stability AI
20:40 Stability delays the release of v1.5 of Stable Diffusion and the consequences
27:15 Elliot's spicy take🌶️ and Stavility AI's competive new future
31:15 OpenAI's discussion with Microsoft
35:00 The release history by OpenAI and the trend of closing
38:45 Imagik Paper and reinventing images
41:00 The challenges of prompt engineering
44:00 Final words on Stability AI's round
48:12 Jasper AI's round
52:00 Marketing dribble just exploded 100x
53:20 Advertising doesn't work that way
54:30 All consumer brand's will be gone in 30 years
59:00 The Sideways effect on the wine market
1:01:30 Pineapples & social signalling
1:03:20 Humans filtering out AI content
1:04:40 Jasper's product demo
1:06:10 Propogating errors through the internet
1:11:00 Wrapping up
⚡Show Notes⚡
- Stability AI's $101m Seed Round https://techcrunch.com/2022/10/17/stability-ai-the-startup-behind-stable-diffusion-raises-101m/
- Jasper AI's $125m Seed Round https://techcrunch.com/2022/10/18/ai-content-platform-jasper-raises-125m-at-a-1-7b-valuation/
- OpenAI in discussion with Microsoft for further funding https://www.theinformation.com/articles/openai-valued-at-nearly-20-billion-in-advanced-talks-with-microsoft-for-more-funding
- Not Andrew Street... Andrew Scott https://www.imdb.com/name/nm0778831/
- Stable Diffusion Launch https://stability.ai/blog/stable-diffusion-announcement
- Dreamstudio https://beta.dreamstudio.ai/home
- Ali Abdaal AI tweet https://mobile.twitter.com/AliAbdaal/status/1582835494475698176
- Moonbeam editing tool https://www.gomoonbeam.com/
- Emad Mostaque CEO of Stability AI https://en.wikipedia.org/wiki/Emad_Mostaque
- Stability AI demo day https://www.youtube.com/watch?v=1Uy_8YPWrXo&t=2415s&ab_channel=RobertScoble
- Why Stability delayed v1.5 release of Stabel Diffusion https://danieljeffries.substack.com/p/why-the-future-of-open-source-ai
- Imagik https://imagick.ai/
- Jasper AI Demo https://www.jasper.ai/demo
- Ads don't work that way https://meltingasphalt.com/ads-dont-work-that-way/
- The Sideways Effect on Merlot https://www.npr.org/sections/thesalt/2017/07/05/535038513/the-sideways-effect-how-a-wine-obsessed-film-reshaped-the-industry
- The Myth of Spinach https://www.compoundchem.com/2018/07/17/spinach/
-Malcolm Gladwell on memory https://www.pushkin.fm/podcasts/revisionist-history/free-brian-williams
👋CONTACT
Any feedback? Leave a comment or hit us on twitter
@tom_k_white, @elliot_c_smith
👋FRIENDSSSSSS
Join our Discord https://discord.gg/kjKT5vp4
#podcast #tech #ai #startup
Tesla AI Day & Data Laundering -- IN PERSON! | EP021
For the first time in a long time Elliot and Tom are in the same room. This week we talk mostly about Tesla's AI day, as well as touching on the "Data Laundering " that is happening in the image generation world. Warning, we get pretty boozed towards the end.
⏲️Timestamps⏲️
00:00 Drinking in person
02:00 Part 1 - Tesla AI Day intro
07:20 NERF & other Vision AI models
14:50 Lanes languages and using attention in vision
21:15 Data & Training capabilities behind FSD
25:25 The infrastructure behind it all
31:00 Tesla makes their own silicon + NVIDIA rambles
38:35 Final comments on Tesla AI day
43:16 Data Laundering
46:55 OpenAI question to US Patents & Tradmark office
55:42 Stadia died because no one trusts google
⚡Show Notes⚡
Part 1 - Tesla AI Day
- Tesla AI Day stream - https://www.youtube.com/watch?v=ODSJsviD_SU&ab_channel=Tesla
- Radiance Fields - https://datagen.tech/guides/synthetic-data/neural-radiance-field-nerf/
- LIDAR is doomed, Elon Musk - https://youtu.be/HM23sjhtk4Q
- Elon Musk's perfume - https://gizmodo.com/elon-musks-100-burnt-hair-perfume-has-sold-out-1849676199
- Russian army using chips from fridges - https://www.reddit.com/r/UkraineWarVideoReport/comments/xiqhu4/ursula_von_der_leyen_the_russian_army_is_removing/
- Meta announces Legs - https://techcrunch.com/2022/10/11/meta-announces-legs/
Part 2
- Data Laundering Article - https://waxy.org/2022/09/ai-data-laundering-how-academic-and-nonprofit-researchers-shield-tech-companies-from-accountability/
- OpenAI request for comment - https://www.uspto.gov/sites/default/files/documents/OpenAI_RFC-84-FR-58141.pdf
- Temtem - https://store.steampowered.com/app/745920/Temtem/
Part 3 - Google Stadia
- Stadia died because no one trusts google - https://techcrunch.com/2022/10/01/stadia-died-because-no-one-trusts-google/
- Player with 6k hours of Red Dead Redemption 2 loses everything https://www.cbr.com/red-dead-redemption-2-player-6000-google-stadia-hours-rockstar/
👋CONTACT
Any feedback? Leave a comment or hit us on twitter
@tom_k_white, @elliot_c_smith
#podcast #tech #ai #startup
Text to Video, New GPUs from Intel and NVIDIA's rocky future | EP020
This week Tom and Elliot cover new models, new hardware and all the interesting things they came across this week.
⏱️Time stamps⏱️
00:00 Introduction
02:53 DALLE-2 removes their wait list
07:42 Meta releases a paper on Make-a-video, a text to video model
12:01 Dreamfusion's text to 3D model generation
16:48 VTOONIFY released for converting portrait videos into caricatures
20:32 StockAI launched and just probably has legal action coming their way
23:33 NVIDIA Launches Cloud SaaS business
26:53 AMD Ryzen700 CPU Launch
29:00 New Intel GPUs
30:48 Reducing 100k equations to 4 using AI
35:25 NVIDIA in the valley
41:38 EchoNet outperforms sonographers
44:30 Learning a language by talking to AI
47:00 Designing the perfect keyboard using AI
49:05 Is Stadia really dead?
55:00 Closing bants
⚡Show Notes⚡
💿Model News
- DALL-E removes their wait list… https://www.theverge.com/2022/9/28/23376328/ai-art-image-generator-dall-e-access-waitlist-scrapped
- Meta releases a paper on a model called Make-a-video - https://ai.facebook.com/blog/generative-ai-text-to-video/
- Dreamfusion text to 3D model https://dreamfusion3d.github.io/
- VTOONIFY https://www.mmlab-ntu.com/project/vtoonify/
- StockAI launched https://www.stockai.com/
- Original tweet showing the copyright issues StockAI faces https://twitter.com/frantzfries/status/1574557008950329354
🖥️ Hardware News
- NVIDIA releases cloud service for metaverse creators https://nvidianews.nvidia.com/news/nvidia-launches-omniverse-cloud-services-for-building-and-operating-industrial-metaverse-applications
- AMD new CPU launch https://arstechnica.com/gadgets/2022/09/everything-you-need-to-know-about-zen-4-socket-am5-and-amds-newest-chipsets/
- New Intel GPUs https://www.intel.com/content/www/us/en/products/details/discrete-gpus/arc.html
🔬 Science News
- Researchers reduce equations from 100k to 4 https://www.simonsfoundation.org/2022/09/26/artificial-intelligence-reduces-a-100000-equation-quantum-physics-problem-to-only-four-equations/
🪣Misc. Bucket
- NVIDIA in the valley, Stratechery https://stratechery.com/2022/nvidia-in-the-valley/
- EchoNet outperforming sonographers for LV function test https://www.tctmd.com/news/echonet-ai-algorithm-beats-sonographers-estimating-lv-function
- Learning a language by talking to AI https://talk.quazel.com/chat/try
- Stadia is officially dead https://www.theverge.com/2022/9/29/23378713/google-stadia-shutting-down-game-streaming-january-2023
New GPUs, New Courses, New Models & Emerging AI | EP019
In a new format, Tom and Elliot talk about a collection of interesting new releases from the last couple of weeks. Hope you're enjoying the show.
⌛Timestamps
00:00:00 - Start
00:03:04 - New NVIDIA GPUs
00:15:00 - Deepmind investigates Emergent Abilities of AI
00:30:23 - Getty Images Bans AI Content
00:35:57 - Chal-E & Blender Textures Using AI
00:44:20 - OpenAI Whisper
00:46:33 - McKinsey Report on AI in China
00:53:02 - New Fast AI Course & ACT-1 Preview
⚡Show Notes⚡
New NVIDIA chip releases
— NVIDIA 4000 series - https://www.nvidia.com/en-gb/geforce/graphics-cards/40-series/
— Coreteks breakdown of NVIDIA performance - https://www.youtube.com/watch?v=ATS-fyQZuwA&ab_channel=Coreteks
— Tom breaks down the new GPU perfromance - https://www.youtube.com/shorts/7raAVrdilSw
— Ada Lovalace Architecture - https://www.nvidia.com/en-gb/geforce/ada-lovelace-architecture/
— Ada Lovelace - https://en.wikipedia.org/wiki/Ada_Lovelace
— Google Colab - https://colab.research.google.com/
— Buy Elliot's coffee machine...
— Wikitext-2 - https://paperswithcode.com/dataset/wikitext-2
Emerging AI
— Emerging AI by DeepMind- https://bdtechtalks.com/2022/08/22/llm-emergent-abilities/
— Getty Images bans AI generated images - https://www.theverge.com/2022/9/21/23364696/getty-images-ai-ban-generated-artwork-illustration-copyright
— Ian Goodfellow & GANs - https://arxiv.org/abs/1406.2661
AI Plugins for Designer tools
— CHARL-E - https://www.charl-e.com/
— Blender Stable Diffusion plugin - https://carlosedubarreto.gumroad.com/l/ceb_sd
— Stable Diffusion for Photoshop - https://www.flyingdog.de/sd/
— Competition - https://www.reddit.com/r/technology/comments/x4swd7/a_man_won_an_art_competition_in_colorado_using/
OpenAI Whisper
— OpenAI Whisper - https://openai.com/blog/whisper/
— Elliot's live dev stream of OpenAI Whisper - https://youtu.be/VlC1wMLI9NY
McKinsey Report
— McKinsey report on AI in China - https://www.mckinsey.com/capabilities/quantumblack/our-insights/the-next-frontier-for-ai-in-china-could-add-600-billion-to-its-economy
Misc.
— Fast AI Course - https://course.fast.ai/
— Adept.ai
— Google assistant that could call and make bookings - https://www.youtube.com/watch?v=d40jgFZ5hXk&ab_channel=BusinessStandard
Stable Diffusion Release & Learning Physics from Video | EP018
Tom and Elliot talk about the release of stable diffusion, some of its strengths and weaknesses and an AI model that can learn fundamental equations of real world systems from video.
00:00 - Start
04:14 - Topic 1 - Stable Diffusion
27:58 - Topic 2 - Discovering Physics from Video
⚡Links
— Stable Diffusion - https://stability.ai/blog/stable-diffusion-public-release
— Automated discovery of fundamental variables hidden in experimental data - https://www.nature.com/articles/s43588-022-00281-6
Amazon Buys One Medical | Podcast EP017
Tom and Elliot talk about the recent acquisition of One Medical. Why Amazon would want it, where AI might fit into the picture and some tin hat theories of what their master plan entails.
⌛Timestamps
00:00 - Start
05:06 - AI For Marketing Misses the Mark
40:42 - AI For Grape Yield
⚡Links
— Amazon official announcement https://press.aboutamazon.com/news-releases/news-release-details/amazon-and-one-medical-sign-agreement-amazon-acquire-one-medical
— NPR coverage of the purchase https://www.npr.org/2022/08/07/1116218333/amazon-may-own-your-doctors-office-next?t=1659968145417
— Amazon's new customer (Whole Foods Acquisition) https://stratechery.com/2017/amazons-new-customer/
👋CONTACT
Any feedback? Leave a comment or hit us on twitter
@tom_k_white, @elliot_c_smith
#podcast #tech #ai #startup
Do we need AI in Marketing and Agriculture? | EP016
The cursed episode… This is V3 of this episode after a couple of tech failures…
Tom and Elliot talk about two papers, one looking at AI in marketing and another in yield prediction for grapes. Both toe the line of "did we really need AI for this".
⌛Timestamps
00:00 - Start
05:06 - AI For Marketing Misses the Mark
40:42 - AI For Grape Yield
⚡Links
— Predicting consumers’ choices in the age of the internet, AI, and almost perfect tracking: Some things change, the key challenges do not https://myscp.onlinelibrary.wiley.com/doi/abs/10.1002/arcp.1068
— Marketers can’t predict what you’ll buy - https://fortune.com/2021/01/02/digital-marketing-ai-artificial-intelligence-netflix-amazon-limits/
— End-to-end deep learning for directly estimating grape yield from ground-based imagery https://arxiv.org/abs/2208.02394
👋CONTACT
Any feedback? Leave a comment or hit us on twitter
@tom_k_white, @elliot_c_smith
#podcast #tech #ai #startup
DALLE2 Pricing Model and Human Induced AI Bias in Language Models | EP015
Tom and Elliot talk about DALLE-2’s new pricing model, and explore the topic of not only introducing data biases but also reasoning biases.
⌛Timestamps
00:00 - Start
02:10 - Topic 1 - DALLE2 Cost and Bias
28:31 - Topic 2 - Human Bias translates to AI Bias
⚡Links
— DALLE-2 Pricing https://openai.com/api/pricing/
— AI Shows human like content-effects on reasoning https://arxiv.org/pdf/2207.07051.pdf
👋CONTACT
Any feedback? Leave a comment or hit us on twitter
@tom_k_white, @elliot_c_smith
#podcast #tech #ai #startup
Steve Jobs on Intelligence and AI Explainability | EP014
Tom and Elliot talk about a Steve Jobs speech and his thoughts on intelligence and whether explainability will save us from stochastic parrots.
⌛Timestamps
00:00:00 - Start
00:06:00 - Topic 1 - Steve Jobs on Intelligence
00:36:24 - Topic 2 - AI explainability
⚡Links
— Steve Jobs - Speech to the Academy of Achievement June 1982 https://www.youtube.com/watch?v=ymbD_a-G1IQ
— Duncker’s Candle Problem https://en.wikipedia.org/wiki/Candle_problem
— Bullet Holes & Biases Abraham Wald https://mcdreeamiemusings.com/blog/2019/4/1/survivorship-bias-how-lessons-from-world-war-two-affect-clinical-research-today
— Nautilus Article https://nautil.us/moving-beyond-mimicry-in-artificial-intelligence-21015/
— Article from Lauren Oakden-Rayner https://laurenoakdenrayner.com/2018/06/05/explain-yourself-machine-producing-simple-text-descriptions-for-ai-interpretability/
— Associated paper https://arxiv.org/abs/1806.00340
— Moonwalking with Einstein https://en.wikipedia.org/wiki/Moonwalking_with_Einstein
— Paper on synthetic MRI data https://link.springer.com/chapter/10.1007/978-3-030-87592-3_1
— Paper on comparing Saliency Methods https://ieeexplore.ieee.org/abstract/document/9647419
— BLEU https://machinelearningmastery.com/calculate-bleu-score-for-text-python/
👋CONTACT Any feedback?
Leave a comment or hit us on Twitter @tom_k_white, @elliot_c_smith
#podcast #tech #ai #startup
Legalities of Copilot & $1 trillion on health admin | EP013
This week Tom and Elliot dig into the new Copilot feature from GitHub and discuss a recent report from McKInsey that shows how the US spends nearly $1 Trillion on admin in the healthcare sector.
00:00:00 - Start
00:02:13 - Topic 1 - Github Copilot
00:03:37 - What is Copilot
00:07:01 - What's causing a push back
00:09:25 - What is Microsoft's plan here
00:11:16 - Does Copilot copy paste code?
00:12:35 - The risk for enterprise dev teams
00:15:47 - How do I know if my code was used to train
00:16:56 - Similarity to Oracle vs Google
00:18:51 - Copilot protection lessons from Nintendo
00:31:15 - Topic 2 McKinsey Healthcare Report
00:32:47 - How we spend 1T a year in health admin
00:36:00 - Calculating health admin spend
00:41:05 - How'd it get so bad?
00:46:26 - Criticisms of the report
01:07:22 - Wrapping Up
⚡Links mentioned
- Mckinsey Report https://www.mckinsey.com/industries/healthcare-systems-and-services/our-insights/claiming-the-1-trillion-prize-in-us-health-care
👋CONTACT
Any feedback? Leave a comment or hit us on Twitter
@tom_k_white, @elliot_c_smith
#podcast #tech #ai #startup
PARTI AI and Google's Investment in Healthcare | Podcast EP012
00:00:00 - Start
00:01:17 - What are we drinking?
00:04:22 - Alphabet's spend in Healthcare
00:13:12 - Searchable Patient Records
00:31:42 - Parti by Google
00:46:16 - Limitations of this model and others
01:06:26 - Wrapping Up
👋CONTACT
Any feedback? Leave a comment or hit us on Twitter
@tom_k_white, @elliot_c_smith
#podcast #tech #ai #startup
Is LaMDA Sentient and Hospitality in Healthcare | EP011
Welcome to another episode. This week Tom and Elliot dig into whether LaMDA is really sentient and how Healthcare can learn some lessons from hospitality.
00:00 - Start
02:40 - Is the AI Sentient?
03:13 - What is LaMDA
04:01 - What is Sentience?
05:08 - My thoughts: No
06:29 - What's going on then?
09:37 - Is the Turing Test a good test?
12:36 - How did people react
18:46 - Why hospitality matters in healthcare
20:01 - Defining patient experience
24:13 - How can we find a metric to optimize
26:06 - Be nice or get sued
31:01 - How do we make it different
36:23 - Key Ideas for Healthcare Hospitality
52:41 - Wrapping Up
👋CONTACT
Any feedback? Leave a comment or hit us on Twitter
@tom_k_white, @elliot_c_smith
#podcast #tech #ai #startup
Live Episode | EP010
Tom and Elliot chat about a few topics in our first ever live episode. Let's hope two tech founders can work out a live stream.
DALLE-2 "Secret" Language & Did we forget how to build Nuclear? | EP009
Tom and Elliot discuss the supposed secret language of DALLE-2 and some signs that the western world might have forgotten how to build new nuclear plants.
TIMESTAMPS
00:00 Intro
04:00 Does DALLE-2 have a secret language?
06:06 What is OpenAI?
09:27 Failure Cases
13:04 Is this like Facebook's Failed Experiment?
17:06 Topic 2 Did we forget how to build power plants?
20:31 France's Nuclear Power
24:05 USA's Nuclear Power
30:31 Is China the new king of nuclear power?
41:16 Wrapping Up
✍️SHOW NOTES
Part 1 - DALLE-2 "Secret" Language
-- 🔬Giannis Darris twitter https://twitter.com/giannis_daras
-- 🧵Giannis' twitter thread summarising the findings https://twitter.com/giannis_daras/status/1531693093040230402
-- 🎨DALLE-2 artwork https://twitter.com/dalle2pics
-- 🧠Open AI https://openai.com/
-- 🗣️Facebook's failed experiment https://www.independent.co.uk/life-style/facebook-artificial-intelligence-ai-chatbot-new-language-research-openai-google-a7869706.html
Part 2 - We've Forgotten how to build Nuclear
-- ⚛️World Nuclear - https://world-nuclear.org/
-- 🥖Nuclear Power in France - https://world-nuclear.org/information-library/country-profiles/countries-a-f/france.aspx
-- 🌭Nuclear Power in USA - https://world-nuclear.org/information-library/country-profiles/countries-t-z/usa-nuclear-power.aspx
-- ⚡Chernobyl Miniseries - https://en.wikipedia.org/wiki/Chernobyl_(miniseries)
-- 🌊Fukushima Disaster - https://en.wikipedia.org/wiki/Fukushima_nuclear_disaster
-- 🍚Nuclear Power in China - https://world-nuclear.org/information-library/country-profiles/countries-a-f/china-nuclear-power.aspx
👋CONTACT
Any feedback? Leave a comment or hit us on twitter
@tom_k_white, @elliot_c_smith
#podcast #tech #ai #startup
Bizzare Signs of Recession and CRISPR Tomatoes | EP008
Tom and Elliot discuss some of the more questionable signs that we might be in a recession and new work increasing Vitamin D in tomatoes using genetic modification with CRISPR.
TIMESTAMPS
00:00:00 Intro
00:02:55 This Week's Topics
00:06:54 Topic 1 Bizzare indicators of recession
00:12:58 Hemline Index
00:18:55 R-Word Index
00:22:08 Men's Underwear Index
00:31:42 Bonus Index List
00:40:05 Stripper Sentiment
00:41:23 Actual Recession Indicators
00:44:54 Topic 2 CRISPR Super Tomatoes
01:03:44 Wrapping Up
✍️SHOW NOTES
Part 1 - Stripper Things
-- Original tweet from @Reversecowgirl69 - https://twitter.com/botticellibimbo/status/1527390388167659528
-- Skyscraper Index - https://en.wikipedia.org/wiki/Skyscraper_Index
-- Hemline Index - https://www.nytimes.com/1974/02/24/archives/probing-the-markets-depths-still-lower-prices-for-stocks-seen-by.html
-- "R-Word" Index - https://www.economist.com/finance-and-economics/2001/04/05/the-r-word
-- Men's Underwear Index - https://bikashkampo.com/the-underwear-theory-of-economic-growth/
-- Champagne Index - https://www.liv-ex.com/news-insights/indices/
-- Bridgwater Capital Frothiness - https://www.bridgewater.com/research-and-insights/ray-dalio-stock-market-bubble
Part 2 - CRISPR Tomatoes
-- Biofortified tomatoes provide a new route to vitamin D sufficiency https://www.nature.com/articles/s41477-022-01154-6
-- Nature Plants https://www.nature.com/nplants/editors
-- What is CRISPR? https://www.newscientist.com/definition/what-is-crispr/
-- Co-Inventor of CRISPR, Emmanuel Charpentier https://en.wikipedia.org/wiki/Emmanuelle_Charpentier
-- Co-Inventor of CRISPR, Jennifer Doudna https://en.wikipedia.org/wiki/Jennifer_Doudna
👋CONTACT
Any feedback? Leave a comment or hit us on twitter
@tom_k_white, @elliot_c_smith
#podcast #tech #ai #startup
DeepMind's GATO model and the speed of human progress | EP007
Tom and Elliot discuss Deepmind's new GATO model and an article looking at the speed of human progress and whether this century will be history's most important.
TIMESTAMPS
00:00 Intro
01:53 What are we drinking
05:42 Topic 1 Deepmind's GATO
29:47 Topic 2: This Can't Go On
58:51 Wrapping Up
✍️SHOW NOTES
Part 1 - DeepMind's GATO model
-- DeepMind's GATO model - https://www.deepmind.com/publications/a-generalist-agent
-- Reinforcement learning - https://en.wikipedia.org/wiki/Reinforcement_learning
-- Gradient descent - https://en.wikipedia.org/wiki/Gradient_descent
-- DeepMind's new GATO makes me fear humans will never achieve AGI - https://thenextweb.com/news/deepminds-astounding-new-gato-ai-makes-fear-humans-will-never-achieve-agi
Part 2 - Speed of Human Progress
-- This Can't Go On - https://www.cold-takes.com/this-cant-go-on/
-- The most important century - https://www.cold-takes.com/most-important-century/
👋CONTACT
Any feedback? Leave a comment or hit us on twitter
@tom_k_white, @elliot_c_smith
Bad AI metrics and How to understand things | EP006
Tom and Elliot discuss how AI metrics get used and abused and a paper looking at how to understand things.
Part 1
- How to Understand Things by Nabeel - https://nabeelqu.co/understanding
- Not Overthinking podcast episode that discusses Nabeel's article - https://notoverthinking.com/how-to-understand-things-2/
- Visual image of "Bag of words" and Natural Language Processing -https://twitter.com/nwilliams030/status/1278008507044937728/photo/1
- Decision tree analysis for house prices - I could not find this one, sorry folks
- The Sequences from Less Wrong -https://www.readthesequences.com/Book-I-Map-And-Territory
- Modernist bread - https://modernistcuisineshop.com/products/modernist-bread
Part 2
- Concepts we covered; accuracy, sensitivity, specificity, AUC, prevalence, prior probability, positive predictive value, the negative predictive value
- The Metric Matrix - https://medium.com/swlh/how-to-remember-all-these-classification-concepts-forever-761c065be33
- Ibis -https://en.wikipedia.org/wiki/Ibis
- Bin Chicken - https://www.youtube.com/watch?v=w4dYWhkSbTU Ibis Photo: By JJ Harrison (https://www.jjharrison.com.au/)
- Own work, CC BY-SA 3.0, https://commons.wikimedia.org/w/index.php?curid=18800827 ROC Image: By cmglee, MartinThoma - Roc-draft-xkcd-style.svg, CC BY-SA 4.0, https://commons.wikimedia.org/w/index.php?curid=109730045
00:00 Intro
01:04 What are we drinking
04:47 How to Understand Things
06:44 The smartest people aren't the quickest to answer
09:23 Part 1 - Not Giving Up
13:22 When to go deep on a topic
22:08 Asking Dumb Questions
29:52 Life update post paper
32:31 AI metrics and which ones to use
46:21 Sensitivity and Specificity Mistakes
Letting Ideas Incubate and The Morals of Online Prescriptions | EP005
Tom and Elliot discuss a meta-analysis of how to leave time between problems to help solve them and a DEA investigation into online prescription services for ADHD.
Links Mentioned
- Does Incubation Enhance Problem Solving? A Meta-Analytic Review
- https://www.researchgate.net/publication/24001208_Does_Incubation_Enhance_Problem_Solving_A_Meta-Analytic_Review
- Plan, Do, Learn - My admittedly hardcore work routine
- https://www.indiehackers.com/post/plan-do-learn-my-admittedly-hardcore-work-routine-1fb500959f
- Maker's Schedule, Manager's Schedule - Paul Graham - http://www.paulgraham.com/makersschedule.html
- History of Water Fluoridation - https://en.wikipedia.org/wiki/Water_fluoridation#History
- http://examine.com/
- "Good is the enemy of great"—Good to Great by Jim Collins - http://www.tomkwhite.com/good-is-the-enemy-of-great
- Warbreaker—Brandon Sanderson - https://www.brandonsanderson.com/warbreaker-introduction
- Ali Abdaal interviews Brandon Sanderson - https://www.youtube.com/watch?v=IyPsEF511Vw 00:00
00:00 Introduction and Rambles
02:06 This Week's Topics
04:19 What We're Drinking
07:20 Blend 43 and High School Jobs
10:17 The Science of Problem Solving
12:51 Does Incubation Help?
18:12 Incubation and Ego Depletion
23:11 Time on Problem vs Time Incubating
25:25 Experiments and Video Games
38:39 The Morals of Online Prescriptions
58:42 Final Thoughts
The Science of Problem Solving plus Elon open sourcing "The Algorithm" | EP004
Tom and Elliot discuss the absurdity of open-sourcing Twitter's timeline algorithm and what we know about the science of solving problems.
Links Mentioned:
- https://rs.io/the-science-of-problem-solving/
- https://tomkwhite.com
- https://elliotcsmith.com
#podcast #tech #ai #startup
Defeating nations with grass and counterfactual value | EP003
Tom and Elliot discuss how grass helped horseback tribes conquer nations and different ways to look at value.
Links Mentioned:
- https://perell.com/note/the-counterfactual-theory-of-value/
- https://tomkwhite.com
- https://elliotcsmith.com
AI Takeoff Speeds and Hammock Driven Development | EP002
Tom and Elliot discuss how quickly AI might become super intelligent and how to get your best work done by spending time in a hammock.
Links Mentioned:
- https://astralcodexten.substack.com/p/yudkowsky-contra-christiano-on-ai?s=r- https://en.wikipedia.org/wiki/GPT-3
- lesswrong.com/
- http://gwern.net/
- Hammock Driven Development: https://www.youtube.com/watch?v=f84n5oFoZBc
- Manager vs maker: http://www.paulgraham.com/makersschedule.html
- Do the real thing: https://www.scotthyoung.com/blog/2020/05/04/do-the-real-thing/)
- Cal Newport coffee shops: https://www.calnewport.com/blog/2013/08/14/deep-work-and-the-good-life/
Mic Check One Two | EP001
Tom and Elliot discuss Linkedin DeepFakes and the Kano Model for classifying features.
Apologies for the echo, we'll get that sorted for the next episode.
Links Mentioned:
- https://www.npr.org/2022/03/27/1088140809/fake-linkedin-profiles
- https://www.productplan.com/glossary/kano-model/
- https://twitter.com/elliot_c_smith - https://twitter.com/tom_k_white
- https://www.maxwellplus.com
- https://www.goodfood.com.au/eat-out/news/milk-permeate-tops-list-of-consumer-concerns-20121231-2c2dt #podcast #tech #ai #startup