Avsnitt
-
Dive into the world of frontier AI development with California State Senator Scott Wiener's intricate detailing of SB 1047 bill. This podcast explores the delicate balance between accelerating AI innovation and ensuring stringent safety protocols, including potential implications for advanced AI models. Learn about the debates on government involvement, the need for independent third-party testing, and Senator Wiener's commitment to a measured approach to AI regulation. Join us for a thought-provoking discussion on the complexities of legislating emerging technologies.
SPONSORS:
Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive
The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR
Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention "Turpentine" to skip the waitlist.
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/
CHAPTERS:
(00:00:00) Introduction
(00:05:47) Senator Scott Wiener
(00:09:38) AI policy
(00:13:56) AI worldview
(00:16:20) Sponsors: Oracle | Brave
(00:18:28) Burden on Developers
(00:26:10) Developers reaction
(00:28:43) Big tech companies opposing the bill
(00:31:09) Open source models
(00:34:57) Sponsors: Squad | Omneky
(00:36:45) Illegal activities
(00:41:15) Penalties
(00:44:33) Third party testing
(00:48:33) Transparency requirements for model development
(00:53:07) Closing thoughts -
Discover how Adam Majmudar embarked on an exceptional journey to create the TinyGPU from scratch, with no experience in GPU design. This insightful podcast follows Adam's process from learning to implementation, highlighting the progressive contributions of countless engineers and the accelerating role of AI in the learning journey. Experience the unfolding of GPU architecture and gain a deeper appreciation for the technology driving today's AI advancements.
RECOMMENDED PODCAST:
The AI Daily Brief If you’re looking for an edge to stay up to date on everything AI, subscribe to Nathaniel Whittemore's AI Daily Brief which delivers tight episodes covering all things AI from legislation to new technologies to the philosophical debates around generalized intelligence.
Spotify: https://open.spotify.com/show/7gKwwMLFLc6RmjmRpbMtEO
Apple: https://podcasts.apple.com/us/podcast/the-ai-daily-brief-formerly-the-ai-breakdown/id1680633614
SPONSORS:
Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive
The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR
Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention "Turpentine" to skip the waitlist.
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/
CHAPTERS:
(00:00:00) Introduction
(00:04:34) Intro
(00:07:42) Learning Resources
(00:12:11) What is the process of getting your chip back?
(00:14:38) What is the scope of the project?
(00:17:18) Sponsors: Oracle | Brave
(00:19:25) Prioritization
(00:23:19) Memory management
(00:33:19) What instructions to include?
(00:38:03) Sponsors: Squad | Omneky
(00:40:42) Registers
(00:48:29) Memory Limitations
(00:57:51) Compute Pattern
(01:01:14) Dispatcher
(01:07:50) How does it get translated into hardware?
(01:21:07) Compute Core Execution
(01:24:57) The Fetcher
(01:27:07) Memory controllers
(01:37:49) Simulating the design
(01:41:09) What did you learn?
(01:50:36) Conclusion -
Saknas det avsnitt?
-
Dive into the nuanced debate over California's SB 1047 AI legislation with Nathan Calvin, Dean Ball, and Steve Newman. Our expert panel discussion explores the bill's intent, dispels misconceptions, and debates its potential impact on technology and regulation. Learn about AI's tail risks, the role of government, and hear suggestions for improving the legislation. Share your thoughts and join the conversation around shaping a positive AI future.
You can reach out and share your thoughts by using the contact form here : https://www.cognitiverevolution.ai/contact/
RECOMMENDED PODCAST:
The AI Daily Brief If you’re looking for an edge to stay up to date on everything AI, subscribe to Nathaniel Whittemore's AI Daily Brief which delivers tight episodes covering all things AI from legislation to new technologies to the philosophical debates around generalized intelligence.
Spotify: https://open.spotify.com/show/7gKwwMLFLc6RmjmRpbMtEO
Apple: https://podcasts.apple.com/us/podcast/the-ai-daily-brief-formerly-the-ai-breakdown/id1680633614
SPONSORS:
The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/
Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention "Turpentine" to skip the waitlist.
CHAPTERS:
(00:00:00) Introduction
(00:05:45) Opinions
(00:11:57) The Bill
(00:17:05) Elevated discussion
(00:18:51) Sponsors: Brave | Omneky
(00:20:18) AI Doctor
(00:22:55) Centralized Regulator
(00:26:29) SB 1047
(00:27:47) Critical infrastructure
(00:31:51) Should we regulate?
(00:39:00) Sponsors: Squad
(00:40:28) Safety standards for training
(00:46:09) What is 10^26 flops?
(00:52:10) Regulating general purpose technology
(00:53:42) AI regulation
(00:58:31) Societal adaptation
(01:01:18) AI safety
(01:04:20) AI regulations
(01:07:19) The current state of the industry
(01:10:08) What industry wants changed
(01:25:42) Safety is hard to legislate
(01:33:06) How to decide the trajectory of AI?
(01:45:52) Testing, Transparency, Whistleblower Provision
(01:55:17) Closing thoughts -
Join us as we explore the future of work in the age of artificial intelligence. Nathan shares essential strategies for college students, especially in computer science, to succeed in a landscape dominated by AI tools. Discover the most important skills to develop, how to use AI for efficiency, and insights into AI-driven task automation. Get valuable advice on incorporating AI into your work and resources for beginning your journey into AI professionalism.
RECOMMENDED PODCAST:
The AI Daily Brief If you’re looking for an edge to stay up to date on everything AI, subscribe to Nathaniel Whittemore's AI Daily Brief which delivers tight episodes covering all things AI from legislation to new technologies to the philosophical debates around generalized intelligence.
Spotify: https://open.spotify.com/show/7gKwwMLFLc6RmjmRpbMtEO
Apple: https://podcasts.apple.com/us/podcast/the-ai-daily-brief-formerly-the-ai-breakdown/id1680633614
SPONSORS:
The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/
Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention "Turpentine" to skip the waitlist.
CHAPTERS:
(00:00:00) Introduction
(00:05:18) AI Closing in on Human Experts
(00:08:48) Limitations of Current AI
(00:13:16) AI's Speed and Availability Advantages
(00:16:26) AI's Evolutionary Advantages
(00:19:01) Viewing AI as Entry-Level Employees
(00:20:38) Sponsors: Brave | Omneky
(00:22:05) Modes of AI Production
(00:25:09) Agent Mode: The Best of Both Worlds
(00:30:08) Prompting Techniques
(00:32:17) AI Coding Assistants
(00:37:01) Automating Processes with AI
(00:37:55) Sponsors: Squad
(00:39:23) University Curriculum and AI Tools
(00:44:50) AI-Generated Music and Video Editing
(00:46:04) Introduction to AI Tools
(00:47:11) Devon AI Agent
(00:49:26) Waymark AI Evaluation Example
(00:52:51) Setting the Context
(00:54:30) Mantras for AI Adoption
(00:56:48) Recommended AI Thought Leaders
(00:59:53) Setting up AI Training
(01:04:25) Avoiding Over-engineering Solutions -
Dive into the accelerating world of artificial intelligence with our latest podcast episode. We discuss the latest AI advancements and the challenges leaders face in keeping up, potential societal backlashes, and regulatory concerns. Explore the possibilities and immerse yourself in a strategic AI scouting report from our conversation with the 80,000 Hours podcast. Listen now for insights on AI's role in various sectors and the necessity for informed discourse.
RECOMMENDED PODCAST:
The AI Daily Brief If you’re looking for an edge to stay up to date on everything AI, subscribe to Nathaniel Whittemore's AI Daily Brief which delivers tight episodes covering all things AI from legislation to new technologies to the philosophical debates around generalized intelligence.
Spotify: https://open.spotify.com/show/7gKwwMLFLc6RmjmRpbMtEO
Apple: https://podcasts.apple.com/us/podcast/the-ai-daily-brief-formerly-the-ai-breakdown/id1680633614
SPONSORS:
The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/
Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention "Turpentine" to skip the waitlist.
CHAPTERS:
(00:00:00) Introduction to the Interview with Nathan LeBenz
(00:05:50) Exploring AI's Capabilities and Ethical Considerations
(00:14:43) Sponsors: Brave | Omneky
(00:16:10) AI's Impact on Medicine and Healthcare Innovations
(00:36:29) Sponsors: Squad
(00:37:56) Predictions and Expectations for Next-Gen AI Applications
(00:57:33) Exploring the Frontier of AI and Robotics
(00:58:57) The Leap in AI: From Language Models to Physical Robots
(01:00:21) GPT-4's Remarkable Achievements and Future Prospects
(01:03:55) Navigating the Discourse on AI Safety and Regulation
(01:12:53) The Polarization of AI Discourse: A Deep Dive
(01:16:17) The Impact of Social Media on AI Conversations
(01:34:53) Exploring the Dynamics of AI Regulation and Public Perception
(01:49:27) Navigating AI's Rapid Progress and Public Perception
(01:50:55) Current State of AI Legislation and Industry Response
(01:53:31) The Challenge of Regulating AI and Ensuring Safety
(02:03:37) The Impact of AI on Information and Social Dynamics
(02:19:18) AI in Warfare: Ethical Considerations and Future Prospects
(02:27:25) Recommendations for Keeping Up with AI Developments
(02:33:45) Final Thoughts and Advice for AI Enthusiasts and Professionals -
In this episode from new podcast Emergent Behavior, host @Ate-a-Pi interviews the co-founders of Prophetic AI to learn how they're using AI to facilitate lucid dreaming. Prophetic had come up in the recent Cognitive Revolution conversation with Dean W. Ball about brain computer interfaces, and Nathan had them on the list of companies to invite on the show, so it was really fun to discover that Ate-a-Pi had already done an interview with them right around the same time.
--
Subscribe to Emergent Behavior:
Spotify: https://open.spotify.com/show/2KfbuKL7iqIfbpY31PHtEg
Apple: https://podcasts.apple.com/us/podcast/emergent-behavior/id1735023473
YouTube: https://www.youtube.com/@EmergentBehaviorPod
&
Check out Nathan's new chatbot on www.cognitiverevolution.ai
--
RECOMMENDED PODCAST:
The AI Daily Brief If you’re looking for an edge to stay up to date on everything AI, subscribe to Nathaniel Whittemore's AI Daily Brief which delivers tight episodes covering all things AI from legislation to new technologies to the philosophical debates around generalized intelligence.
Spotify: https://open.spotify.com/show/7gKwwMLFLc6RmjmRpbMtEO
Apple: https://podcasts.apple.com/us/podcast/the-ai-daily-brief-formerly-the-ai-breakdown/id1680633614
--
SPONSORS:
The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/
Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.
--
TIMESTAMPS:
(00:00) Intro
(00:43) Diving Deep with Prophetic AI
(02:18) Exploring Lucid Dreaming with Halo
(05:08) The Technical Marvel Behind Halo
(07:25) A Deep Dive into Lucid Dreaming Experiences
(13:15) Sponsor: Brave | Omneky
(14:42) Do All People Have Lucid States?
(32:19) Sponsor: Squad
(41:05) Building the Neural Model for Dream Control
(43:15) Exploring the Intersection of EEG, fMRI, and Ultrasound in Lucid Dreaming
(43:48) The Journey from Open Source Data to Targeted Brain Stimulation
(47:08) Collaboration with the Donders Institute and the Future of Lucid Dreaming Research
(48:40) The Role of Machine Learning and AI in Enhancing Data Collection and Analysis
(50:04) From Theory to Practice: Implementing Transcranial Focused Ultrasound (TFUS)
(53:51) Personalizing the Lucid Dreaming Experience through Reinforcement Learning
(1:16:18) Looking Ahead: The Potential and Challenges of Neurostimulation Technology
(1:22:55) Addressing the Skeptics: The Debate Over Natural vs. Technologically Induced Lucid Dreaming -
In this podcast, we dive into the fascinating world of brain-computer interfaces with Dean W. Ball. We learn about the latest technologies, from non-invasive EEG and ultrasound stimulation to invasive Neuralink implants. We also discover the state-of-art tools, technical challenges, and the big questions around thought dimensionality, ethical considerations, and the societal impact of brain reading and writing.
SPONSORS:
The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/
Plumb is a no-code AI app builder designed for product teams who care about quality and speed. What is taking you weeks to hand-code today can be done confidently in hours. Check out https://bit.ly/PlumbTCR for early access.
Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.
CHAPTERS:
(00:00:00) Introduction
(00:04:00) Background
(00:06:50) Journey to Neurotech Interest
(00:07:56) Concept of Human-Machine Merge
(00:12:01) Impact of Language Models
(00:15:53) Sponsors: Brave / Omneky
(00:17:20) Adoption of AI Tools like ChatGPT
(00:22:33) Neural Technologies as Sensor Fusion
(00:26:03) Brain Signals and EEG Devices
(00:29:09) Electrodes and Electrical Field Measurement
(00:37:04) Sponsors: Plumb / Squad
(00:39:01) Neurofeedback and Brain Training
(00:48:44) The Rise of Neural Networks
(00:57:29) Shared Latent Space for Brain Signals
(01:09:18) Trajectory of Brain-Computer Interface
(01:14:44) Near-Term Possibilities
(01:26:25) Limitations of Brain-Computer Interfaces
(01:38:31) Stimulating Brain Activity
(01:46:08) Policy Considerations
(01:52:02) Solved World and Artificial Constraints
(02:04:27) Acclimating to Merge Technology
(02:08:33) Advice for Understanding Neural Interfaces -
In this episode from the Autopilot podcast, Sergiy Nesterenko, founder of Quilter (backed by Benchmark), discusses designing PCB circuitboards end-to-end using reinforcement learning. "Autopilot" host Will Summerlin and Nesterenko cover how current PCB boards are designed and how Quilter’s tech stack enables faster board design, what better circuit boards enable in the future, their GTM and where they are seeing most market pull right now, and much more.
Subscribe to Autopilot:
Spotify: https://open.spotify.com/show/6YQZkKHN7EP2yWedAvSxBC?si=18377c69a2804333&nd=1&dlsi=18fee5e95b284d02
Apple: https://podcasts.apple.com/us/podcast/autopilot-with-will-summerlin/id1738163836
YouTube: https://www.youtube.com/@AutopilotwithWillSummerlin
Check out Nathan's new chatbot on www.cognitiverevolution.ai
SPONSORS:
The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/
Plumb is a no-code AI app builder designed for product teams who care about quality and speed. What is taking you weeks to hand-code today can be done confidently in hours. Check out https://bit.ly/PlumbTCR for early access.
Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.
LINKS:
Quilter: https://www.quilter.ai/
Autopilot Ventures: https://www.apv.vc/
X/SOCIAL:
@labenz (Nathan)
@WSummerlinAI (Will)
@sergiynest (Sergiy)
@quilterai (Quilter)
TIMESTAMPS:
(00:00) Intro & Sergiy’s Background
(04:31) What Sergiy learned from SpaceX
(05:53) Founding thesis of Quilter and Quilter’s journey
(06:57) Where would one find circuit boards?
(08:11) What is the process of designing a circuit board?
(09:39) Design process today with Quilter
(14:34) Sponsor: Omneky
(16:01) Quilter’s thesis and designing more complex circuits
(18:25) How much are humans currently paid for board design
(19:41) Labor dynamics in board design
(20:30) Do most companies have board designers in-house?
(21:14) Incentive structure
(22:44) What does a high-performance circuit board look like vs low-performance?
(26:37) Quilter’s technology stack
(29:15) Sponsor: Plumb | Squad
(31:15) How Quilter can grow with scale?
(33:50) Where is circuit manufacturing happening
(37:17) What other parts of knowledge work can be solved with reinforcement learning
(41:03) GTM and who Quilter is selling to
(42:48) Pricing
(44:04) Where Quilter is seeing the most market pull right now
(45:21) What makes Quilter an exciting company to work at or invest
(47:14) The effects of closed research in private companies for the industry
(49:25) Open source vs closed source
(51:14) What Sergiy would advise to himself in his early founder
(53:59) What drew Sergiy to working with Benchmark
(56:19) Wrap -
Google DeepMind researchers Keerthana Gopalakrishnan and Ted Xiao discuss their latest breakthroughs in AI robotics. Including models that enable robots to understand novel objects, learn from human demonstrations, and operate under ethical constraints. The conversation covers six groundbreaking papers that showcase rapid progress towards general-purpose robotics.
SPONSORS:
The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/
Plumb is a no-code AI app builder designed for product teams who care about quality and speed. What is taking you weeks to hand-code today can be done confidently in hours. Check out https://bit.ly/PlumbTCR for early access.
Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.
CHAPTERS :
(00:00) Introduction
(04:44) The Future of Robotics
(14:40) Sponsors : Brave / Omneky
(16:04) Inputs and Outputs
(24:03) A Leap Towards Generalist Robots
(32:08) Sponsors : Plumb / Squad
(33:52) Learning in Robotics
(41:12) Learning from On-the-Fly Examples
(41:57) Annotating Robot Actions
(50:17) Scaling and Safety
(01:03:05) Learning to Learn Faster
(01:08:43) Zero-Shot Learning
(01:15:15) Future Directions -
In this episode, we delve into the intricate world of AI inference with cofounders of Firework AI. Discover the strategies behind optimizing AI performance, the importance of balancing latency and throughput, and the nuances of different AI architectures from GPT-3 to Stable Diffusion. Learn about their partnership with Stability AI, their unique focus on reducing total cost of ownership, and their vision for a seamless developer experience.
RECOMMENDED PODCAST:
How Do You Use ChatGPT with Dan Shipper.
Dan Shipper talks to programmers, writers, founders, academics, tech executives, and others to walk through all of their ChatGPT use cases (including Nathan!). They even use ChatGPT together, live on the show. Listen to How Do You Use ChatGPT? from Dan Shipper and the team at Every, wherever you get your podcasts: https://link.chtbl.com/hdyuchatgpt
SPONSORS:
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/
The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR
Plumb is a no-code AI app builder designed for product teams who care about quality and speed. What is taking you weeks to hand-code today can be done confidently in hours. Check out https://bit.ly/PlumbTCR for early access.
Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.
CHAPTERS :
(00:00:00) Introduction
(00:08:34) Compute Stack
(00:19:23) Fireworks Product Philosophy
(00:24:11) Sponsors : Brave / Omneky
(00:25:40) Fine-tuning Strategy
(00:38:40) Sponsors : Plumb / Squad
(00:40:33) NVIDIA Stack Overview
(00:47:14) TensorFlow Triton Service
(00:55:25) Reduced Precision Advantages
(01:03:57) Different Deployment Scenarios
(01:08:27) Seeking Intuition on Sharding
(01:19:28) Announcing Stability AI Partnership
(01:32:00) Closing Remarks -
In this episode, we explore the cutting-edge world of AI-powered brain imaging with the MindEye2 Project. Discover how researchers are reconstructing images from fMRI data, offering unprecedented insights into the human mind. We discuss the implications for neuroscience, clinical diagnosis, and the future of AI-assisted brain decoding.
RECOMMENDED PODCAST:
How Do You Use ChatGPT with Dan Shipper.
Dan Shipper talks to programmers, writers, founders, academics, tech executives, and others to walk through all of their ChatGPT use cases (including Nathan!). They even use ChatGPT together, live on the show. Listen to How Do You Use ChatGPT? from Dan Shipper and the team at Every, wherever you get your podcasts : https://link.chtbl.com/hdyuchatgpt
SPONSORS:
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/
The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR
Plumb is a no-code AI app builder designed for product teams who care about quality and speed. What is taking you weeks to hand-code today can be done confidently in hours. Check out https://bit.ly/PlumbTCR for early access.
Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.
CHAPTERS:
(00:00) Introduction
(07:24) Evolution of Brain Decoding Tech
(10:33) From MindEye1 to MindEye2
(14:12) Sponsor: Omneky
(14:43) Foundation Models for Enhanced AI
(26:49) Future of Image Reconstruction from Brain Data
(34:10) Sponsors: Brave / Plumb / Squad
(44:23) Evaluating AI-Generated Reconstructions
(48:10) Understanding Semantic Info in the Brain
(51:47) Potential and Ethics of Brain Data Usage
(57:13) Foundation Models in Neuroscience
(01:02:46) Future of Brain-Computer Interfaces -
In this episode, Linus Lee, AI product leader at Notion, joins us to discuss his groundbreaking projects and unique approach to exploring AI systems. He shares his toolkit and insights on language model capabilities, along with his vision for the future of AI, which is centered on amplifying human intelligence. Linus inspires listeners to engage deeply with AI and to steer its development in ways that enhance human creativity and agency.
RECOMMENDED PODCAST:
How Do You Use ChatGPT Dan Shipper talks to programmers, writers, founders, academics, tech executives, and others to walk through all of their ChatGPT use cases (including Nathan!). They even use ChatGPT together, live on the show. Listen to How Do You Use ChatGPT? from Dan Shipper and the team at Every, wherever you get your podcasts. https://link.chtbl.com/hdyuchatgpt
SPONSORS:
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/
The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR
Plumb is a no-code AI app builder designed for product teams who care about quality and speed. What is taking you weeks to hand-code today can be done confidently in hours. Check out https://bit.ly/PlumbTCR for early access.
Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.
CHAPTERS :
(00:00) Introduction
(10:16) AI and Creativity
(14:37) Sponsor: Omneky
(14:57) AI Research Development
(20:05) Bridging Modalities
(32:38) Sponsor: Brave / Plumb / Squad
(35:36) Transformer Models and Techniques
(52:32) Personal AI Research Setup
(58:55) Leveraging Language Models for Coding
(01:02:05) AI Model Development and Notion AI
(01:22:05) Future of AI Models and App Development
(01:32:51) Emerging Trends in AI -
In this podcast, Nathan and Nick dive deep into the data requirements for achieving Artificial General Intelligence. They explore the current paradigms, the role of data in approximating intelligence, and the scaling trends for GPT models. The discussion covers various datasets, from email and Twitter to YouTube and genomic data, as they analyze the feasibility of reaching the target of 100 trillion high-quality tokens. While the bull case suggests an abundance of data, the bear case highlights the limits on high-quality data, prompting a fascinating exploration of what makes data good for AI and the potential for AI to generate its own data.
Sponsors
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/
The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR
Head to Squad to access global engineering without the headache and at a fraction of the cost: head to http://choosesquad.com/ and mention “Turpentine” to skip the waitlist.
Plumb is a no-code AI app builder designed for product teams who care about quality and speed. What is taking you weeks to hand-code today can be done confidently in hours. Check out https://bit.ly/PlumbTCR for early access.
Chapters
(00:00) Introduction
(05:04) Scaling Hypothesis of Intelligence
(07:32) Is There Enough High Quality Data?
(10:19) Algorithms Impacting Data Requirements
(17:42) Sponsor : Omneky
(18:04) Estimating High Quality Token Requirements
(24:07) Astronomy and YouTube Data Scale
(29:42) Genomics Data
(37:58) Sponsors : Brave / Plumb / Squad
(41:16) Code Datasets and Synthetic Data
(45:48) The Bear Case: Quality and Usability of Data
(50:54) Investment Trends and Compute Efficiency
(54:19) Training Run
(57:21) Synthetic Data Generation and Self-Play -
In this episode, we explore the Chinese AI ecosystem with 'L-squared,' an anonymous tech worker based in Beijing. We discuss major players, model quality, public engagement, regulation, and the US 'chip ban.' Discover the similarities and differences between US and Chinese AI landscapes, and gain a nuanced perspective on the current state of AI in China.USEFUL RESOURCES:Testing Chinese models: Yi-34B-Chat (made by Kai-Fu Lee's team 01.AI) can be tried out via Replicate (https://replicate.com/01-ai/yi-34b-chat) or Hugging Face. You can also use the ChatGLM playground (https://open.bigmodel.cn/trialcenter) and Baidu's ERNIE (https://yiyan.baidu.com/) without a Chinese SIM card. Benchmarking models: SuperCLUE is one of the most prominent benchmarks - the latest results are on GitHub (https://github.com/CLUEbenchmark/SuperCLUE) and the paper explaining the methodology is here (https://arxiv.org/abs/2307.15020). Regulation: Explainer (https://carnegieendowment.org/2023/07/10/china-s-ai-regulations-and-how-they-get-made-pub-90117) from Matt Sheehan; piece (https://www.chinatalk.media/p/how-tight-ai-regs-hurt-chinese-firms) on how genAI regs are affecting Chinese companies. US-China competition: Jeff Ding's work (https://www.tandfonline.com/doi/full/10.1080/09692290.2023.2173633) on the diffusion deficit in S&T; Bloomberg piece (https://www.bloomberg.com/graphics/2023-china-huawei-semiconductor/) on Huawei's semiconductor development efforts. Staying up to date: Sign up to alerts from CSET's Scout tool (https://scout.eto.tech/); subscribe to Concordia AI's AI safety (https://aisafetychina.substack.com/) in China newsletter (disclaimer: I used to work at Concordia!) A 2016 profile (https://chinai.substack.com/p/chinai-37-happy-20th-anniversary) on Microsoft Research Asia by Wang Jingjing, covered in Jeff Ding's ChinAI newsletterSPONSORS:Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, instead of...does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitiveOmneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off http://www.omneky.com/The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCRHead to Squad to access global engineering without the headache and at a fraction of the cost: head to choosesquad.com and mention “Turpentine” to skip the waitlist.Plumb is a no-code AI app builder designed for product teams who care about quality and speed. What is taking you weeks to hand-code today can be done confidently in hours. Check out https://bit.ly/PlumbTCR for early access.TIMESTAMPS:(00:00) Introduction(07:24) China's AI Ecosystem(13:40) Public AI Engagement(17:33) Sponsors : OCI / Omneky(18:50) AI Tools Comparison(35:37) Sponsors : Brave / Squad / Plumb(39:14) AI Regulatory Maze(51:02) AI Performance, Censorship(55:28) Chinese AI Regulations(01:04:37) Tech, Research Role(01:12:11) Global AI Ecosystem(01:23:22) Cultural AI Perspectives(01:29:14) AI Safety, Cooperation
-
In this episode, Nathan sits down with Andrew Lee, founder of Shortwave, an AI-powered email app that describes itself as “the smartest email app on planet earth.” They discuss Shortwave’s RAG stack, how the AI assistant works, the models Shortwave is using, and much more. This is truly a masterclass in RAG app development.Sponsors : Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitiveThe Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCRPlumb is a no-code AI app builder designed for product teams who care about quality and speed. What is taking you weeks to hand-code today can be done confidently in hours. Check out https://bit.ly/PlumbTCR for early access.Head to Squad to access global engineering without the headache and at a fraction of the cost: head to choosesquad.com and mention “Turpentine” to skip the waitlist.TIMESTAMPS:(00:00) - Intro(01:07) - Shortwave: AI-Powered Email(06:22) - Genesis of Shortwave(15:25) - Sponsors: Oracle / Omneky(16:46) - Data Processing Pipeline(21:57) - Choosing a Vector Database(26:34) - How the AI Assistant Works(36:24) - Sponsors: Brave / Plumb / Squad(40:53) - Fine-Tuning & Hosting Models(45:11) - Email Automation(47:55) - Email Retrieval(51:44) - Optimizing AI Performance(53:20) - Safety & Embedded Ethics(01:04:51) - Strategic Product Launches(01:09:58) - Inbox Management(01:12:24) - The Future of Collaborative AI(01:18:54) - Scaling Personalized Outreach(01:26:04) - Closing Thoughts & What's Next
-
In this episode, we dive deep into the inner workings of large language models with Professor David Bau and grad students Koyena Pal and Eric Todd from Northeastern University. Koyena shares insights from her Future Lens paper, which shows that even mid-sized language models think multiple tokens ahead. Eric discusses the fascinating concept of Function Vectors - complex patterns of activity spread across transformer layers that enable in-context learning. Professor Bau connects the dots between these projects and the lab's broader interpretability research agenda, identifying key abstractions that link low-level computations to higher-level model behaviors.SPONSORS:Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitiveODF is where top founders get their start. Apply to join the next cohort and go from idea to conviction-fast. ODF has helped over 1000 companies like Traba, Levels and Finch get their start. Is it your turn? Go to http://beondeck.com/revolution to learn more.Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.comThe Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCRPlumb is a no-code AI app builder designed for product teams who care about quality and speed. What is taking you weeks to hand-code today can be done confidently in hours. Check out https://bit.ly/PlumbTCR for early access.Head to Squad to access global engineering without the headache and at a fraction of the cost: head to choosesquad.com and mention “Turpentine” to skip the waitlist.TIMESTAMPS:(00:00) Intro(04:03) Reverse Engineering AI(10:10) Factual Knowledge Localization(16:34) Sponsors: Oracle | Omneky | On Deck(18:27) Future Lens Paper Intro(23:54) Choosing GPT-J(26:54) Vocabulary Prediction(30:36) Sponsors: Brave | Plumb | Squad(33:13) Fixed Prompt(35:57) Soft Prompt(41:32) Future Lens Results Analysis(51:50) Tooling & Open Source Code(56:07) Larger Models & Mamba Probes(1:04:10) Function Vectors Paper(1:09:39) Extracting & Patching Vectors(1:13:30) Encoding Task Understanding(1:15:36) Expert Models Implications(1:18:09) Conclusion
-
In this episode, Nathan sits down with Elicit co-founders Andreas Stuhlmüller and Jungwon Byun to discuss their mission to make AI-assisted research more accessible and reliable. Learn about their unique approach to task decomposition, which allows language models to accurately tackle complex research questions. We delve into the company's tech stack, their transition from nonprofit to startup, and their dedication to creating trustworthy AI tools for high-stakes applications. Join us for an exploration of the future of AI in research.
The Cognitive Revolution is part of the Turpentine podcast network. Learn more: www.turpentine.co
HELPFUL LINKS:
Elicit : https://elicit.com/
Andreas Stuhlmüller : https://twitter.com/stuhlmueller
Jungwon Byun : https://twitter.com/jungofthewon
SPONSORS:
Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive
ODF is where top founders get their start. Apply to join the next cohort and go from idea to conviction-fast. ODF has helped over 1000 companies like Traba, Levels and Finch get their start. Is it your turn? Go to http://beondeck.com/revolution to learn more.
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com
The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR
Plumb is a no-code AI app builder designed for product teams who care about quality and speed. What is taking you weeks to hand-code today can be done confidently in hours. Check out https://bit.ly/PlumbTCR for early access.
Head to Squad to access global engineering without the headache and at a fraction of the cost: head to choosesquad.com and mention “Turpentine” to skip the waitlist.
TIMESTAMPS:
(00:00:30) Intro
(00:05:05) What is Elicit?
(00:06:03) Vision for Elicit
(00:10:10) Making research transparent
(00:11:58) How to use it?
(00:15:27) Sponsors: Oracle | On Deck | Omneky
(00:18:21) Task Decomposition
(00:23:48) Defining the task
(00:26:30) Eliciting fine-grained evaluations
(00:28:06) Hallucination rates
(00:30:22) Models in play
(00:31:30) Sponsors: Brave | Plumb | Squad
(00:34:26) Shipping a new feature every week
(00:36:10) What was not possible a year ago?
(00:38:26) Chain of thought
(00:43:47) Tactically, how to structure the chain of thought
(00:45:21) Data sets and fine-tuning
(00:51:23) Scaffolding
(00:53:22) Translating structure into more compute
(00:54:27) Infrastructure for investigating papers in detail
(00:59:50) Emphasis on high-value use cases over speed
(01:00:33) Balancing long-term safety and misuse concerns
(01:02:36) Monitoring research progress for negative impact
(01:06:05) Evolving user base and usage patterns
(01:06:52) Biomedicine as a key domain for Elicit
(01:08:57) Expanding results and depth of processing
(01:11:40) Reorganizing information for better understanding
(01:13:12) Habit formation and frequency of use
(01:14:43) The concept of an AI bundle subscription
(01:18:09) Nonprofit to Commercial Venture
(01:20:08) Nonprofit Team and Commercial Mission
(01:20:39) Hiring Needs at Elicit -
In this second part of a two episode series, Nathan and AI scout Jason Meaux provide a sweeping overview of the first 90 days of Mamba-inspired research. They discusstMamba's application to computer vision, experiments in extending effective context length, the potential problem of internal rotting states, and the use of hybrid SSMs in biology.Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api
LINKS:
Show Notes and Paper Links: https://docs.google.com/document/d/1NK_a3deVL_aczORmSRw8LyujNPotpO7Kd90sIRj9Qx0/edit?usp=sharing
Nathan's original Mamba Deep Dive
Spotify: https://open.spotify.com/episode/3b3zeDVU6fE2yV9vdNVLqX?si=dc7a885d601d4a58
Apple: https://podcasts.apple.com/us/podcast/emergency-pod-mamba-memory-and-the-ssm-moment/id1669813431?i=1000639397566
X/SOCIAL:
@labenz (Nathan)
SPONSORS: ORACLE | OMNEKY | BRAVE | ON DECK | SQUAD
Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com
The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api
ODF is where top founders get their start. Apply to join the next cohort and go from idea to conviction-fast. ODF has helped over 1000 companies like Traba, Levels and Finch get their start. Is it your turn? Go to http://beondeck.com/revolution to learn more.
💥 Access global engineering without the headache and at a fraction of the cost: head to choosesquad.com and mention “Turpentine” to skip the waitlist.
TIMESTAMPS:
(00:00) - Episode Start
(00:01:14) - Nathan and Jason’s Bet
(00:04:51) - U-Mamba
(00:15:10) - Sponsors: Oracle | Omneky
(00:06:08) - Swin U-Mamba
(00:18:59) - Vision Mamba
(00:24:30 - VMamba
(00:27:26) - VM-UNet
(00:30:37) - Sponsors: Brave | On Deck
(00:35:15) - SegMamba
(00:36:59) - Vivim
(00:37:31) - Mamba Morph
(00:39:01) - Graph Mamba
(00:43:15) - Long Mamba
(00:59:54) - Evo and StripedHyena
The Cognitive Revolution is produced by Turpentine: a media network covering technology, business, and culture.
Producer: Vivian Meng
Editor: Graham Bessellieu
For sponsor or guest inquiries, email: [email protected] -
In this first part of a two episode series, Nathan and AI scout Jason Meaux provide a sweeping overview of the first 90 days of Mamba-inspired research. They discuss the mechanistic underpinnings of Mamba architecture, Mamba's context capabilities, multi-modal applications in image segmentation and computer vision tasks, and much more. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api
RECOMMENDED PODCAST: Autopilot explores the adoption and rollout of AI in the industries that drive the economy and the dynamic founders bringing rapid change to slow-moving industries. From law, to hardware, to aviation, Will Summerlin interviews founders backed by Benchmark, Greylock, and more to learn how they're automating at the frontiers in entrenched industries.
Listen on Spotify: https://open.spotify.com/show/6YQZkKHN7EP2yWedAvSxBC?si=18377c69a2804333
Listen on Apple: https://podcasts.apple.com/ca/podcast/autopilot-with-will-summerlin/id1738163836
LINKS:
Show Notes and Paper Links: https://docs.google.com/document/d/1NK_a3deVL_aczORmSRw8LyujNPotpO7Kd90sIRj9Qx0/edit?usp=sharing
Nathan's original Mamba Deep Dive
Spotify: https://open.spotify.com/episode/3b3zeDVU6fE2yV9vdNVLqX?si=dc7a885d601d4a58
Apple: https://podcasts.apple.com/us/podcast/emergency-pod-mamba-memory-and-the-ssm-moment/id1669813431?i=1000639397566
X/SOCIAL:
@labenz (Nathan)
SPONSORS: ORACLE | OMNEKY | SQUAD | BRAVE
Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com
💥 Access global engineering without the headache and at a fraction of the cost: head to choosesquad.com and mention “Turpentine” to skip the waitlist.
The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api
ODF is where top founders get their start. Apply to join the next cohort and go from idea to conviction-fast. ODF has helped over 1000 companies like Traba, Levels and Finch get their start. Is it your turn? Go to http://beondeck.com/revolution to learn more. -
In this episode, Nathan sits down with Adam Gleave, founder of Far AI, for a masterclass on AI exploitability. They dissect Adam's findings on vulnerabilities in GPT-4's fine-tuning and Assistant PIs, Far AI's work exposing exploitable flaws in "superhuman" Go AIs through innovative adversarial strategies, accidental jailbreaking by naive developers during fine-tuning, and more. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api
RECOMMENDED PODCAST: Autopilot explores the adoption and rollout of AI in the industries that drive the economy and the dynamic founders bringing rapid change to slow-moving industries. From law, to hardware, to aviation, Will Summerlin interviews founders backed by Benchmark, Greylock, and more to learn how they're automating at the frontiers in entrenched industries.
Listen on Spotify: https://open.spotify.com/show/6YQZkKHN7EP2yWedAvSxBC?si=18377c69a2804333
Listen on Apple: https://podcasts.apple.com/ca/podcast/autopilot-with-will-summerlin/id1738163836LINKS:
LINKS:
Far AI: https://far.ai/author/adam-gleave/
X/SOCIAL:
@labenz (Nathan)
@ARGleave (Adam)
@FARAIResearch (Far.AI)
SPONSORS:
Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com
The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api
ODF is where top founders get their start. Apply to join the next cohort and go from idea to conviction-fast. ODF has helped over 1000 companies like Traba, Levels and Finch get their start. Is it your turn? Go to http://beondeck.com/revolution to learn more.
💥 Access global engineering without the headache and at a fraction of the cost: head to choosesquad.com and mention “Turpentine” to skip the waitlist.
TIMESTAMPS:
(00:00:00) Episode Preview
(00:01:25) The alarming reality of AI exploits: from accidental jailbreaking to malicious attacks.
(00:16:45) The Assistants API: a new frontier for AI exploitation.
(00:41:54) The ethical dilemma of AI security research and disclosure.
(00:51:36) Exploring AI vulnerabilities: a deep dive into GPT-4's exploits.
(00:51:47) The challenge of AI robustness and the 'Accidental Jailbreaking' phenomenon.
(00:52:39) Navigating the Assistants API: security risks and malicious exploits.
(00:53:27) The robustness tax: balancing AI safety with performance.
(01:07:42) Unveiling flaws in superhuman Go-playing AIs: a gray-box investigation.
(01:36:50) Empirical scaling laws for adversarial robustness: a future focus.
(01:41:53) Closing remarks and opportunities at FAR AI
The Cognitive Revolution is produced by Turpentine: a media network covering technology, business, and culture.
Producer: Vivian Meng
Editor: Graham Bessellieu
For sponsor or guest inquiries, email: [email protected] - Visa fler
