Artificial intelligence
I liked Joscha Bach's presentation on evolution of AI and how it relates to understanding of consciousness.
Language models like GPT, DALL·E and Midjourney are fascinating. Curious how far scaling transformer based language models get, maybe they get us to AGI.
I want to be able to have a voice assistant that 'knows me' and I can asks question too that is actually good. LA is a tool I am building that hopefully eventually solves this problem as it will know in a lot of detail which knowledge you have and your preferences in learning.
On the Measure of Intelligence is a good read. Bleeding Edge AI is nice way to stay up to date on AI.
Andrej Karpathy does amazing work in ML. His interview with Lex and his Neural Networks: Zero to Hero course were insightful. Transformer ML models as described in Attention Is All You Need are very useful.
Midjourney & ChatGPT are my favorite uses of AI right now.
Hugging Face has amazing community focused on sharing ml models with community.
OpenAI & Anthropic do interesting research.
Notes
- We will all soon stop emphasizing something was created using AI and we will just focus on creating.
- Best part of I, Robot is how it consistently presents robots doing undesirable things not as AI “gone evil” or “run amok” but implications of their programming that humans did not anticipate, which must be understood and fixed like any other engineering problem.
- It’s not neurons, CPUs or Chinese Room inhabitants who understand, it’s the causal structure implemented by them.
- LLMs won’t replace junior coders by doing 100% of their jobs, it’ll replace them by making top-1% coders 50x more productive. You’re not “safe” because you can do things no LLM can. Your competition isn’t the machine gun of bullshit, it’s the person holding it.
- Real opportunity in AI for most people will not be in AI but in building a front end around it.
Links
- What worries me about AI (2018)
- Tomaso Poggio: Brains, Minds, and Machines (2019)
- Amy Webb on Artificial Intelligence, Humanity, and the Big Nine (2019)
- Ada Lovelace Institute - Independent research and deliberative body with a mission to ensure data and AI work for people and society.
- OpenAI Charter - Describes the principles we use to execute on OpenAI’s mission.
- Google AI Education Resources (HN)
- AI DEBATE : Yoshua Bengio | Gary Marcus (2019) (Reddit)
- Google Research: Looking Back at 2019, and Forward to 2020 and Beyond
- CS221: Artificial Intelligence: Principles and Techniques (2020)
- Awful AI - Curated list to track current scary usages of AI - hoping to raise awareness. (HN)
- Building AGI: Promising Approaches, Remaining Milestones, and Likely Obstacles | Yoshua Bengio (2019)
- Abstraction and Reasoning Corpus (ARC) - Contains the ARC task data, as well as a browser-based interface for humans to try their hand at solving the tasks manually.
- HN: John Carmack: I’m going to work on artificial general intelligence (2020)
- Superintelligence - The Idea That Eats Smart People. (Talk)
- Toward Trustworthy AI Development: Mechanisms for Supporting Verifiable Claims (2020)
- Common Sense Comes Closer to Computers (2020) (HN)
- The quest for artificial intelligence - A History of ideas and achievements
- On the Measure of Intelligence (2019)
- Bored Humans - 40 fun artificial intelligence (AI) pages you can use for free.
- AI – the no bullshit approach (2020)
- Stanford DAWN - Five-year research project to democratize AI by making it dramatically easier to build AI-powered applications.
- AI Research, Replicability and Incentives (2020)
- Environmental drivers of systematicity and generalization in a situated agent (2019)
- UCL Centre for Artificial Intelligence
- Skynet Today - Dedicated to providing accessible and informed coverage of the latest AI news and trends.
- DeepMind AI reading list (2020) (HN)
- Using Artificial Intelligence to Augment Human Intelligence (2017)
- Why general artificial intelligence will not be realized (2020) (HN)
- AI Myths - Tackle 8 of the most insidious myths, misconceptions and inaccuracies about AI. (Tweet)
- Manifold Computing - Open, distributed research group working on significantly improving learning systems and applying them to the toughest problems humanity faces.
- The role of AI in coding (2020)
- Papers with Annotations
- AI Paygrades - Statistics of industry job offers in Artificial Intelligence.
- CS50 Introduction to Artificial Intelligence with Python (2020) (Notes)
- Mathematical Theory of Artificial Intelligence course (2020)
- Paradigms of Artificial Intelligence Programming (HN) (In OCaml)
- ACL2020 Tutorial: Open-Domain Question Answering
- Simple ML algorithms implemented in Python 3, TensorFlow 2, and Keras by George Hotz
- SISL (Stanford Intelligent Systems Laboratory) (GitHub)
- AI Expert Roadmap (Code) (HN)
- Secondmind - Decisions by people, empowered by AI.
- Architecture For Discovering Computational Consciousness (2020)
- The Institute for Ethical AI & Machine Learning (GitHub)
- dair.ai - Democratizing Artificial Intelligence Research, Education, and Technologies. (GitHub)
- Mila - Quebec Artificial Intelligence Institute. (GitHub)
- EleutherAI - Grassroots AI research group aimed at democratizing and open sourcing AI research. (GitHub)
- Artificial Intelligence Wiki
- Awesome AI Guidelines
- State of the Art AI - Open-data and free platform built by the research community to facilitate the collaborative development of AI. (Concepts)
- OpenCog - Framework for integrated Artificial Intelligence & Artificial General Intelligence (AGI). In Scheme.
- 2020: A Year Full of Amazing AI papers- A Review
- AI Conference Deadlines (Code)
- FACET - Open source library for human-explainable AI.
- Sony AI Research Code
- AI Achievements - Growing Timeline of AI Milestones.
- Complexity No Bar to AI (HN)
- Facebook AI Performance Evaluation Platform
- Google Research: Looking Back at 2020, and Forward to 2021
- Chatting with Google’s DeepMind about the future of AI (2021)
- Moore's Law for Everything (2021) (HN)
- How We Built A Context-Specific Bidding System for Etsy Ads (2021)
- Most fears about technology are really fears about capitalism
- Why Computers Won’t Make Themselves Smarter (2021)
- This AI Learns From Its Dreams | Two Minute Papers (2018) (Paper)
- Replika - AI companion who cares.
- Replika.ai Research Papers, Posters, Slides & Datasets
- From Zero to AI Research Scientist full resources guide
- Francois Chollet - Intelligence and Generalization (2021)
- Your Favorite AI Podcasts / Blogs / Newsletters / YouTube Channels? (2021)
- We were promised Strong AI, but instead we got metadata analysis (2021) (HN)
- Is your AI project a nonstarter? (2018) - Check(list) to help you avoid the pain of learning the hard way.
- The Coming AI Hackers (2021)
- Silicon Valley AI Lab
- Facebook AI Research
- MUM: A new AI milestone for understanding information (2021)
- Intel ISL (Intel Intelligent Systems Lab) (GitHub)
- Biases in AI Systems (2021)
- Anthropic AI - Building Reliable, Interpretable, and Steerable AI Systems. (HN)
- Coral - Complete toolkit to build products with local AI. (GitHub)
- PAIR – Google Research - Human-centered research and design to make AI partnerships productive, enjoyable, and fair.
- The Impossibility of Automating Ambiguity (2021) (Tweet)
- A Breakdown of AI Chip Companies (2021)
- The Ethics of AI (2021)
- Allen Institute for AI (GitHub)
- Scaling Hypothesis - The path to Artificial General Intelligence? (2021)
- Fast and flexible: Human program induction in abstract reasoning tasks (2021) (Tweet)
- Tesla AI Day (2021) (HN)
- One Hundred Year Study on Artificial Intelligence (AI100) - Summarize the history of AI since March 2020.
- The UK AI Strategy: are we listening to the experts? (2021) (Tweet)
- Awesome Edge AI
- ContinualAI - Non-profit Research Organization and Open Community on Continual Learning for AI. (GitHub)
- Resources for Data Centric AI
- Responsible-AI-Widgets - Responsible AI user interfaces for Fairlearn, interpret-community, and Error Analysis, as well as foundational building blocks that they rely on.
- Notes on Artificial Intelligence (Code)
- Using AI to accelerate scientific discovery - Demis Hassabis (2021)
- Just Ask for Generalization (2021) (Tweet)
- Short Story on AI: Forward Pass (2021) (Tweet)
- Solving Math Word Problems (2021) (HN)
- Training Verifiers to Solve Math Word Problems (2021) (Article) (HN) (Tweet)
- Pathways: A next-generation AI architecture (2021)
- Strong AI Requires Autonomous Building of Composable Models (2021)
- Fast indoor 2D localization using ceiling lights (2021)
- Shannon entropy in the context of machine learning and AI (2018)
- An argument for the impossibility of machine intelligence (2021)
- Sea AI Lab (GitHub)
- Ask HN: What are the early signs of singularity? (2021)
- Aligning AI With Shared Human Values (2020) (Code)
- 100 Lessons from 1 Year of AI Research (2021)
- DeepMind's Player of Games, a general-purpose game algorithm (2021) (HN)
- The future of artificial intelligence is self-organizing and self-assembling (2021) (HN)
- What Does It Mean for AI to Understand? (2021) (HN)
- Frontiers in Collective Intelligence: A Workshop Report (2021)
- Literature for the self-taught AI practitioner
- AI Now Institute - Research institute dedicated to examining the social and political implications of artificial intelligence. (Twitter)
- Modular AI - AI infrastructure to power the world.
- Neural nets are not “slightly conscious,” and AI PR can do with less hype (2022) (HN)
- Yann LeCun on a vision to make AI systems learn and reason like animals and humans (2022) (Tweet)
- Deep learning is hitting a wall? (2022) (HN)
- Anatomy of an AI System
- The singularity is close? (2022) (HN)
- AgentFormer: Agent-Aware Transformers for Socio-Temporal Multi-Agent Forecasting (2021) (Code)
- Off Belief Learning (2022)
- The Future of Artificial Intelligence with Sam Harris and Eric Schmidt (2022)
- On the Measure of Intelligence (2019) (Tweet)
- NumGLUE - Suite of Fundamental yet Challenging Mathematical Reasoning Tasks.
- Gato – A Generalist Agent (2022) (HN)
- Reliance on metrics is a fundamental challenge for AI: Patterns (2022)
- Awesome Conversational AI
- Artificial Intelligence for Beginners - A Curriculum - 12 Weeks, 24 Lessons, AI for All.
- Why I will no longer engage in philosophical discussions about conscious AI/superintelligent machines (2022) (TL;DR)
- Discussion between Google engineer and their conversational AI model
- Where I agree and disagree with Eliezer (2022)
- Demis Hassabis: DeepMind - AI, Superintelligence & the Future of Humanity (2022)
- The AI Unbundling (2022) (HN)
- AIRI - Artificial Intelligence Research Institute (GitHub)
- Large Model Applications by Modality
- GUT-AI initiative - Initiative which aims to eliminate the multiple, single-points-of-failure when using AI for real-life applications.
- Bleeding Edge AI - Feed of noteworthy developments in AI.
- Generally Intelligent - Independent research lab building AI agents that can learn & understand like humans, so they can be safely deployed. (Twitter) (Intro)
- Ask HN: Where to start with learning AI? (2022)
- Andrej Karpathy: Tesla AI, Self-Driving, Optimus, Aliens, and AGI (2022)
- Adversarial Policies Beat Professional-Level Go AIs (2022) (HN)
- Neurosymbolic Programming for Science (2022)
- The near future of AI is action-driven (2022) (HN)
- Futurepedia - Largest AI Tools Directory.
- Diplomacy Cicero and Diplodocus - Code for Cicero, an AI agent that plays the game of Diplomacy with open-domain natural language negotiation.
- LAION - Aiming to make large-scale machine learning models, datasets and related code available to the general public. (GitHub)
- Powderworld - Lightweight simulation environment for understanding AI generalization.
- How should we evaluate progress in AI?
- Ask HN: Getting into AI? (2022)
- Building A Virtual Machine inside ChatGPT (2022) (Tweet) (HN)
- Linus Lee Is Living With AI (2022)
- Ask HN: What field in computer science will be AI proof (2022)
- From the Evolution of Rosbag to the Future of AI Tooling (2022)
- A Generalist Neural Algorithmic Learner (2022) (Tweet)
- Before the flood - Ruminations on the future of AI (2022)
- Ask HN: Will AI put programmers our of work? (2022)
- Perhaps it is a bad thing that the leading AI companies cannot control their AIs (2022) (HN)
- Favorite books (fiction or non) about AI (2022)
- Curated list of the latest breakthroughs in AI
- Generalist AI beyond Deep Learning (2023)
- Mastering Diverse Domains through World Models (2023) (Code) (Web) (Code) (Code)
- The Next button (2023) (Tweet)
- AI Reading List
- AI Product Index - Curated index to track AI-powered products.
- AI Toolbox - Comprehensive list of Artificial Intelligence tools divided by category.
- John Carmack’s ‘Different Path’ to Artificial General Intelligence (2023) (HN)
- Ask HN: What were the papers on the list Ilya Sutskever gave John Carmack? (2023)
- Awesome Code AI
- AI Notes
- How should AI systems behave, and who should decide? (2023)
- What recent AI products are you now using on a regular basis? (2023) (HN)
- Papers on the UX of AI programming assistants (2023)
- Creating a landing page using AI tools and no code (HN)
- Introduction to Data-Centric AI (2023) (Lobsters) (HN)
- Planning for AGI and beyond (2023)
- Ask HN: How do I stay on top of AI within software development? (2023)
- EleutherAI announces it has become a non-profit (2023) (HN)
- Self hosted AI (2023)
- The Most Cited AI Papers in 2022 (HN)
- A weapon to surpass Metal Gear (2023) (HN)
- Not By AI Badges - Badge for Your AI-free Content. (HN)
- Yoshua Bengio talks: LLMs, Cognition, Causality, Responsible AI, Creativity (2023)
- Offensive AI Compilation
- Sparks of Artificial General Intelligence: Early experiments with GPT-4 (2023) (Tweet)
- Sam Altman: OpenAI CEO on GPT-4, ChatGPT, and the Future of AI (2023)
- AI Courses
- Simulators (2022)
- How to think about modern AI from first principles
- Ask HN: What's your best resource for keeping up-to-date on AI developments? (2023)
- Generative Agents: Interactive Simulacra of Human Behavior (2023) (HN) (Code)
- Ask HN: I am a full stack developer, where do I start learning for AI (2023)
- AutoResearcher - Automating scientific workflows with AI.
- AI Safety FAQ (Code)
- GPTRPG - Demo of an GPT-based agent existing in an RPG-like environment.
- Fireside Chat: With Ilya Sutskever and Jensen Huang: AI Today and Vision of the Future (2023)
- Google “We Have No Moat, and Neither Does OpenAI” (2023) (HN)
- A Generalist Agent (2022 (Code)
- Interactive AI training simuation
- Ask HN: Will AI result in mass silo-ing of new knowledge? (2023)
- AGiXT - Dynamic AI Automation Platform.
- i-Code - Build integrative and composable multimodal Artificial Intelligence.
- AI Learning Curation
- Ask HN: How to Break into AI Engineering (2023)
- Awesome Open-Ended AI
- How do you use AI development tools? (2023)
- xAI - Understand the Universe.
- “Low-Resource” Text Classification: A Parameter-Free Classification Method with Compressors (2023)
- How to Use AI to Do Stuff: An Opinionated Guide (2023)
- OpenModelDB - Open and free database for AI models. (Code)
- A guide to designing and shipping AI developer tools (2023)
- Dario Amodei (Anthropic CEO) - $10 Billion Models, OpenAI, Scaling, & AGI in 2 years (2023)
- George Hotz: There is no hard takeoff (2023) (HN)
- AGI Introduction
- An observation on Generalization (2023)
- Large Language Models As General Pattern Machines (2023) (HN)
- Awesome AI Tools
- Collaborative AI-Assisted Workflows with Inngest and Partykit
- AI Companies 2023
- Awesome open data-centric AI