My curated vault of resources for learning, building, shipping, and using AI in software development. The focus is practical AI engineering: LLM applications, agentic coding, RAG, local models, evaluation, observability, ML foundations, and durable learning material.
This list is intentionally selective. It favors resources that help developers understand AI systems or build with them, and leaves out entries that are mainly unrelated productivity, marketing, sales, entertainment, or generic software material.
- Start Here
- AI Coding Tools
- Agent Frameworks and Infrastructure
- LLM App Development
- RAG and Data Ingestion
- AI Search and Research Assistants
- Inference and Serving
- Model Providers and Families
- Fine-Tuning and Training
- Evals, Observability, and Security
- Benchmarks and Leaderboards
- Prompting and Playgrounds
- Machine Learning and Deep Learning
- Multimodal AI
- Courses and Books
- Papers and Research Context
- Newsletters, Blogs, and Communities
- OpenAI Cookbook - Practical recipes for building with OpenAI APIs, from prompting to retrieval and tool use.
- Hugging Face LLM Course - A hands-on path through transformers, tokenizers, fine-tuning, and modern LLM workflows.
- Full Stack Deep Learning - Production-oriented course material for training, deploying, and maintaining ML systems.
- Fast.ai Practical Deep Learning - Code-first deep learning course aimed at builders rather than pure theorists.
- Google Machine Learning Crash Course - A compact introduction to supervised ML concepts and applied modeling.
- Transformer Explainer - Interactive browser visualization of how transformer language models process text.
- AnimatedLLM - Visual explanations of core LLM mechanics.
- R2D3: A Visual Introduction to Machine Learning - Friendly visual explanations for important ML ideas.
- Cursor - AI-native code editor for codebase chat, multi-file edits, and refactoring.
- Windsurf - AI-first development environment with code editing and agentic assistance.
- Zed - High-performance code editor with built-in AI editing and agentic workflows.
- Kiro - Agentic IDE from AWS built around spec-driven development.
- Google Antigravity - Agent-first IDE from Google where autonomous agents plan, execute, and verify software tasks with artifacts and browser verification.
- Orca - Agent development environment for running a fleet of parallel coding agents with your own subscriptions on desktop, mobile, and remote runtimes.
- Codex CLI - Local terminal coding agent for repository-aware development tasks.
- Claude Code - Terminal-based coding agent for navigating and editing larger codebases.
- Gemini CLI - Open-source command-line agent built around Google's Gemini models.
- Aider - Git-aware pair programmer that edits files and keeps changes easy to review.
- Amp - Agentic coding tool from Sourcegraph for editor and terminal workflows.
- Goose - Open-source local coding agent from Block that works with any model.
- OpenCode - Open-source terminal coding agent with provider flexibility.
- Pi - Customizable terminal coding agent with an extension-friendly workflow.
- Plandex - Terminal-based AI coding workflow for larger implementation plans.
- DeepSeek-Reasonix - DeepSeek-native terminal coding agent engineered around prefix-cache stability.
- Open Interpreter - Local terminal interface for executing code and automating computer tasks with LLMs.
- GitHub Copilot - AI pair programmer integrated into popular IDEs and GitHub workflows.
- Continue - Open-source IDE assistant that can connect different models and custom context sources.
- Cline - VS Code agent extension with tool use, file editing, and multi-provider support.
- RooCode - Autonomous VS Code coding agent for planning and implementation tasks.
- Amazon Q Developer - AWS-focused coding assistant for IDEs, terminals, and cloud development tasks.
- Tabnine - Code completion assistant with support for team and enterprise workflows.
- Jupyter AI - AI assistant for JupyterLab and notebooks with support for many local and hosted models.
- OpenHands - Autonomous software engineering agent with shell, browser, and editor workflows.
- SWE-agent - Research agent from the SWE-bench team that autonomously fixes GitHub issues.
- Devin - Commercial autonomous software engineering agent.
- Prime Agent - Self-improving RLM agent for coding workflows and long-running autonomous tasks.
- GPT Pilot - App-building agent designed to keep a developer in the loop.
- CodeRabbit - AI pull request review assistant for summarizing changes and surfacing issues.
- PR-Agent - Open-source automation for PR review, descriptions, suggestions, and feedback.
- Qodo - AI coding and review workflows focused on tests, pull requests, and code quality.
- Mintlify - AI-assisted documentation generation for codebases and developer products.
- Stenography - Tool for generating code explanations and documentation.
- Repomix - Packs source code into structured context files for AI tools.
- Gitingest - Converts repositories into LLM-friendly text digests.
- code-review-graph - Local-first code intelligence graph for MCP and CLI that reduces context needed by AI coding tools.
- code-graph-rag - Graph-based RAG for querying, understanding, and editing multi-language monorepos.
- v0 - Prompt-based UI generation for React and Next.js projects.
- Bolt.new - AI web development agent for building and deploying full-stack apps in the browser.
- Lovable - Conversational app generation for quickly turning product ideas into deployable code.
- Replit Agent - Replit's agent for generating, running, and deploying full apps inside the browser IDE.
- screenshot-to-code - Converts UI screenshots into frontend code.
- Vanna - Open-source RAG approach for text-to-SQL and database question answering.
- Wren AI - Open-source generative BI and text-to-SQL agent with a semantic layer.
- AI2sql - Natural-language interface for generating SQL queries.
- LangGraph - Stateful graph framework for multi-step and multi-agent LLM workflows.
- AutoGen - Microsoft's framework for building multi-agent conversations and collaboration loops.
- CrewAI - Agent orchestration framework with roles, tasks, and human review patterns.
- OpenAI Agents SDK - OpenAI's official framework for multi-agent workflows with handoffs, guardrails, and tracing.
- smolagents - Minimal Hugging Face library for agents that write and execute code.
- Semantic Kernel - Microsoft's SDK for integrating LLMs, plugins, and agents into applications.
- Pydantic AI - Typed Python framework for structured LLM applications and reliable outputs.
- Google ADK - Google's Agent Development Kit for local development, tools, and agent protocols.
- PocketFlow - Minimal agent framework useful for understanding the core mechanics without much abstraction.
- MetaGPT - Multi-agent framework that turns a requirement into product, design, and engineering tasks.
- Mastra - TypeScript framework for agents, workflows, memory, and tool integrations.
- VoltAgent - TypeScript framework for agents with tools, memory, and observability hooks.
- PraisonAI - Multi-agent framework with workflows, memory, and tool support.
- Portia AI - Agent framework designed around visible plans, progress updates, and human interruption.
- Hermes Agent - Personal agent platform with memory, messaging integrations, and sandboxed tool execution.
- DeerFlow - Long-horizon SuperAgent harness with sandboxes, memory, tools, skills, and subagents.
- AutoGPT - Early autonomous agent project that grew into a platform for building and running AI agents.
- LiveKit Agents - Framework for building realtime voice and video AI agents.
- Swarm Forge - Simple tool from Robert C. Martin for coordinating several AI agents.
- Embabel Agent - Kotlin framework for agentic flows on the JVM that mixes LLM prompts with typed domain models and goal-directed planning.
- ruflo - Agent meta-harness for deploying multi-agent swarms and coordinating autonomous workflows.
- Paperclip - Open-source app for managing and coordinating AI agents at work.
- holaOS - Open-source agent workspace that runs Claude Code, Codex, and other agents across 100+ tool integrations.
- Apache Maka - Local-first AI agent workspace, incubating at Apache, that models messages, tool calls, results, and permissions.
- Agent Skills - Open format and reference SDK for reusable agent capabilities.
- agent-skills - Production-grade engineering skills for AI coding agents, curated by Addy Osmani.
- skills - Matt Pocock's collection of practical engineering skills for coding agents.
- Superpowers - Agentic skills framework and software development methodology.
- Google Skills - Official Agent Skills for Google products and technologies.
- Compound Engineering Plugin - Compound engineering workflows packaged for Claude Code, Codex, Cursor, and other agents.
- Anthropic Skills - Anthropic's public repository of official and example Agent Skills.
- Spec Kit - GitHub's toolkit for spec-driven development with coding agents.
- Cursor Plugins - Cursor plugin specification and official plugins.
- andrej-karpathy-skills - Single CLAUDE.md that improves Claude Code behavior, derived from Andrej Karpathy's observations on LLM coding.
- ECC - Agent harness optimization system with skills, memory, and security rules for Claude Code, Codex, OpenCode, and Cursor.
- Agency Agents - Large collection of role-based agent personas spanning engineering, design, marketing, and operations.
- Caveman - Claude Code skill that cuts token usage by forcing terse responses.
- Diagram Design - Claude Code skill with 29 editorial diagram types rendered as self-contained HTML and SVG.
- Obsidian Skills - Agent skills for working with the Obsidian CLI and its open formats.
- Anthropic Cybersecurity Skills - Community collection of 800+ structured cybersecurity skills for agents, mapped to MITRE ATT&CK, NIST CSF 2.0, and other frameworks.
- Model Context Protocol - Open protocol for connecting AI systems to tools, data, and external capabilities.
- ToolHive - Tool for finding and deploying MCP servers.
- Browser Use - Library that lets AI agents control a real browser to complete web tasks.
- Steel Browser - Browser automation infrastructure for AI agents, including sessions, screenshots, and proxies.
- Notte - Framework for browser-using AI agents.
- E2B - Sandboxed cloud environments for safely running AI-generated code.
- Cloudflare Computer - Sandboxed computer environments that give agents a full machine to work in.
- Agent Reach - CLI that gives agents read and search access to Twitter, Reddit, YouTube, GitHub, and more without API fees.
- CLI-Anything - Generates agent-ready CLIs for existing software and hosts a hub of community-built ones.
- ego lite - Browser designed for agents and humans to share, so automation runs in parallel with access to your real logins and tabs.
- mem0 - Memory layer that lets agents retain user context across sessions.
- Letta - Platform for stateful agents with long-term memory, based on the MemGPT research.
- TencentDB Agent Memory - Team-level memory hub that turns conversations, docs, and code into reusable memory assets shared across agents.
- OpenViking - Open-source context database for agents that exposes memories, resources, and skills as a browsable virtual filesystem with tiered loading.
- ai-memory - Long-term memory for agent coding CLIs that also enables handoff between different agent vendors.
- LangChain - Broad framework for LLM apps, chains, agents, retrieval, and integrations.
- LlamaIndex - Data framework for connecting LLMs to private, structured, and unstructured knowledge.
- Haystack - Modular framework for search, question answering, agents, and RAG pipelines.
- DSPy - Framework for programming LLM pipelines declaratively and optimizing prompts automatically.
- LLM App - Framework for real-time LLM-enabled data pipelines.
- SymbolicAI - Neuro-symbolic framework for building LLM-centered applications.
- Instructor - Library for reliable structured outputs from LLMs using type annotations.
- Outlines - Structured generation library that constrains model output to JSON, regex, or grammars.
- LMQL - Query language for constraining and composing LLM calls.
- LiteLLM - Unified SDK and proxy for calling 100+ LLM providers through the OpenAI format.
- Portkey - LLMOps gateway for monitoring, routing, caching, and governance.
- Bifrost - Open-source LLM gateway for routing, load balancing, guardrails, and observability.
- TensorZero - Framework that combines gateway, observability, evaluation, optimization, and experimentation for LLM apps.
- Manifest - LLM router for choosing cost-effective models and enforcing usage limits.
- Switchyard - NVIDIA router that spreads LLM traffic across models and providers while preserving native OpenAI and Anthropic APIs.
- Dify - Open-source platform for visually building and operating LLM apps and agents.
- Flowise - Drag-and-drop builder for LLM flows and agents.
- Langflow - Visual builder for RAG and multi-agent applications.
- Scale GenAI Platform - Platform for comparing, building, and deploying generative AI applications.
- n8n - Fair-code workflow automation platform with native AI agent nodes that combines visual building with custom code.
- Docling - Document conversion and ingestion toolkit for AI pipelines.
- pdf-inspector - Fast Rust library for PDF inspection, classification, and text extraction with scanned-vs-text detection.
- Firecrawl - API that crawls websites and converts them into LLM-ready markdown or structured data.
- Crawl4AI - Open-source web crawler designed for LLM data pipelines.
- FAISS - Meta's library for efficient similarity search and clustering of dense vectors.
- pgvector - PostgreSQL extension for vector similarity search.
- Qdrant - Open-source vector database and search engine written in Rust.
- Weaviate - Open-source vector database with hybrid search and modular model integrations.
- Milvus - Distributed vector database built for large-scale similarity search.
- Chroma - Developer-friendly embedding database for LLM applications.
- LanceDB - Embedded vector database for multimodal AI built on the Lance columnar format.
- turbovec - Vector index built on TurboQuant, written in Rust with Python bindings.
- Agentset - Platform for building and evaluating RAG and agentic systems.
- RAGFlow - Open-source RAG engine with deep document understanding and agent workflows.
- Semantica - Graph-native infrastructure for context and accountable AI systems.
- privateGPT - Local document Q&A for private files.
- Quivr - Personal knowledge base that lets users chat with stored files and notes.
- Perplexity - AI search interface that combines retrieval and generated answers.
- Exa - Search API designed for language-model workflows.
- Phind - Developer-focused AI search and answer engine.
- You.com - AI search engine with personalized and privacy-oriented features.
- NotebookLM - Gemini-powered tool for working with documents and notes.
- Open Notebook - Open-source NotebookLM-like system with more local control.
- STORM - Research assistant that gathers sources and produces citation-backed reports.
- Local Deep Research - Research workflow for web, academic, and private-document sources using local or cloud models.
- Elicit - AI research assistant for literature review and evidence extraction.
- Consensus - Search engine for answers grounded in scientific papers.
- SciSpace - Assistant for reading, explaining, and exploring academic literature.
- Ollama - Simple local runner for open-weight language models.
- llama.cpp - Efficient C/C++ inference for LLaMA-style models and many derivatives.
- vLLM - High-throughput inference and serving engine built around PagedAttention.
- SGLang - Fast serving framework for LLMs and vision-language models.
- llamafile - Packages a model and llama.cpp runtime into a single portable executable.
- LocalAI - Self-hosted OpenAI-compatible API for running models locally.
- MLX - Apple's array framework for efficient machine learning on Apple silicon.
- bitnet.cpp - Microsoft inference framework for 1-bit LLMs.
- whisper.cpp - C/C++ implementation of Whisper for local speech recognition.
- ds4 - DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA, and ROCm by antirez.
- AirLLM - Runs 70B model inference on a single 4GB GPU via layered loading.
- gpt4all - Local model ecosystem with desktop app and bindings.
- LLM - Simon Willison's CLI and Python library for using local and remote LLMs.
- Harbor - Containerized stack for running local model backends, UIs, and supporting services.
- RunThisLLM - Hardware-oriented guide for choosing models that can run locally.
- llmfit - CLI that checks hundreds of models and providers to find what runs on your hardware.
- oMLX - LLM inference server for Apple Silicon with continuous batching and SSD caching, managed from the macOS menu bar.
- Modular MAX - Modular Platform with the MAX inference engine and the Mojo language.
- LM Studio - Desktop app for discovering, downloading, and running local models.
- Open WebUI - Self-hosted web interface for local and remote LLMs.
- LibreChat - Open-source multi-provider chat UI for assistant-style workflows.
- Jan - Local-first desktop AI app that can run offline or connect to APIs.
- Msty - Desktop interface for working with local and hosted AI models.
- OpenRouter - Unified API for accessing many hosted models through one interface.
- Together AI - Hosted training, fine-tuning, and inference for open models.
- Groq - Fast cloud inference for supported open models using LPU hardware.
- OpenAI API - APIs for language, multimodal generation, speech, vision, and agentic workflows.
- ChatGPT - OpenAI's conversational assistant for general reasoning, coding, and multimodal work.
- Claude - Anthropic's model family for writing, analysis, coding, and long-context tasks.
- Gemini - Google's multimodal AI family and chat interface.
- Gemma - Google's open-weight model family derived from Gemini research.
- Grok - xAI's model family and assistant with real-time X integration.
- Phi - Microsoft's family of small language models.
- Llama - Meta's open-weight model family for self-hosting, fine-tuning, and research.
- Mistral - Open-weight and hosted models from Mistral AI.
- DeepSeek - Open-source model family known for strong reasoning and coding variants.
- Qwen - Alibaba's multilingual model family with open-source releases.
- Kimi - Moonshot AI assistant and model family with long-context and agentic use cases.
- GLM - Open-source language model family from Z.ai.
- Cohere - Enterprise NLP and LLM platform with retrieval-oriented APIs.
- MiniMax - Multimodal foundation models spanning text, speech, video, and music.
- Hugging Face - Hub for open models, datasets, and machine learning tooling.
- Needle - 14 MB foundation model for tiny devices such as phones, wearables, smart home hardware, and robots.
- Unsloth - Fast, memory-efficient fine-tuning library with a local UI for running and training LLMs and diffusion models.
- Axolotl - Streamlined fine-tuning tool covering many model architectures via YAML configs.
- LLaMA-Factory - Unified fine-tuning framework for 100+ models with a web UI.
- TRL - Hugging Face library for post-training models with SFT, DPO, and RLHF.
- Kiln - App for synthetic data, fine-tuning, and model-building workflows.
- Ludwig - Low-code system for training and deploying ML and deep learning models.
- Soup - YAML-driven LLM fine-tuning with layer streaming that trains an 8B model on a 4 GB laptop GPU.
- OpenAI Evals - Framework for writing and running model evaluation suites.
- promptfoo - Open-source CLI for testing prompts, running evals, and red-teaming LLM apps.
- DeepEval - Open-source LLM evaluation framework with pytest-style tests.
- Ragas - Evaluation toolkit focused on RAG pipeline quality.
- lm-evaluation-harness - EleutherAI's standard framework for benchmarking language models.
- Inspect - UK AI Security Institute's framework for large language model evaluations.
- Langfuse - Open-source tracing, prompt management, metrics, and evaluation platform.
- LangSmith - LangChain's platform for tracing, evaluating, and monitoring LLM applications.
- Braintrust - Platform for evals, prompt iteration, and logging in AI products.
- Phoenix - Open-source observability for ML and LLM applications.
- OpenLIT - OpenTelemetry-native observability for generative AI apps.
- Helicone - Logging, monitoring, caching, and debugging layer for LLM applications.
- Opik - Open-source tracing, evaluation, and monitoring platform for LLM systems.
- MLflow - Experiment tracking, model deployment, and evaluation platform with LLM support.
- Agenta - Open-source platform for prompt management, evaluation, and production monitoring.
- Maxim AI - Evaluation and observability platform for shipping AI products with quality checks.
- OpenAI Downtime Monitor - Public status and latency tracker for major LLM APIs.
- Cleanlab TLM - API for detecting unreliable or hallucinated LLM outputs.
- Prediction Guard - Controlled LLM access with privacy, safety, and compliance features.
- rehydra - Local PII anonymization and rehydration SDK for LLM prompts.
- Agentic Radar - Security scanner for agentic workflows.
- AI-Infra-Guard - Tencent's AI red teaming platform that scans agents, skills, MCP servers, and AI infrastructure.
- Artificial Analysis - Independent model comparisons across quality, price, speed, and hosting.
- LMArena - Crowdsourced human-preference leaderboard for model comparison.
- OpenRouter Rankings - Usage-based model rankings from OpenRouter traffic.
- SEAL LLM Leaderboard - Expert-driven model benchmark leaderboard.
- LLM Stats - Model comparison site covering context windows, price, speed, and benchmarks.
- SWE-bench - Benchmark for software engineering tasks based on real GitHub issues.
- Terminal-Bench - Benchmark for terminal-based agent performance.
- OpenAI Playground - Browser workspace for testing prompts, models, and API behavior.
- Google AI Studio - Prototyping environment for Gemini models and prompts.
- GitHub Models - Model exploration and prototyping directly inside GitHub.
- PromptPerfect - Tooling for prompt iteration and optimization.
- OpenAI Prompt Engineering Guide - Official tactics for improving prompt reliability.
- Learn Prompting - Open educational material for prompting, structured outputs, and AI safety basics.
- Prompt Engineering Guide - Community-maintained notes and examples for prompt design.
- Anthropic Courses - Educational notebooks and material for working with Anthropic models.
- DeepLearning.AI: ChatGPT Prompt Engineering for Developers - Short course on prompts for developer workflows.
- PyTorch - Popular deep learning framework with dynamic computation graphs and strong research adoption.
- TensorFlow - End-to-end ML framework for training, deployment, and production pipelines.
- Keras - High-level neural network API for fast experimentation.
- scikit-learn - Core Python toolkit for classical machine learning.
- PaddlePaddle - Baidu's deep learning platform for research and production.
- DeepLearning4J - JVM-based deep learning framework.
- mlpack - C++ machine learning library focused on speed and scalability.
- cuDNN - NVIDIA GPU-accelerated primitives for deep neural networks.
- Gymnasium - Toolkit for reinforcement learning environments and algorithm comparison.
- Albumentations - Fast image augmentation library for computer vision pipelines.
- Transformers - Hugging Face's model-definition framework for state-of-the-art models across text, vision, audio, and multimodal tasks.
- ONNX Runtime - Cross-platform, high-performance accelerator for ML inference and training.
- Jupyter Notebook - Interactive notebook environment widely used for ML experiments and analysis.
- TensorBoard - Visualization toolkit for model training and experiments.
- Netron - Viewer for neural network, ONNX, and ML model files.
- Activeloop - Dataset management and streaming platform for computer vision and AI workloads.
- MNIST - Classic handwritten digit dataset for introductory vision models.
- Fashion-MNIST - Drop-in MNIST alternative using fashion product images.
- CIFAR-10 and CIFAR-100 - Small image classification datasets for model experiments.
- ImageNet - Large-scale visual recognition dataset that shaped modern computer vision.
- COCO - Detection, segmentation, captioning, and keypoint dataset for vision systems.
- Open Images - Large annotated image dataset for classification, detection, and segmentation.
- Pascal VOC 2012 - Object detection and segmentation benchmark.
- Visual Question Answering - Benchmark for answering natural-language questions about images.
- YouTube-8M - Large-scale labeled video dataset.
- DeepMind QA Corpus - Reading comprehension dataset built from CNN and Daily Mail articles.
- UC Irvine Machine Learning Repository - Broad collection of datasets for classical ML tasks.
- Stable Diffusion - Open text-to-image diffusion model ecosystem.
- Flux - High-quality text-to-image models from Black Forest Labs.
- Midjourney - Widely used image generation service for stylized and photorealistic outputs.
- Ideogram - Image generation platform with strong text rendering.
- Adobe Firefly - Creative Cloud integrated image generation and editing tools.
- ComfyUI - Node-based interface for Stable Diffusion and image-generation workflows.
- Civitai - Community hub for sharing diffusion models, LoRAs, and workflows.
- Lexica - Search engine for Stable Diffusion images and prompts.
- PromptHero - Prompt search and inspiration across major image models.
- DiffusionDB - Large-scale dataset of Stable Diffusion prompts and generated images.
- TRELLIS.2 - Microsoft's native and compact structured latents for 3D generation.
- Modly - Desktop app that generates 3D models from images or prompts with local AI on your own GPU.
- Runway - AI video generation and editing platform for creative and production workflows.
- Pika - Text-to-video and image-to-video generation platform.
- Luma Dream Machine - Video generation model for realistic motion from text or images.
- Kling AI - Image and video generation tools.
- Google Flow - Google AI filmmaking workspace powered by Veo.
- HyperFrames - Framework for programmatically rendering video with HTML, CSS, JavaScript, and agents.
- video-use - Library for editing videos with coding agents.
- LTX-2 - Official inference and LoRA training package for the LTX-2 open audio-video generative model.
- Whisper - Speech recognition model released by OpenAI.
- faster-whisper - Reimplementation of Whisper on CTranslate2 for much faster transcription.
- Kokoro - Lightweight open-weight text-to-speech model.
- Deepgram - Speech-to-text and voice AI API platform.
- AssemblyAI - Speech recognition and audio intelligence API.
- ElevenLabs - High-quality text-to-speech and voice generation platform.
- Bark - Open-source transformer-based text-to-audio model.
- TorToiSe - Open-source text-to-speech model with an emphasis on voice quality.
- AudioCraft - Meta's generative audio toolkit for music and sound generation.
- Voicebox - Open-source AI voice studio for cloning, dictation, and creation.
- speech-to-speech - Hugging Face toolkit for building local voice agents with open-source models.
- Suno - Text-to-music generation platform.
- Udio - Music generation platform for creating and sharing songs.
- AI Engineering - End-to-end guide to designing and shipping AI products.
- Designing Machine Learning Systems - Production ML systems, data loops, deployment, and maintenance.
- Hands-On Large Language Models - Visual and implementation-oriented guide to LLM applications.
- LLM Engineer's Handbook - Production LLM workflows, fine-tuning, quantization, and serving.
- Build a Large Language Model from Scratch - Layer-by-layer implementation of transformer language models.
- Build an AI Agent from Scratch - Agent foundations covering tools, memory, planning, and multi-agent patterns.
- Build a Reasoning Model from Scratch - Ground-up explanation of reasoning model construction.
- Generative Deep Learning - Practical coverage of GANs, VAEs, diffusion, and generative modeling.
- Artificial Intelligence: A Modern Approach - Canonical textbook for the broader AI field.
- Deep Learning - Foundational neural network text by Goodfellow, Bengio, and Courville.
- Understanding Deep Learning - Modern deep learning book with math, intuition, and notebooks.
- Deep Learning: Foundations and Concepts - Probability-grounded deep learning reference.
- Speech and Language Processing - Standard reference for NLP and language technology.
- Reinforcement Learning: An Introduction - Classic reinforcement learning text by Sutton and Barto.
- The Hundred-Page Machine Learning Book - Compact machine learning overview.
- Machine Learning Yearning - Andrew Ng's practical guide to structuring ML projects.
- Understanding Machine Learning: From Theory to Algorithms - Theory-oriented ML textbook.
- DeepLearning.AI Short Courses - Focused, practical short courses on LLMs, agents, evaluation, and prompting.
- Karpathy: Neural Networks Zero to Hero - Bottom-up neural network and language-model implementation series.
- Stanford CS324: Large Language Models - University course on LLM capabilities, training, and societal impact.
- Stanford CS224n - Natural language processing with deep learning.
- Stanford CS231n - Convolutional neural networks and computer vision.
- MIT 6.S191: Introduction to Deep Learning - Fast-paced MIT course on modern deep learning.
- MIT 6.S099: Artificial General Intelligence - MIT course and lecture material on AGI.
- Berkeley Deep Reinforcement Learning - Course material on deep RL methods and applications.
- Google DeepMind Introduction to Reinforcement Learning - Video course on RL fundamentals.
- Hugging Face Diffusion Models Course - Course material for learning diffusion models in Python.
- Google Generative AI Learning Path - Introductory path for generative AI concepts and Google tooling.
- Generative AI for Beginners - Microsoft's 21-lesson course on building with generative AI.
- AI for Beginners - Microsoft's 12-week, 24-lesson introductory AI curriculum.
- AI for Everyone - Non-technical overview of AI strategy and capabilities.
- Attention Is All You Need - Introduced the transformer architecture behind modern LLMs.
- Scaling Laws for Neural Language Models - Shows how language model performance scales with compute, data, and parameters.
- Language Models are Few-Shot Learners - GPT-3 paper that popularized few-shot prompting at scale.
- Training Language Models to Follow Instructions with Human Feedback - InstructGPT paper that established the RLHF recipe behind modern assistants.
- Constitutional AI - Alignment approach using model-written principles and critiques.
- Chain-of-Thought Prompting Elicits Reasoning in Large Language Models - Showed that step-by-step prompting unlocks reasoning in large models.
- ReAct: Synergizing Reasoning and Acting in Language Models - Interleaved reasoning and tool use, the pattern behind most LLM agents.
- Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks - Original RAG paper combining retrieval with generation.
- LoRA: Low-Rank Adaptation of Large Language Models - Parameter-efficient fine-tuning method that became the default for adapting LLMs.
- FlashAttention - IO-aware exact attention algorithm that made long contexts practical.
- DeepSeek-R1 - Reasoning model trained with reinforcement learning, released with open weights.
- ImageNet Classification with Deep Convolutional Neural Networks - AlexNet paper that accelerated deep learning adoption in vision.
- Sequence to Sequence Learning with Neural Networks - Early neural sequence transduction work for translation and related tasks.
- Neural Turing Machines - Research on neural networks augmented with differentiable memory.
- Batch Normalization - Training technique that stabilizes and accelerates deep neural networks.
- Residual Learning - ResNet paper that enabled much deeper vision networks.
- Mastering the Game of Go with Deep Neural Networks and Tree Search - AlphaGo paper combining deep learning and tree search.
- Artificial General Intelligence: Concept, State of the Art and Future Prospects - Ben Goertzel's overview of AGI as a research program.
- Mapping the Landscape of Human-Level Artificial General Intelligence - Survey-style map of AGI concepts and approaches.
- Universal Intelligence: A Definition of Machine Intelligence - Formal discussion of machine intelligence definitions.
- The AGI Containment Problem - Research framing around containment and control of advanced AI systems.
- Simon Willison's Weblog - Prolific blog tracking practical LLM tools and developments.
- Lil'Log - Lilian Weng's in-depth technical posts on deep learning and LLM research.
- Latent Space - Podcast and newsletter for AI engineers.
- AI Engineer Newsletter - Newsletter focused on AI engineering and practical LLM development.
- The Rundown AI - General AI news and product updates.
- AlphaSignal - AI research and engineering updates.
- Superhuman AI - AI tools and workflow-oriented newsletter.
- Lex Fridman AI Podcast - Long-form conversations on AI, science, engineering, and philosophy.
- r/LocalLLaMA - Reddit community for running and fine-tuning local models.
- OpenAI - AI research and product organization.
- Google DeepMind - AI research lab working across models, science, and general intelligence.
- Machine Intelligence Research Institute - Research organization focused on advanced AI safety.
- OpenCog - Open-source project exploring AGI architectures.
- Numenta - Research organization studying intelligence and brain-inspired computation.
- Journal of Artificial General Intelligence - Research journal dedicated to AGI.
- Awesome RAG Production - Curated resources for production retrieval-augmented generation.
- Open LLMs - Curated list of commercially usable open LLMs.
- Awesome ChatGPT - Resources, demos, and tools around ChatGPT-style applications.
- Awesome ChatGPT Prompts - Prompt examples for ChatGPT workflows.
- Awesome Music AI - AI music generation and analysis resources.
- Papers for Molecular Design Using Deep Learning - Domain-specific generative AI and deep learning papers for molecular design.