AiFetchly Blog

Build with AI data, ship faster

Tutorials, architectures, and best practices for AI-powered data fetching.

Connecting Inbound Mailboxes: IMAP vs POP3 Guide

Step-by-step guide for digital marketers to connect inbound mailboxes in aiFetchly: configure IMAP vs POP3, sanitize HTML payloads, and automate AI replies.

digital-marketersemail-marketingimapauto-replytutorial-walkthrough
Configuring Native Browsers in aiFetchly: Chrome & Firefox

Deep dive into aiFetchly External System Paths: configure native Chrome and Firefox executables, leverage authentic OS entropy, and bypass anti-bot walls.

developersbrowser-automationchrome-dev-toolsanti-botfeature-deep-dive
aiFetchly Lifecycle Hooks: Zero-Trust AI Tool Safety

Deep dive into aiFetchly lifecycle hooks: intercept PreToolUse events, enforce custom command policies via JSON IPC, and safeguard autonomous AI agents.

developerslifecycle-hooksagent-safetytool-governancefeature-deep-dive
Building Custom Command Hooks: Intercept AI Tool Calls

Step-by-step developer guide to writing, registering, and testing custom lifecycle command hooks in aiFetchly using standard I/O JSON protocol.

developerslifecycle-hookscommand-hookstool-guardrailstutorial-walkthrough
Inside aiFetchly Operations Dashboard: Workflow Governance

Deep dive for power users into aiFetchly Operations Dashboard: govern multi-agent workflows, monitor priority queues, and audit real-time execution telemetry.

power-usersoperations-dashboardworkflow-governancetask-monitoringfeature-deep-dive
Solving Anti-Bot Roadblocks: 2Captcha & Native Browsers

Learn how data analysts resolve Cloudflare and CAPTCHA challenge walls in aiFetchly with automated 2Captcha solving and native Chrome/Firefox binary binding.

data-analystsanti-bot2captchabrowser-automationproblem-solution
Configuring AI Message Tasks: Risk Tiers & Circuit Breakers

Step-by-step developer guide to configuring autonomous AI Message tasks in aiFetchly with granular tool risk tiers, auto-approve gates, and circuit breakers.

developerstask-schedulerai-message-taskscircuit-breakerstutorial-walkthrough
Tuning Local RAG: Embedding Models & Vector Dimensions

Deep dive for data analysts into aiFetchly RAG architecture: evaluate embedding models, vector dimensions (384d-1536d), and semantic chunking trade-offs.

data-analystsragvector-embeddingsknowledge-libraryfeature-deep-dive
Customer Communication AI: Automate Inbound Inquiries

Learn how power users automate repetitive customer inquiries and follow-ups in aiFetchly with Knowledge Library RAG, IMAP sync, and human approvals.

power-userscustomer-communicationinbound-automationragproblem-solution
Inside aiFetchly Workspace Memory: Auto-Dream Architecture

Deep dive for developers into aiFetchly Workspace Memory: explore Git-root scoping, 6 memory schemas, Auto-Dream consolidation, and confidence scoring.

developersworkspace-memoryauto-dreamcontext-managementfeature-deep-dive
aiFetchly AI Email Writer: Step-by-Step Campaign Guide

Complete tutorial for digital marketers to build high-converting cold email sequences using aiFetchly AI Email Writer, dynamic variables, and local RAG.

digital-marketersemail-marketingai-email-writeroutreach-campaigntutorial-walkthrough
Structured Web Processing: Raw DOM to Relational Tables

Deep dive for data analysts into aiFetchly Structured Information Processing: parse complex web pages, normalize attributes, and export clean relational tables.

data-analystsstructured-dataweb-scrapingdata-normalizationfeature-deep-dive
AI Chat V2: Resilient Streaming & Context Management

Learn how developers eliminate context crashes and streaming dropouts in aiFetchly AI Chat V2 with live CTX% telemetry, auto-compaction, and reconnect engines.

developersai-chat-v2context-managementstreaming-reconnectproblem-solution
aiFetchly Task Chaining: Automate Multi-Step B2B Pipelines

Step-by-step tutorial for power users to automate multi-stage B2B pipelines by chaining search, contact extraction, and AI analysis with dependency triggers.

power-userstask-schedulingautomationdependency-chainingtutorial-walkthrough
Desktop vs Cloud Marketing: The aiFetchly Lead Gen Edge

Explore why digital marketers choose desktop-first aiFetchly over cloud SaaS platforms for unmetered B2B lead scraping, private SMTP, and zero API credit fees.

digital-marketersdesktop-advantagelead-generationemail-marketingdesktop-vs-web-app-advantage
Geospatial Scraping: aiFetchly Google & Yandex Maps Guide

Step-by-step tutorial for data analysts to scrape, normalize, and export verified local business data across Google Maps and Yandex Maps using aiFetchly.

data-analystsgoogle-mapsyandex-mapsweb-scrapingtutorial-walkthrough
AMD Pensando Pollara 400 Guide: UEC 400G AI NIC

Master AMD Pensando Pollara 400 in 2026: explore the first UEC-ready AI NIC, 400GbE P4 packet pipeline, MetaRoCE, UET, and ROCm RCCL GPU cluster scaling.

amdpensandopollara-400ai-nicultra-ethernetrocmrccltutorial
Apple M4 Neural Engine Guide: ANE Silicon Architecture

Master the Apple M4 Neural Engine in 2026: explore the 38 TOPS 16-core ANE, unified memory DMA, Core ML graph compiler, and sub-3W on-device AI.

appleapple-siliconneural-engineanem4-chipcore-mlai-hardwaretutorial
Broadcom Jericho3-AI Guide: Scheduled Fabric for AI

Master Broadcom Jericho3-AI in 2026: explore the BCM88890 ASIC, Ramon3 fabric, credit-based VOQs, cell spraying, and zero-loss scaling for 32k GPU clusters.

broadcomjericho3-aibcm88890ramon3scheduled-fabricdatacenter-networkingai-clusterstutorial
Broadcom Tomahawk 5 Guide: Ultra Ethernet AI Fabrics

Master Broadcom Tomahawk 5 in 2026: explore 51.2 Tbps switching, 800GbE ports, RoCEv2 congestion control, and Ultra Ethernet AI cluster fabrics.

broadcomtomahawk-5ultra-ethernetrocev2ai-fabricsdatacenter-networkinggpu-clusterstutorial
Cisco Silicon One G200 Guide: 51.2T Unified AI Fabrics

Master Cisco Silicon One G200 in 2026: explore 51.2 Tbps switching, 800GbE ports, scheduled VOQ fabric, P4 programmability, and Ultra Ethernet AI.

ciscosilicon-oneg200ai-fabricsultra-ethernetrocev2datacenter-networkingtutorial
Enfabrica ACF-S Guide: Accelerated Fabric for AI Clusters

Master Enfabrica ACF-S in 2026: explore PCIe Gen 5, CXL memory pooling, 800GbE RDMA, and the Accelerated Compute Fabric Switch for 32k GPU clusters.

enfabricaacf-spcie-gen5cxlrocev2ai-fabricsdatacenter-networkingtutorial
Marvell Teralynx 10 Guide: 51.2T Ultra-Low Latency AI Fabric

Master Marvell Teralynx 10 in 2026: explore 51.2 Tbps switching, sub-200ns latency, 800GbE ports, flowlet routing, and Ultra Ethernet AI fabrics.

marvellteralynx-10ultra-ethernetrocev2ai-fabricsdatacenter-networkinggpu-clusterstutorial
Directory Assistant: Scraping 12 Global Business Registries

Master the aiFetchly Directory Assistant: extract verified B2B firmographics across 12 international business directories with automated cookie and shadow DOM bypasses.

data-analystsdirectory-assistantweb-scrapingfirmographicsfeature-deep-dive
NVIDIA Quantum-X800 Guide: 800G InfiniBand AI Fabrics

Master NVIDIA Quantum-X800 in 2026: explore Q3400 115.2T switching, ConnectX-8 800G SuperNICs, SHARPv4 in-network compute, and Blackwell AI fabrics.

nvidiaquantum-x800connectx-8infinibandai-fabricsdatacenter-networkinggpu-clusterstutorial
NVIDIA Spectrum-X Guide: Hyperscale AI Ethernet Fabric

Master NVIDIA Spectrum-X in 2026: explore Spectrum-4 51.2T switching, BlueField-3 SuperNICs, RoCE adaptive routing, and zero-loss AI cluster fabrics.

nvidiaspectrum-xspectrum-4bluefield-3rocev2ai-fabricsdatacenter-networkingtutorial
Prism Guide: Multi-LLM Serving via GPU Memory Ballooning

Master Prism in 2026: explore USENIX OSDI 2026 GPU memory ballooning, kvcached driver, KVPR model placement, and 3.3x higher TTFT SLO attainment.

PrismGPU Memory BallooningLLM ServingMulti-TenancyOSDI 2026kvcachedKV CacheSystems Engineering
Snapdragon X Elite Guide: Hexagon NPU & Copilot+ PC AI

Master Snapdragon X Elite Hexagon NPU in 2026: explore 45 TOPS compute, 136 GB/s memory, OCP microscaling MXFP6/4, and on-device Copilot+ AI serving.

qualcommsnapdragon-x-elitehexagon-npucopilot-pcon-device-aimicroscalingai-hardwaretutorial
Strata Guide: Hierarchical Context Caching for Long LLMs

Master Strata in 2026: explore USENIX OSDI 2026 hierarchical context caching, GPU-assisted I/O, HiRadixTree, and 5x faster TTFT for long-context LLMs.

StrataContext CachingKV CacheLong-Context LLMsOSDI 2026GPU-Assisted IOSGLangSystems Engineering
Tesla HW4 Guide: AI4 In-Vehicle Autonomous Driving Silicon

Master Tesla HW4 (AI4) in 2026: explore 5nm dual-SoC silicon, 500+ TOPS compute, GDDR6 memory, 16-camera vision, and end-to-end FSD v13 neural driving.

tesla-hw4ai4autonomous-drivingnpuautomotive-siliconfsdcomputer-visiontutorial
Ultra Ethernet Transport (UET) Guide: Next-Gen AI Fabrics

Master Ultra Ethernet Transport (UET 1.0) in 2026: explore multipath packet spraying, flexible ordering, credit congestion control, and open AI fabrics.

ultra-ethernetuetuecai-fabricsdatacenter-networkingrocev2gpu-clusterstutorial
ZipServ Guide: Lossless BF16 Compression for Fast LLMs

Master ZipServ in 2026: explore ASPLOS 2026 hardware-aware lossless compression, TCA-TBE bitmaps, fused ZipGEMM, and 2.2x faster bit-exact LLM inference.

ZipServLossless CompressionLLM InferenceTensor CoreASPLOS 2026ZipGEMMBFloat16Systems Engineering
Achronix Speedster7t Guide: 2D NoC & MLP AI FPGA Silicon

Master Achronix Speedster7t in 2026: explore 20 Tbps 2D NoC architecture, 86 TFLOPS Machine Learning Processors, 512 GB/s GDDR6 memory, and sub-10ms AI.

AchronixSpeedster7t2D NoCFPGAMachine Learning ProcessorGDDR6AI HardwareEdge AI
Alibaba Hanguang 800 Guide: T-Head Datacenter AI NPU

Master Alibaba Hanguang 800 in 2026: explore T-Head 4-core ring architecture, 192MB SRAM, CISC tensor ISA, 500 IPS/W efficiency, and X-Dragon cloud AI serving.

alibabat-headhanguang-800ai-hardwarenpudatacenter-siliconx-dragontutorial
AMD XDNA 2 Guide: Spatial Dataflow NPU & Block FP16 AI

Master AMD XDNA 2 in 2026: explore 32 AI Engine tiles, 50 TOPS compute, native Block FP16 arithmetic, spatial dataflow, and Ryzen AI software integration.

amdxdna-2ryzen-aiai-engineblock-fp16npuedge-aitutorial
Arm Ethos-U85 Guide: Transformer MicroNPU for Edge AI

Master Arm Ethos-U85 in 2026: explore the 4 TOPs transformer microNPU, Cortex-M85 pairing, Vela compiler optimization, and sub-watt edge TinyML serving.

armethos-u85micronputinymledge-aicortex-m85transformers
Prospect Research Agent: aiFetchly Lead Researcher Guide

Master the built-in Lead Researcher subagent in aiFetchly AI Chat V2: automate deep prospect company research, market signals, and source-grounded summaries.

digital-marketerslead-researchersubagentsai-chat-v2tutorial-walkthrough
BrainChip Akida 2.0 Guide: Neuromorphic Event-Based AI

Master BrainChip Akida 2.0 in 2026: explore neuromorphic event-based silicon, SNN and TENN architectures, sub-milliwatt edge AI, and on-chip learning.

brainchipakidaneuromorphicedge-aispiking-neural-networkstennhardware
Cadence Tensilica Guide: Neo NPU & Vision DSP Architecture

Master Cadence Tensilica in 2026: explore Neo NPU architecture, Vision Q8 1024-bit SIMD, NeuroWeave SDK, 80 TOPS compute, and custom TIE instruction extensions.

cadencetensilicaneo-npuvision-q8neuroweaveai-hardwareembedded-systemstutorial
Cornelis CN5000 Guide: 400G Omni-Path Fabric for AI

Master Cornelis CN5000 in 2026: explore 400G Omni-Path fabrics, SuperNIC hardware offload, Fine-Grained Adaptive Routing, OPX libfabric, and low-latency AI.

Cornelis NetworksCN5000Omni-PathSuperNICAI Scale-OutDistributed TrainingHigh Performance NetworkingAI Hardware
EdgeCortix SAKURA-II Guide: Dynamic Neural Accelerator AI

Master EdgeCortix SAKURA-II in 2026: explore the Dynamic Neural Accelerator (DNA), 60 TOPS sub-8W compute, reconfigurable dataflow, and MERA edge serving.

edgecortixsakura-iiedge-aidynamic-neural-acceleratorhardwareinferencegenerative-ai
Enflame DTU Guide: CloudBlazer AI Processor Architecture

Master Enflame DTU in 2026: explore CloudBlazer Yunsui T20, GCU-CARE 2.0 cores, TopsLink interconnect fabric, TopsRider software, and enterprise AI clusters.

enflamedtucloudblazergcu-careai-hardwarehbm2etopsridertutorial
Innatera T1 Guide: Neuromorphic Spiking Sensor AI Silicon

Master Innatera T1 in 2026: explore analog spiking neural processor architecture, sub-milliwatt sensor edge AI, RISC-V integration, and Talamo SDK serving.

innateraspiking-neural-processorneuromorphicedge-aisub-milliwattrisc-vhardware
Intel Lunar Lake NPU 4 Guide: Core Ultra AI Architecture

Master Intel Lunar Lake NPU 4 in 2026: explore 6 Neural Compute Engines, 48 TOPS compute, SHAVE DSPs, OpenVINO serving, and 136 GB/s DMA memory bandwidth.

intellunar-lakenpu4core-ultraopenvinoai-hardwarecopilot-plustutorial
Kandou Glasswing Guide: Chord Signaling AI Chiplet IP

Master Kandou Glasswing in 2026: explore CNRZ-5 chord signaling, 1 pJ/bit ultra-short reach SerDes, organic substrate chiplets, and AI cluster fabrics.

kandouglasswingchord-signalingchipletsserdesai-hardwareinterconnect
Lightelligence PACE: Photonic AI Matrix Computing Guide

Master Lightelligence PACE in 2026: explore 16,000+ photonic components, 64x64 optical MAC arrays, 3ns latency, 3D EIC-PIC packaging, and 100x GPU speedups.

lightelligencepacephotonic-computingoptical-aisilicon-photonicsai-hardwareomactutorial
MediaTek NPU 890 Guide: Dimensity 9400 Mobile AI Silicon

Master MediaTek NPU 890 in 2026: explore Dimensity 9400 3nm silicon, hardware speculative decoding, on-device LoRA training, and NeuroPilot SDK AI.

mediateknpu-890dimensity-9400mobile-aispeculative-decodingon-device-loraneuropilottutorial
NeuReality NR1 Guide: AI Inference Server-on-a-Chip

Master NeuReality NR1 in 2026: explore the 7nm AI-CPU NAPU architecture, host CPU offload, 10x inference efficiency, RoCE v2, and zero-GPU-idle serving.

neurealitynr1ai-hardwareinferenceserver-on-chipdatacenternpu
Renesas DRP-AI Guide: Reconfigurable Vision AI Silicon

Master Renesas DRP-AI and RZ/V2H in 2026: explore the dynamically reconfigurable processor, 80 TOPS AI-MAC engine, OpenCV offload, and TVM edge serving.

renesasdrp-airz-v2hreconfigurable-processoredge-airoboticshardware
Synopsys ARC NPX Guide: Scalable Embedded AI Processor IP

Master Synopsys ARC NPX in 2026: explore scalable 96 TOPS NPU clusters, native Transformer acceleration, MetaWare EV Toolkit, and automotive ASIL-D safety.

synopsysarc-npxnpu-ipmetaware-evedge-aiembedded-systemsautomotive-aitutorial
VeriSilicon Vivante VIP9000: Scalable Embedded NPU Guide

Master VeriSilicon Vivante VIP9000 in 2026: explore scalable NPU architecture, native Transformer acceleration, Acuity SDK, and 100M+ edge AI chips.

verisiliconvivantevip9000npu-ipedge-aiembedded-systemsacuity-sdktutorial
Astera Labs Leo Guide: CXL Smart Memory Controller AI

Master Astera Labs Leo in 2026: explore CXL 2.0 smart memory controllers, 2TB DDR5 expansion, memory pooling, COSMOS telemetry, and low-latency AI serving.

Astera LabsLeo CXLSmart Memory ControllerCompute Express LinkDDR5AI HardwareDatacenter InfrastructureLLM Serving
Ayar Labs TeraPHY Guide: Optical I/O Silicon for AI

Master Ayar Labs TeraPHY in 2026: explore UCIe optical I/O chiplets, SuperNova CW lasers, 8 Tbps bandwidth, sub-5pJ/bit energy, and scale-up AI clusters.

ayar-labsteraphysupernovaoptical-iosilicon-photonicsucieai-hardwaretutorial
Biren BR100 Guide: 77-Billion Transistor AI Chiplet

Master Biren BR100 in 2026: explore 77B-transistor chiplet architecture, 1,024 TFLOPS 16-bit compute, BLink 640 GB/s fabric, and BIRENSUPA software stack.

biren-technologybiren-br100chiplet-architecturegpgpudatacenter-siliconbirensupahbm2etutorial
Celestial AI Guide: Photonic Fabric & OMIB Scale-Up AI

Master Celestial AI Photonic Fabric in 2026: explore OMIB optical chiplets, 25x bandwidth density, disaggregated HBM memory pooling, and sub-100ns latency.

celestial-aiphotonic-fabricomibsilicon-photonicsoptical-interconnectdisaggregated-memorycxltutorial
Eliyan NuLink Guide: Interposer-Free AI Chiplet Silicon

Master Eliyan NuLink in 2026: explore interposer-free chiplet interconnects, organic substrate HBM4 scaling, Simultaneous Bidirectional signaling, and UMI.

EliyanNuLinkChipletsInterconnectHBM4Advanced PackagingAI AcceleratorsAI Hardware
EnCharge AI: Charge-Domain In-Memory Computing Guide

Master EnCharge AI in 2026: explore charge-domain in-memory computing (CD-IMC), 150+ TOPS/W efficiency, capacitor matrix physics, and client AI acceleration.

encharge-aiin-memory-computingcharge-domaincd-imcanalog-aienergy-efficiencyedge-aitutorial
Flex Logix InferX X1 Guide: Reconfigurable Edge AI Silicon

Master Flex Logix InferX X1 in 2026: explore EFLX reconfigurable interconnects, nnMAX systolic tiles, dynamic layer reconfiguration, and sub-8W edge AI.

Flex LogixInferX X1eFPGAEdge AIReconfigurable ComputingAI Accelerators
In-Session Agent Monitoring: aiFetchly Scheduled Loop Guide

Discover how power users automate recurring in-session tasks and process monitoring using aiFetchly Scheduled Loops (/loop <duration> <prompt>) in AI Chat V2.

power-usersscheduled-loopsai-chat-v2automationtutorial-walkthrough
MatX One Guide: Giant Super-Core LLM Silicon Architecture

Master MatX One in 2026: explore the giant super-core LLM chip, ex-Google TPU architecture, 10x FLOP efficiency, HBM memory scaling, and PyTorch serving.

matxmatx-onellm-architecturetpu-architectssuper-coreai-hardwarellm-inferencetutorial
MemryX MX3: Compute-at-Memory Edge AI Architecture Guide

Master MemryX MX3 in 2026: explore compute-at-memory architecture, dataflow streaming, 16-chip cascading, sub-watt efficiency, and zero-host-overhead serving.

memryxmx3compute-at-memorydataflow-architectureedge-aimulti-chip-cascadeembedded-systemstutorial
Moffett Antoum Guide: Deep-Sparse AI Processor Architecture

Master Moffett Antoum in 2026: explore deep dual sparsity, Sparse Processing Units (SPUs), 32x compute acceleration, and sub-100W inference serving.

moffett-aiantoumsparse-computingdual-sparsityai-hardwarespullm-inferencetutorial
Mythic AMP M1076 Guide: Analog Compute-in-Memory AI

Master Mythic AMP M1076 in 2026: explore analog compute-in-memory, embedded Flash arrays, Ohms law matrix multiplication, 25 TOPS, and sub-4W edge AI.

mythic-ampm1076compute-in-memoryanalog-aiembedded-flashedge-airisc-vtutorial
Normal Computing CN101: Thermodynamic AI Chip Guide

Master Normal Computing CN101 in 2026: explore thermodynamic linear algebra, stochastic matrix tiles, physics-based sampling, and sub-10W AI inference.

Normal ComputingCarnot CN101Thermodynamic ComputingStochastic ElectronicsDiffusion SamplingEdge AI
Positron AI Guide: Asimov Transformer Inference Silicon

Master Positron AI in 2026: explore Asimov silicon, 2.3TB LPDDR5x memory, TransWarp 2GHz systolic array, 16 Tbps interconnect, and Atlas inference servers.

Positron AIAsimovAtlasTransformer InferenceLPDDR5xTransWarpAI HardwareLLM Serving
Quadric Chimera Guide: General-Purpose NPU Architecture

Master Quadric Chimera in 2026: explore GPNPU architecture, unified C++ matrix-vector-scalar pipelines, Chimera LLVM, and up to 864 TOPS edge AI compute.

QuadricChimeraGPNPUEdge AIAI AcceleratorsLLVMComputer VisionAI Hardware
Rain AI Guide: Brain-Inspired Compute-in-Memory Silicon

Master Rain AI in 2026: explore brain-inspired neuromorphic computing, digital compute-in-memory (D-CIM), Andes RISC-V integration, and sub-10W AI inference.

Rain AICompute-in-MemoryNeuromorphic ComputingRISC-VD-CIMEdge AIAI Hardware
Recogni Scorpio Guide: 1000-TOPS Logarithmic AI Silicon

Master Recogni Scorpio in 2026: explore Logarithmic Number Systems (LNS), 1,000 TOPS compute, 16MB on-chip weight clustering, and sub-10ms 8MP vision AI.

RecogniScorpioLogarithmic Number SystemEdge AIAutonomous VehiclesComputer VisionAI Hardware
Rivos Guide: Server-Class RISC-V CPU & AI Accelerator SoC

Master Rivos in 2026: explore server-class RISC-V cores, integrated data-parallel AI acceleration, cache-coherent memory, and zero-copy PyTorch serving.

rivosrisc-vserver-socai-acceleratorcache-coherencyai-hardwarellm-inferencetutorial
Sapeon X330 Guide: Datacenter NPU for Fast LLM Inference

Master Sapeon X330 in 2026: explore the 7nm datacenter NPU, 734 TOPS INT8 compute, GDDR6 memory, sub-150W TDP efficiency, and enterprise LLM serving.

sapeonx330datacenter-npullm-inferencegddr6ai-hardwareenergy-efficiencytutorial
Semidynamics Guide: All-in-One RISC-V AI Tensor Silicon

Master Semidynamics in 2026: explore Atrevido RISC-V cores, Gazzillion 128-miss memory tolerance, integrated Tensor Units, and all-in-one AI acceleration.

SemidynamicsRISC-VTensor UnitVector UnitGazzillionEdge AIAI AcceleratorsAI Hardware
SiMa.ai MLSoC: Purpose-Built Edge AI Architecture Guide

Master SiMa.ai MLSoC in 2026: explore heterogeneous MLA architecture, 50 TOPS at 10 TOPS/W, sub-10W power, Palette SDK, and multi-modal edge AI deployment.

sima-aimlsocedge-aimachine-learning-acceleratorpalette-sdkembedded-systemscomputer-visiontutorial
SpiNNaker 2 Guide: 10-Million Core Neuromorphic AI

Master SpiNNaker 2 in 2026: explore 152 ARM cores per chip, 10M-core SpiNNcloud scaling, event-based neuromorphic processing, and hybrid SNN-ANN inference.

spinnaker-2neuromorphic-computingspiking-neural-networksevent-based-aiarm-architecturespinncloudbrain-simulationtutorial
Syntiant NDP120: Sub-Milliwatt Neural Decision AI Guide

Master Syntiant NDP120 in 2026: explore Syntiant Core 2 architecture, sub-milliwatt neural decision processing, always-on voice AI, and sensor fusion.

syntiantndp120neural-decision-processoredge-aialways-on-aisub-milliwattsensor-fusiontutorial
Tesla Dojo Guide: D1 Chip & Training Tile AI Supercomputing

Master Tesla Dojo in 2026: explore the D1 chip, 25-die InFO-SoW Training Tile, 9 PFLOPS compute, 1.32 PB/s SRAM bandwidth, and ExaPOD AI superclusters.

tesla-dojod1-chiptraining-tileinfo-sowai-supercomputingcomputer-visionfsdtutorial
Auditing Agent Code Changes: Inside aiFetchly Diff Viewer

Discover how developers audit autonomous agent code edits using aiFetchly File Operations Panel, turn-by-turn file tracking, and inline diff inspection.

developersai-chat-v2code-auditingfile-operationsfeature-deep-dive
AWS Trainium2 Guide: NeuronCore-v2 & UltraCluster AI

Master AWS Trainium2 in 2026: explore NeuronCore-v2, 96GB HBM3e, NeuronLink-v2 UltraServers, 100k-chip UltraClusters, and PyTorch NeuronX serving.

awstrainium2neuroncoreneuron-sdkai-hardwarellm-inferencedistributed-trainingtutorial
Axelera Metis AIPU: Digital In-Memory AI Computing Guide

Master Axelera Metis AIPU in 2026: explore digital in-memory computing (D-IMC), 214 TOPS throughput, 15 TOPS/W efficiency, RISC-V control, and Voyager SDK.

axelera-aimetis-aipudigital-in-memory-computingd-imcedge-airisc-vcomputer-visiontutorial
CXL 3.1 Guide: Disaggregated Memory Pooling for LLMs

Master CXL 3.1 in 2026: explore PCIe 6.0 PAM4 fabrics, multi-headed memory pooling, zero-copy KV cache disaggregation, and multi-terabyte LLM inference.

cxlcxl-3-1memory-poolingdisaggregated-memoryllm-inferencekv-cachepcie-6datacenter-architecture
d-Matrix Corsair Guide: Digital In-Memory AI Computing

Master d-Matrix Corsair in 2026: explore Digital In-Memory Computing (DIMC), 2GB SRAM at 150 TB/s, Block Floating Point, and Aviator LLM inference serving.

d-matrixcorsairin-memory-computingdimcai-hardwarellm-inferencesramtutorial
Esperanto ET-SoC-1: 1,000+ RISC-V AI Architecture Guide

Master Esperanto ET-SoC-1 in 2026: explore 1,088 low-power RISC-V cores, 160MB on-chip SRAM, 34 Minion Shires, near-threshold voltage, and sub-20W efficiency.

esperantoet-soc-1risc-vmany-coreai-inferencenear-threshold-computingdlrmtutorial
Extropic DTCA Guide: Thermodynamic Computing for AI

Master Extropic and thermodynamic computing in 2026: explore DTCA physics, CMOS thermal noise sampling, Boltzmann machines, and 10,000x energy efficiency.

extropicthermodynamic-computingdtcaenergy-based-modelsdiffusion-modelsprobabilistic-hardwarephysics-based-aitutorial
FuriosaAI RNGD Guide: Tensor Contraction Processor AI

Master FuriosaAI RNGD in 2026: explore the 150W Tensor Contraction Processor (TCP), 48GB LPDDR5X, 512 TFLOPS compute, and native vLLM LLM inference serving.

furiosaairngdtcptensor-contractionai-hardwarellm-inferencelpddr5xtutorial
Graphcore Bow IPU Guide: 3D Wafer-on-Wafer AI Architecture

Master Graphcore Bow IPU in 2026: explore 3D Wafer-on-Wafer silicon, 1,472 MIMD cores, 900MB SRAM at 65 TB/s, Poplar SDK, and BSP graph intelligence.

graphcorebow-ipuwafer-on-wafermimdpoplar-sdkai-hardwaresparse-aitutorial
Hailo-10 Guide: Structure-Defined Dataflow for Edge AI

Master Hailo-10 in 2026: explore structure-defined dataflow architecture, 40 TOPS INT4 compute, sub-5W power, on-device LLMs, and Hailo Dataflow Compiler.

hailohailo-10edge-aidataflow-architecturegenerative-aion-device-llmembedded-systemstutorial
IBM NorthPole Guide: Brain-Inspired In-Memory AI Silicon

Master IBM NorthPole in 2026: explore Science-backed 256-core architecture, 224MB on-chip SRAM, 4 NoCs, and eliminating off-chip DRAM bottlenecks.

ibm-northpolein-memory-computingneuromorphicai-hardwaresramedge-aienergy-efficiencytutorial
Intel Gaudi 3 Guide: Architecture, RoCEv2 & vLLM Serving

Master Intel Gaudi 3 in 2026: explore 64 TPCs, 8 MMEs, 128GB HBM2e, integrated 24x 200GbE RoCEv2 Ethernet networking, and vLLM inference on SynapseAI.

intelgaudi-3habanasynapseaivllmai-hardwarellm-inferencetutorial
Intel Loihi 2 Guide: Neuromorphic Spike-Based AI Silicon

Master Intel Loihi 2 in 2026: explore Intel 4 EUV silicon, 1M programmable neurons, asynchronous NoCs, graded spikes, and Lava neuromorphic software.

intel-loihi-2neuromorphicspiking-neural-networksai-hardwareasynchronous-computinglava-frameworkedge-aitutorial
Kneron KL730 Guide: Reconfigurable NPU for Edge GPT

Master Kneron KL730 in 2026: explore reconfigurable NPU architecture, sub-1W edge GPT inference, transformer acceleration, and Kneo privacy mesh networking.

kneronkl730reconfigurable-npuedge-aiedge-gptautomotive-aiembedded-systemstutorial
Lightmatter Passage Guide: Photonic AI Interconnect Silicon

Master Lightmatter Passage in 2026: explore 3D optical interposers, 114 Tbps bandwidth, Mach-Zehnder interferometers, and breaking the AI copper wall.

lightmatterpassagesilicon-photonicsoptical-computingai-hardwareinterconnectualinktutorial
Meta MTIA Guide: Modular Scale-Up Custom AI Silicon

Master Meta MTIA in 2026: explore modular chiplet architecture, 72-chip scale-up racks, HCCL collectives, PyTorch 2.x, and vLLM inference acceleration.

meta-mtiacustom-siliconai-hardwarepytorchvllmscale-up-networkingchipletstutorial
NVIDIA GB200 NVL72 Guide: Rack-Scale Liquid-Cooled AI

Master NVIDIA GB200 NVL72 in 2026: explore 72 Blackwell GPUs, 130 TB/s NVLink 5 copper spine, 1.4 ExaFLOPS FP4 compute, and 120kW liquid cooling.

nvidiagb200nvl72blackwellnvlink-5ai-hardwarellm-inferencetutorial
Qualcomm Cloud AI 100 Ultra: Datacenter Inference Guide

Master Qualcomm Cloud AI 100 Ultra in 2026: explore quad-SoC silicon, 64 AI cores, 576MB SRAM, 548 GB/s bandwidth, vLLM serving, and 150W low-TDP efficiency.

qualcommcloud-ai-100-ultraai-inferencedatacenter-siliconvllmspeculative-decodingmicroscalingtutorial
Tenstorrent Guide: Blackhole RISC-V Tensix AI Architecture

Master Tenstorrent Blackhole in 2026: explore Tensix cores, 16 SiFive RISC-V CPUs, 180MB SRAM, 4x 800G optical networking, and TT-Metalium kernel development.

tenstorrentblackholerisc-vtensixtt-metaliumai-hardwarellm-inferencetutorial
Untether AI speedAI Guide: At-Memory Spatial AI Architecture

Master Untether AI speedAI in 2026: explore at-memory spatial computing, 1,400+ RISC-V cores, 238MB SRAM at 1 PB/s, 30 TFLOPS/W, and imAIgine SDK.

untether-aispeedaiat-memory-computingspatial-architecturerisc-vai-hardwareimaigine-sdktutorial
AnimateDiff-Lightning Guide: Fast Video AI Model

Master AnimateDiff-Lightning in 2026: explore cross-model distillation, few-step video generation, flow-conditional discriminators, and PyTorch code.

animatediff-lightningvideo-generationdiffusion-distillationcomputer-visiongenerative-aicross-modeltutorial
Apple Intelligence AFM Guide: On-Device Foundation AI

Master Apple Intelligence AFM in 2026: explore the 3B on-device architecture, dynamic LoRA adapters, Talaria quantization, and Private Cloud AI.

AI ArchitectureApple IntelligenceAFMOn-Device AILoRA AdaptersNeural Engine
Cerebras CS-3 Guide: Wafer-Scale Engine AI Hardware

Master Cerebras CS-3 in 2026: explore the 4-trillion transistor WSE-3, 21 PB/s SRAM memory bandwidth, and 2,000+ token/s real-time AI inference.

cerebras-cs3wafer-scale-engineai-hardwarellm-inferencememory-bandwidthsemiconductorstutorial
EchoMimicV2 Guide: Semi-Body Human Animation AI

Master EchoMimicV2 in 2026: explore Audio-Pose Dynamic Harmonization, Head Partial Attention, Phase-specific Denoising Loss, and half-body video AI.

echomimic-v2human-animationhalf-bodydiffusion-modelsaudio-drivencomputer-visiontutorial
Etched Sohu Guide: Hardwired Transformer ASIC AI

Master the Etched Sohu in 2026: explore the 4nm hardwired Transformer ASIC, 144GB HBM3e, 500k tok/s Llama 70B throughput, and specialized AI hardware.

AI HardwareTransformer ASICEtched SohuLLM InferenceLow Voltage InferenceHardware Acceleration
Falcon Mamba 7B Guide: Pure Attention-Free AI Modeling

Master Falcon Mamba 7B in 2026: explore the pure attention-free 7B foundation model, zero KV cache, constant throughput, and Mamba state space AI.

AI ArchitectureFalcon MambaMamba SSMAttention-Free LLMsState Space ModelsKV Cache Optimization
FastVideo Guide: Sliding Tile Attention AI Model

Master FastVideo in 2026: explore Sliding Tile Attention, 10.4x faster DiT attention, 3.5x end-to-end video speedup, and ThunderKittens kernels.

fastvideosliding-tile-attentiondiffusion-transformersvideo-generationgpu-accelerationthunderkittenstutorial
Groq LPU Guide: Deterministic AI Inference Hardware

Master Groq's LPU in 2026: explore the Tensor Streaming Processor, 80 TB/s on-chip SRAM, compile-time determinism, and 500+ token/s real-time AI.

groq-lputensor-streaming-processorai-hardwarellm-inferencesram-architecturedeterministic-computingtutorial
Hallo2 Guide: 4K Long-Duration Audio-Driven Avatar AI

Master Hallo2 in 2026: explore 4K portrait diffusion, patch-drop augmentation, codebook temporal alignment, AdaLN text control, and hour-long video AI.

hallo2audio-driven-avatarportrait-animation4k-video-generationdiffusion-modelscomputer-visiontutorial
Hunyuan3D 2.0 Guide: High-Resolution 3D Asset AI

Master Tencent Hunyuan3D 2.0 in 2026: explore the two-stage Shape and Paint diffusion architecture, PBR texture synthesis, and open-source 3D AI.

AI GenerationHunyuan3D3D Asset GenerationDiffusion ModelsTexture SynthesisComputer Vision
Jamba 1.5 Guide: Hybrid SSM-Transformer MoE AI

Master AI21 Jamba 1.5 in 2026: explore the hybrid Mamba-Transformer architecture, 256K context, 10x KV cache reduction, and ExpertsInt8 MoE AI.

AI ArchitectureJamba 1.5Mamba SSMMixture-of-ExpertsLong-Context LLMsKV Cache Optimization
Kling-MotionControl Guide: Video DiT Animation AI

Master Kling-MotionControl in 2026: explore the 3D DiT video architecture, multi-granularity motion transfer, Subject Library, and 10x inference AI.

AI GenerationKling-MotionControlVideo DiTCharacter AnimationMotion TransferDiffusion Transformers
Kwai-Kolors Guide: Photorealistic Bilingual Diffusion AI

Master Kwai-Kolors in 2026: explore the GLM-powered text-to-image architecture, bilingual typography rendering, human photorealism, and diffusion AI.

AI GenerationKwai-KolorsDiffusion ModelsText-to-ImageBilingual TypographyComputer Vision
Llama 3.2 Vision Guide: Cross-Attention Multimodal AI

Master Llama 3.2 Vision in 2026: explore Meta's 11B and 90B models, cross-attention adapters, frozen text backbones, and 128K multimodal AI.

llama-3-2-visionmultimodal-llmcross-attentionopen-source-aicomputer-visiondocument-aitutorial
Loopy Guide: Template-Free Audio-Driven Avatar AI

Master ByteDance's Loopy in 2026: explore template-free portrait diffusion, inter/intra-clip temporal layers, Audio-to-Latents, and 124-frame motion AI.

loopyaudio-driven-avatarportrait-diffusionbytedancevideo-generationtemporal-modelingtutorial
MatMul-Free LM Guide: Scalable Ternary AI Modeling

Master MatMul-free LMs in 2026: explore ternary weights, linear recurrent units, zero MAC operations, and 10x energy-efficient AI inference.

AI ArchitectureMatMul-Free LMTernary WeightsBitLinearGreen AIHardware Acceleration
Moshi Guide: Real-Time Full-Duplex Speech-Text AI

Master Moshi in 2026: explore Kyutai's full-duplex speech-text foundation model, Mimi neural audio codec, Inner Monologue, and sub-200ms voice AI.

moshivoice-aispeech-to-speechfull-duplexneural-audio-codecmultimodal-llmtutorial
OpenVLA Guide: Open-Source Vision-Language-Action AI

Master OpenVLA in 2026: explore the 7B robot foundation model, DINOv2-SigLIP visual fusion, OpenX pre-training, LoRA adaptation, and 4-bit edge AI.

openvlaroboticsvision-language-actionopen-x-embodimentlora-roboticsedge-aitutorial
PiZero Guide: Flow Matching VLA Robot Foundation AI

Master Physical Intelligence's PiZero in 2026: explore the 3.3B flow matching VLA, PaliGemma backbone, action expert, and 50Hz dexterous robotics AI.

pi0roboticsvision-language-actionflow-matchingdiffusion-policyfoundation-modelstutorial
Qwen2.5-Coder Guide: Open-Source Code Intelligence AI

Master Qwen2.5-Coder in 2026: explore Alibaba's 5.5T token code LLM, 70:20:10 data mixture, repo-level FIM, 128K YaRN context, and 32B code AI.

qwen2-5-codercode-llmopen-source-aisoftware-engineeringfimyarn-contexttutorial
SambaNova SN40L Guide: Reconfigurable Dataflow AI

Master SambaNova SN40L in 2026: explore the Reconfigurable Dataflow Unit, 3-tier memory with 1.5TB DDR5, 1,040 PCUs, and agentic MoE inference AI.

AI HardwareDataflow ArchitectureSambaNova SN40LMoE ServingLLM InferencePrompt Caching
SmolLM2 Guide: Data-Centric Small Language Model AI

Master Hugging Face's SmolLM2 in 2026: explore 11T token overtraining, FineMath, Stack-Edu, the Warmup-Stable-Decay schedule, and 1.7B on-device edge AI.

smollm2small-language-modelsdata-centric-aihugging-faceon-device-aifinemathtutorial
Taalas Guide: Direct-to-Silicon Hardcore AI Models

Master Taalas in 2026: explore direct-to-silicon hardwired models, zero-memory weight wiring, 17k tokens/sec Llama inference, and 1000x green AI.

AI HardwareTaalasHardcore ModelsDirect-to-SiliconLLM InferenceZero Memory Bottleneck
V-Express Guide: Audio-Driven Portrait Video AI

Master V-Express in 2026: explore conditional dropout, V-Kps visual keypoints, progressive multi-stage training, and audio-driven portrait video AI.

v-expressportrait-animationvideo-generationdiffusion-modelstalking-headcomputer-visiontutorial
Zyphra Zamba2 Guide: Hybrid SSM-Shared Attention AI

Master Zyphra Zamba2 in 2026: explore the hybrid Mamba2 backbone, shared attention with layer-specific LoRA, 3x faster throughput, and lean KV cache AI.

AI ArchitectureZyphra Zamba2Mamba2Shared AttentionHybrid ModelsKV Cache Optimization
Agent S2 Guide: Compositional Computer-Use AI Agents

Master Agent S2 in 2026: explore Mixture of Grounding, proactive hierarchical planning, generalist-specialist composition, and topping Claude on OSWorld.

agent-s2computer-usegui-agentsmixture-of-groundinghierarchical-planningosworldtutorial
ConsisID Guide: Identity-Preserving Video AI Model

Master ConsisID in 2026: explore frequency decomposition, low/high-frequency facial extractors, CogVideoX DiT scaling, and tuning-free video AI.

consisidtext-to-videodiffusion-transformeridentity-preservationcomputer-visiongenerative-aitutorial
CrystalMem Guide: Elastic Memory for Self-Evolving AI Agents

Master CrystalMem in 2026: explore knowledge crystallization, 4-state fidelity ladders, verified recrystallization, and eliminating agent memory hysteresis.

crystalmemai-agentsagent-memoryself-evolving-llmselastic-memoryknowledge-crystallizationtutorial
DepthCrafter Guide: Consistent Video Depth AI Model

Master DepthCrafter in 2026: explore video diffusion for depth estimation, 3-stage training, 110-frame coherence, and long-video PyTorch pipelines.

depthcraftervideo-depth-estimationdiffusion-modelscomputer-visionsvdgenerative-aitutorial
DSpark Guide: Confidence Speculative Decoding in LLMs

Master DSpark in 2026: explore semi-autoregressive drafting, Markov logit-bias heads, confidence-scheduled verification, and 85% faster LLM inference.

dsparkspeculative-decodingdeepseekvllmsglanginference-optimizationtutorial
Fast-DetectGPT Guide: Zero-Shot AI Text Detection

Master Fast-DetectGPT in 2026: explore conditional probability curvature, zero-shot AI text detection, 340x acceleration over DetectGPT, and PyTorch code.

fast-detectgptai-detectionzero-shotllm-securitysynthetic-datamachine-learningnlptutorial
Ferret-UI 2 Guide: Apple Universal Vision UI Agent AI

Master Apple Ferret-UI 2 in 2026: explore universal UI grounding, any-resolution multi-grid visual encoding, cross-platform agents, and on-device PyTorch.

ferret-ui-2apple-aigui-agentsvision-language-modelscomputer-usevisual-groundingmultimodaltutorial
Fission-GRPO Guide: Robust Error Recovery in AI Tool Use

Master Fission-GRPO in 2026: explore on-policy error fission, learned error simulators, multi-turn tool recovery, and stopping hallucinated agent retry loops.

fission-grpotool-usereinforcement-learninggrpoai-agentserror-recoveryqwentutorial
FlashMask Guide: Column-Wise Sparse Attention Mask AI

Master FlashMask in 2026: explore column-wise sparse mask representations, linear O(N) memory scaling, SFT/DPO acceleration, and 500K+ context LLM training.

flashmaskflashattentionattention-maskssparse-attentionllm-trainingdposfttutorial
Google vs Yandex: Multi-Engine Search Arbitrage Guide

Discover how data analysts overcome single-engine SEO bias by querying Google and Yandex concurrently in aiFetchly to discover 40% more B2B domains.

data-analystsmulti-engine-searchgoogle-vs-yandexmarket-intelligenceproblem-solution
InfLLM Guide: Training-Free Long-Context Memory for LLMs

Master InfLLM in 2026: explore training-free long-context scaling, chunk-level context memory, attention sinks, and dynamic KV offloading for 1M+ token LLMs.

infllmlong-contextkv-cacheattention-sinksllm-inferenceoffloadingcontext-memorytutorial
InternVideo2 Guide: 6B Video Foundation AI Model

Master InternVideo2 in 2026: explore spatiotemporal ViT scaling, progressive multi-modal pre-training, video-audio-text synergy, and PyTorch inference.

internvideo2video-understandingfoundation-modelsmultimodalcomputer-visionspatiotemporal-aitutorial
Kolors Guide: Bilingual Photorealistic Diffusion AI

Master Kuaishou Kolors in 2026: explore ChatGLM3-powered text-to-image diffusion, bilingual text rendering, SDXL UNet scaling, and Diffusers code.

kolorstext-to-imagediffusion-modelschatglm3sdxlcomputer-visiongenerative-aitutorial
LivePortrait Guide: Real-Time Portrait Animation AI

Master LivePortrait in 2026: explore stitching and retargeting modules, implicit keypoint animation, 12.8ms inference, and open-source PyTorch pipelines.

liveportraitcomputer-visionportrait-animationdiffusion-modelsface-reenactmentgenerative-aitutorial
LLaVA-OneVision Guide: Unified Multi-Modal AI Model

Master LLaVA-OneVision in 2026: explore AnyRes visual task transfer across single-image, multi-image, and video, Qwen2 scaling, and PyTorch inference.

llava-onevisionmultimodalvision-language-modelsvideo-understandinganyresqwen2computer-visiontutorial
LongVILA Guide: 2M Context Multi-Modal AI Model

Master NVIDIA LongVILA in 2026: explore Multi-Modal Sequence Parallelism, 2M context scaling, hour-long video reasoning, and distributed PyTorch.

Multimodal AIComputer VisionDistributed SystemsLong ContextVideo UnderstandingPyTorch
Lotus Guide: Fast Randomized Low-Rank LLM Training

Master Lotus in 2026: explore randomized low-rank gradient projection, adaptive subspace switching, cutting optimizer memory by 40%, and faster training.

lotusllm-trainingoptimizerslow-rank-gradientsgalorememory-efficienttutorial
MambaVision Guide: Hybrid Mamba-Transformer AI Backbone

Master NVIDIA MambaVision in 2026: explore hybrid Mamba-Transformer vision backbones, linear SSM visual mixers, ImageNet SOTA Pareto trade-offs, and PyTorch.

mambavisionvision-transformerstate-space-modelsmambacomputer-visiondeep-learningimagenettutorial
Mobile-Agent-v2 Guide: Multi-Agent Phone Automation AI

Master Mobile-Agent-v2 in 2026: explore multi-agent phone automation, Planning-Decision-Reflection loops, visual perception, and robust mobile device control.

mobile-agent-v2mobile-agentsphone-automationgui-agentsmultimodalalibabacomputer-visiontutorial
OmniHuman-1 Guide: Scaling Human Animation AI Models

Master ByteDance OmniHuman-1 in 2026: explore omni-conditions DiT scaling, parameter-free 3D RoPE appearance, CFG annealing, and full-body human video AI.

omnihuman-1human-animationdiffusion-transformerditcomputer-visionmultimodaltutorial
RAG-Fusion Guide: Multi-Query Search & RRF in Modern AI

Master RAG-Fusion in 2026: explore multi-query prompt expansion, Reciprocal Rank Fusion (RRF) algorithms, rank aggregation, and zero-cross-encoder RAG search.

rag-fusionragreciprocal-rank-fusioninformation-retrievalvector-searchhybrid-searchtutorial
SAGA Guide: Workflow-Atomic GPU Scheduling for AI Agents

Master SAGA in 2026: explore workflow-atomic GPU scheduling, Agent Execution Graphs, tool-call TTLs, session affinity, and 1.64x faster compound AI serving.

sagagpu-schedulingai-agentscompound-aikv-cachevllmllm-servingtutorial
StreamDiffusion Guide: Real-Time Interactive AI Models

Master StreamDiffusion in 2026: explore stream batching, Residual CFG, pipelined VAE queues, 100+ FPS generation, and real-time PyTorch pipelines.

streamdiffusiondiffusion-modelsreal-time-aicomputer-visiongenerative-aipytorchtutorial
TokenFormer Guide: Tokenized Model Parameter AI

Master TokenFormer in 2026: explore tokenized model parameters, token-parameter attention, all-attention architectures, and progressive LLM scaling.

tokenformertransformer-architectureparameter-scalingdeep-learningllm-trainingattention-mechanismsiclr-2025tutorial
UI-TARS Guide: Native End-to-End Vision GUI Agent

Master UI-TARS in 2026: explore native vision GUI agents, unified action spaces, System-2 deliberate reasoning, and Agent DPO beating Claude Computer Use.

ui-tarsgui-agentscomputer-usevision-language-modelssystem-2-reasoningagent-dpotutorial
VILA Guide: NVIDIA Pre-Trained Visual Language AI

Master NVIDIA VILA in 2026: explore interleaved image-text pre-training, LLM weight adaptation, multi-image in-context learning, and AWQ serving.

vilanvidia-researchvision-language-modelsmultimodalpre-trainingawqcomputer-visiontutorial
Agent-Gym Guide: Training Autonomous LLM Agents via RL

Master Agent-Gym in 2026: explore interactive environment suites, AgentEvol reinforcement learning, trajectory rollouts, and multi-turn LLM agent training.

agent-gymai-agentsreinforcement-learningagent-evolinteractive-environmentsllm-trainingweb-agentstutorial
Agent Hospital Guide: Autonomous Multi-Agent Medical AI

Master Agent Hospital in 2026: explore multi-agent clinical simulation, MedQA self-evolution, disease progression modeling, and autonomous medical AI agents.

agent-hospitalai-agentsmulti-agent-systemsmedical-aisimulationmedqaself-evolutiontutorial
APOLLO Guide: SGD-Level Memory with AdamW LLM Scaling

Master APOLLO in 2026: explore SGD-like memory footprint, AdamW-level performance, random projection gradient scaling, and 3x faster LLM training.

apollollm-trainingoptimizersmemory-efficientadamwsgdtutorial
ArmoRM Guide: Multi-Objective Reward Model for AI RLHF

Master ArmoRM in 2026: explore multi-objective reward modeling, MoE dynamic gating, verbosity decorrelation, and 89.0 RewardBench scores with an 8B model.

armormrlhfreward-modelsmixture-of-expertsrewardbenchllm-alignmentllama-3tutorial
AutoCodeRover Guide: AST-Driven Autonomous Code Repair AI

Master AutoCodeRover in 2026: explore AST-based code search, spectrum-based fault localization, SWE-bench repair, and autonomous software engineering agents.

autocoderoverai-agentssoftware-engineeringswe-benchcode-repairast-searchautomated-debuggingtutorial
BitDecoding Guide: Tensor Core Speedup for Low-Bit KV Cache

Master BitDecoding in 2026: explore cooperative Tensor-CUDA cores, 4-bit KV cache layouts, Hopper wgmma, Blackwell NVFP4, and 7.5x faster LLM decoding.

bitdecodingkv-cachetensor-coreslong-contextllm-servingquantizationhoppertutorial
Cerebras CS-3 Guide: Wafer-Scale Engine 3 for Fast AI

Master Cerebras CS-3 in 2026: explore Wafer-Scale Engine 3 (WSE-3), 44GB on-chip SRAM, 21 PB/s bandwidth, and 2,000+ token/s LLM serving with sub-1ms latency.

cerebraswse-3cs-3wafer-scale-enginellm-servinghardware-architecturesramtutorial
GLM-Edge Guide: On-Device LLM & VLM Model Architecture

Master GLM-Edge in 2026: explore Zhipu AI's 1.5B/4B text and 2B/5B vision models, Qualcomm NPU optimization, INT4 OpenVINO, and 100+ tok/s edge AI.

glm-edgeedge-aion-device-llmvlmzhipu-aiqualcomm-npuopenvinotutorial
Groq LPU Guide: Deterministic Tensor Streaming LLM Serving

Master Groq LPU in 2026: explore Tensor Streaming Processors (TSPs), on-chip SRAM, compiler determinism, and 1,000+ token/s LLM serving with sub-5ms latency.

groqlputensor-streaming-processorllm-servinghardware-architecturesraminference-optimizationtutorial
Hunyuan3D 2.0 Guide: High-Resolution 3D Asset AI Model

Master Hunyuan3D 2.0 in 2026: explore Hunyuan3D-DiT flow matching, ShapeVAE meshes, Hunyuan3D-Paint multi-view textures, and studio-grade 3D asset generation.

hunyuan3d3d-generationdiffusion-transformerflow-matchingditcomputer-visiongenerative-aitutorial
LISA Guide: Layerwise Importance Sampling for LLMs

Master LISA in 2026: explore layerwise importance sampling, cutting fine-tuning memory by 65%, outperforming LoRA by 36%, and scaling full-parameter LLMs.

lisallm-fine-tuningloramemory-efficientimportance-samplingneuripstutorial
Llama Guard 3 Guide: Real-Time AI Safety & Agent Security

Master Llama Guard 3 in 2026: explore MLCommons safety taxonomy, Prompt Guard injection defense, 1B/8B classifiers, and real-time agent guardrails.

llama-guardai-safetyprompt-injectioncontent-moderationagent-securityllm-guardrailsmeta-aitutorial
LMDeploy Guide: Fast Mixed-Precision LLM Inference Engine

Master LMDeploy in 2026: explore TurboMind mixed-precision GEMM, hardware-aware weight packing, adaptive head alignment, and 156% higher serving throughput.

lmdeployturbomindllm-servingmixed-precisionquantizationawqinference-optimizationtutorial
LongCite Guide: Fine-Grained In-Text Citations for LLMs

Master LongCite in 2026: explore fine-grained in-text citations, LongQuote data synthesis, LongBench-Cite, and verified provenance across 128K context windows.

longcitecitationslong-contextraghallucination-mitigationai-agentstsinghuatutorial
LoRA-GA Guide: Gradient Approximation for Faster LLMs

Master LoRA-GA in 2026: explore gradient approximation initialization, matching full fine-tuning convergence, and boosting LLM reasoning by up to 11%.

lora-galorapeftllm-fine-tuninggradient-approximationtsinghuatutorial
LoRA-Pro Guide: Gradient Projection for Low-Rank LLMs

Master LoRA-Pro in 2026: explore optimal gradient projection, eliminating low-rank optimization distortion, and matching full fine-tuning performance.

lora-prolorapeftllm-fine-tuninggradient-projectioniclr-2025tutorial
Marco-o1 Guide: MCTS Reasoning Model for Open-Ended AI

Master Marco-o1 in 2026: explore Alibaba's open reasoning LLM combining MCTS tree search, mini-step action granularity, and self-reflective thinking loops.

marco-o1reasoning-modelsmctsllm-reasoningqwen2chain-of-thoughttest-time-computetutorial
Mini-Omni2 Guide: Real-Time Audio-Visual Voice AI Model

Master Mini-Omni2 in 2026: explore simultaneous video and speech understanding, delayed parallel decoding, SNAC tokens, and sub-300ms multimodal voice AI.

mini-omni2multimodalvoice-aispeech-to-speechvision-language-modelssnacreal-time-aitutorial
Q-Sparse Guide: Fully Sparsely-Activated LLMs in 2026

Master Q-Sparse in 2026: explore top-K activation sparsity, straight-through estimator training, Block Q-Sparse, and 4x faster sparse LLM inference.

q-sparseactivation-sparsityllm-inferencebitnetsparse-computingmicrosoft-researchtutorial
RWKV-7 Guide: Goose Architecture & Dynamic State Evolution

Master RWKV-7 Goose in 2026: explore dynamic state evolution, generalized delta rules, vector-valued gating, in-context learning rates, and O(1) inference.

rwkv-7linear-attentionrecurrent-neural-networksllm-architecturedynamic-state-evolutionconstant-memorytutorial
ScatterMoE Guide: Fast Fused Kernels for Sparse MoE LLMs

Master ScatterMoE in 2026: explore fused Triton kernels, ParallelLinear primitives, zero-padding sparse routing, and memory-efficient MoE LLM scaling.

scattermoemoetritongpu-kernelsllm-trainingsparse-routingtutorial
Self-Taught Evaluator Guide: LLM-as-a-Judge Alignment AI

Master the Self-Taught Evaluator in 2026: explore Meta FAIR synthetic evaluation training, RewardBench scoring, iterative bootstrapping, and human-free judges.

self-taught-evaluatorllm-as-a-judgerewardbenchsynthetic-datallm-alignmentmeta-fairevaluatorstutorial
Zamba2 Guide: Hybrid Mamba2-Transformer AI Architecture

Master Zamba2 in 2026: explore Zyphra's hybrid Mamba2-Transformer models, 6x KV cache reduction, shared attention LoRAs, and sub-10B state-of-the-art AI.

zamba2mamba2state-space-modelshybrid-architecturetransformerkv-cacheslmtutorial
Agent Q Guide: Autonomous Web Agents via MCTS and DPO

Master Agent Q in 2026: explore MultiOn & Stanford's framework combining guided MCTS, self-critique, and off-policy DPO for autonomous web agents.

agent-qautonomous-agentsweb-agentsmctsdpoweb-scrapingbrowser-automationtutorial
Agent Q Guide: MCTS & Self-Critique for Web AI Agents

Master Agent Q in 2026: explore how Monte Carlo Tree Search, sub-goal self-critique, and node-level DPO boost autonomous web agent success from 18% to 95%.

agent-qai-agentsmctsweb-agentsreinforcement-learningdpoweb-scrapingtutorial
BitBLAS Guide: High-Performance Quantized LLM Kernels

Master Microsoft's BitBLAS in 2026: explore mixed-precision GPU kernel generation, hardware swizzling, fast sub-8-bit dequantization, and 4.2x GEMM speedup.

BitBLASQuantizationGPU KernelsTensor CoresLLM InferenceMicrosoft Research
CoT-Decoding Guide: Prompt-Free LLM Reasoning via Top-k

Master CoT-Decoding in 2026: explore Google DeepMind’s prompt-free reasoning, alternative top-k token branching, decoding confidence margins, and math LLMs.

cot-decodingchain-of-thoughtdecoding-strategiesreasoning-modelsgoogle-deepmindprompt-engineeringinference-optimizationtutorial
DeepScaleR Guide: Surpassing o1 with a 1.5B Model via RL

Master DeepScaleR in 2026: explore UC Berkeley’s iterative context lengthening, scaling RL to 16k tokens, and surpassing o1-preview with 1.5B parameters.

deepscalerreinforcement-learningreasoning-modelsgrpoiterative-context-lengtheningsmall-language-modelsqwen2-5tutorial
DejaVu Guide: Contextual Sparsity for LLM Inference

Master DejaVu in 2026: explore contextual sparsity, asynchronous lookahead predictors, hardware-efficient sparse loading, and 2x faster LLM token decoding.

DejaVuContextual SparsityLLM InferenceICML 2023Lookahead PredictorsGPU Acceleration
Demystifying Long CoT: Mechanics of LLM Reasoning via RL

Master long CoT reasoning in 2026: explore CMU’s empirical study on SFT vs. RL, reward shaping, web data filtering, and latent error correction in LLMs.

long-cotchain-of-thoughtreinforcement-learningreasoning-modelscmudeepseek-r1data-curationtutorial
Exo Guide: Distributed AI Inference on Everyday Devices

Master Exo in 2026: explore P2P device clustering, dynamic ring pipeline parallelism, MLX unified memory, and running 70B models across consumer hardware.

exodistributed-inferencep2p-aiedge-aimlxapple-siliconpipeline-parallelismtutorial
Fiddler Guide: CPU-GPU Orchestration for Fast MoE AI

Master Fiddler in 2026: explore ICLR 2025 CPU-GPU MoE orchestration, eliminating PCIe transfer stalls, expert caching, and running Mixtral on consumer GPUs.

fiddlermoecpu-gpu-orchestrationmixtralllm-inferenceheterogeneous-computingiclr-2025tutorial
LIMO Guide: Unlocking LLM Reasoning with 817 Samples

Master LIMO in 2026: explore the Less-Is-More reasoning hypothesis, cognitive templates, curated SFT data recipes, and scaling mathematical AI models.

limoreasoning-modelsdata-efficient-sftcognitive-templatesqwen2-5math-reasoningaime24tutorial
Logic-RL Guide: Eliciting Reasoning with Rule-Based RL

Master Logic-RL in 2026: explore rule-based reinforcement learning, synthetic logic puzzles, anti-shortcut format rewards, and emergent reasoning.

logic-rlreinforcement-learningreasoning-modelsgrpor1-zerologic-puzzlesdeep-learningtutorial
PowerInfer-2: Fast 47B LLM Inference on Smartphones

Master PowerInfer-2 in 2026: explore neuron-cluster decomposition, heterogeneous NPU-CPU execution, flash-to-RAM pipelining, and 11.68 tok/s on mobile devices.

powerinfer-2edge-aimobile-llmnpuneuron-clustersactivation-sparsityllm-inferencetutorial
Punica Guide: Multi-Tenant LoRA Serving with SGMV

Master Punica in 2026: explore MLSys 2024 multi-tenant LoRA serving, Segmented Gather Matrix-Vector (SGMV) kernels, and 12x higher throughput on single GPUs.

PunicaLoRA ServingMulti-TenantSGMVMLSys 2024GPU Optimization
rStar-Math: Small LLMs Surpass OpenAI o1 in Math via MCTS

Master rStar-Math in 2026: explore self-evolved deep thinking, MCTS test-time search, process preference models (PPM), and scaling small math LLMs.

rstar-mathmctssmall-language-modelsreasoning-modelsprocess-reward-modelscode-augmented-cotmath-reasoningtutorial
Search-R1: Training LLMs to Reason and Search via RL

Master Search-R1 in 2026: explore interleaved reasoning and search, loss masking on retrieved tokens, and GRPO training to eliminate LLM hallucinations.

search-r1reinforcement-learningreasoning-modelsgrporagweb-searchllm-agentstutorial
SimpleRL-Zoo Guide: Taming Zero RL for Open Base LLMs

Master SimpleRL-Zoo in 2026: explore HKUST’s recipe for zero reinforcement learning, taming 10 open base models, and unlocking emergent reasoning.

simplerl-zoozero-reinforcement-learningr1-zerogrpollama-3mistralqwen2-5tutorial
Sky-T1 Guide: Training an o1-Level Reasoner for $450

Master Sky-T1 in 2026: explore UC Berkeley’s open-source recipe, 17k curated reasoning traces, DeepSpeed ZeRO-3 SFT, and cost-efficient o1-class LLMs.

sky-t1reasoning-modelso1-reproductionopen-source-aiqwen2-5deep-learningmath-codingtutorial
SPPO Guide: Self-Play Preference Optimization for LLMs

Master SPPO in 2026: explore Self-Play Preference Optimization, two-player games, Nash equilibrium, and aligning LLMs without frozen reference models.

sppoself-playllm-alignmentreinforcement-learningnash-equilibriumgame-theorydpotutorial
Striped Attention Guide: Faster Causal Ring Attention

Master Striped Attention in 2026: explore round-robin token striping, eliminating causal idle bubbles in Ring Attention, and 2x faster long-context scaling.

striped-attentionring-attentioncontext-parallelismlong-contexttri-daodistributed-trainingflashattentiontutorial
SVD-LLM Guide: Truncation-Aware SVD for LLM Compression

Master SVD-LLM in 2026: explore ICLR 2025 truncation-aware data whitening, layer-wise parameter updates, 40% model compression, and 1.8x faster inference.

SVD-LLMModel CompressionLow-Rank DecompositionSVDICLR 2025Inference Optimization
T-MAC Guide: Table Lookup GEMM for Low-Bit CPU LLMs

Master Microsoft T-MAC in 2026: explore table lookup GEMM, bit-serial design, and running 1-to-4-bit quantized LLMs on CPUs up to 11x faster than llama.cpp.

t-maccpu-inferencequantizationgemmtable-lookupllm-servingedge-aitutorial
ThunderKittens: Embedded DSL for Fast AI Kernels

Master ThunderKittens in 2026: explore tile primitives, WGMMA, TMA async templates, eliminating shared memory bank conflicts, and scaling H100 GPU kernels.

thunderkittenscudagpu-kernelsh100tensor-coresflashattentionmambatutorial
TileLang Guide: Composable Tiled AI Kernel Programming

Master TileLang in 2026: explore composable tile primitives, TVM TIRX compilation, FlashMLA on Hopper, eliminating bank conflicts, and scaling GPU kernels.

tilelangai-compilergpu-kernelshopperflashmladeepseektvmtutorial
ZigzagAttention Guide: Fast Long-Context LLM Inference

Master ZigzagAttention in 2026: explore exclusive retrieval and streaming heads, eliminating DuoAttention kernel overhead, and slashing long-context KV cache.

zigzagattentionkv-cachelong-contextllm-inferenceretrieval-headsstreaming-headsduoattentiontutorial
AttentionStore Guide: Multi-Turn KV Cache Architecture

Master AttentionStore in 2026: explore hierarchical KV storage, layer-wise asynchronous prefetching, and 86% lower TTFT for multi-turn LLM agent serving.

AttentionStoreKV CacheMulti-Turn ServingDisaggregated StorageLLM SystemsInference Optimization
Cortex Guide: Semantic Caching for LLM Remote Data Access

Master Cortex in 2026: explore USENIX NSDI 2026 semantic knowledge caching, two-stage Seri retrieval, LLM-powered judging, and 3.6x throughput for AI agents.

Distributed SystemsAI AgentsSemantic CachingRemote Data AccessNSDI 2026
DistFlashAttn Guide: Distributed Attention for Long LLMs

Master DistFlashAttn in 2026: explore SOSP 2024 distributed attention, causal load-balancing, zero-overhead buffer reuse, and 4.45x faster long-context scaling.

DistFlashAttnContext ParallelismFlashAttentionLong ContextSOSP 2024Distributed Training
EcoServe Guide: Partially Disaggregated LLM Serving

Master EcoServe in 2026: explore USENIX OSDI 2026 partially disaggregated serving, zero-network KV caching, macro instances, and 2.5x goodput on commodity GPUs.

ecoservellm-servingkv-cachedisaggregated-servingosdi-2026vllmgpu-clusterstutorial
EROICA Guide: Online Troubleshooting for Large Model Training

Master EROICA in 2026: explore USENIX NSDI 2026 differential observability, runtime behavior patterns, and 97.5% root-cause diagnosis across 100,000 GPUs.

Distributed SystemsMachine LearningPerformance OptimizationCloud ComputingNSDI 2026
FLARE Guide: Anomaly Diagnostics for Massive LLM Training

Master FLARE in 2026: explore USENIX NSDI 2026 full-stack tracing, O(1) NCCL hang diagnostics, 0.43% overhead, and anomaly detection across 6,000 GPUs.

flarellm-trainingdistributed-systemsnsdi-2026gpu-clustersncclanomaly-detectiontutorial
FlexLLM Guide: Token-Level Co-Serving of Inference & PEFT

Master FlexLLM in 2026: explore USENIX NSDI 2026 token-level computation fusion, dependent parallelization, graph pruning, and SLO-guaranteed co-serving.

Distributed SystemsLLM ServingParameter-Efficient Fine-TuningGPU OptimizationNSDI 2026
HetRL Guide: Heterogeneous RL Training for LLMs

Master HetRL in 2026: explore MLSys 2026 heterogeneous GPU orchestration for LLM post-training, multi-level scheduling, and up to 9.17x higher RL throughput.

hetrlreinforcement-learningllm-trainingmlsys-2026heterogeneous-computingrlhfgpu-schedulingtutorial
InfLLM Guide: Training-Free Long-Context Memory Units

Master InfLLM in 2026: explore NeurIPS 2024 training-free long-context extrapolation, memory units, representative key vectors, and constant O(1) GPU memory.

InfLLMLong ContextMemory UnitsNeurIPS 2024KV CacheTraining-Free
Llumnix Guide: Dynamic LLM Serving with Live Migration

Master Llumnix in 2026: explore OSDI 2024 dynamic scheduling, asynchronous multi-stage pre-copy KV cache migration, and 80% lower tail latency for LLM serving.

LLM ServingLlumnixLive MigrationKV CacheOSDI 2024Distributed Systems
OpenTela Guide: Decentralized Heterogeneous LLM Serving

Master OpenTela in 2026: explore USENIX OSDI 2026 user-space overlay, CRDT gossip routing, Slurm-Kubernetes bridging, and 15B token production LLM serving.

opentelallm-servingdistributed-systemsosdi-2026hpcslurmcrdttutorial
Pipeline Parallelism Guide: Online LLM Serving in SGLang

Master pipeline parallelism for online LLM serving in 2026: explore USENIX OSDI 2026 dynamic chunk sizing, delay scheduling, and low-latency SGLang inference.

pipeline-parallelismllm-servingsglangosdi-2026chunked-prefilldelay-schedulinggpu-optimizationtutorial
PipeMorph Guide: Straggler-Resilient Pipeline Parallelism

Master PipeMorph in 2026: explore USENIX NSDI 2026 Outstanding Paper research, schedule morphing, CPU-side RDMA offloading, and 3.5x faster LLM training.

pipemorphpipeline-parallelismdistributed-trainingnsdi-2026stragglersllm-infrastructurerdmatutorial
PLA-Serve Guide: Prefill-Length-Aware LLM Serving in 2026

Master PLA-Serve in 2026: explore MLSys 2026 length-aware prefill disaggregation, dual-queue scheduling, CUDA Graph clustering, and 35% higher throughput.

Distributed SystemsLLM ServingPrefill OptimizationCUDA GraphsMLSys 2026
Seer Guide: Fast Synchronous LLM Reinforcement Learning

Master Seer in 2026: explore USENIX OSDI 2026 online context learning, divided rollouts, 94% lower tail latency, and 2.04x faster synchronous LLM RL training.

seerreinforcement-learningllm-trainingosdi-2026moonshot-aispeculative-decodingrollout-tailtutorial
ServerlessLLM Guide: Low-Latency Serverless AI Serving

Master ServerlessLLM in 2026: explore OSDI 2024 fast multi-tier checkpoint loading, GPUDirect Storage, locality migration, and 82% lower cold-start latency.

ServerlessLLMServerless InferenceGPUDirect StorageCold StartsOSDI 2024LLM Systems
SuperInfer Guide: Rotary Scheduling on GPU Superchips

Master SuperInfer in 2026: explore MLSys 2026 SLO-aware rotary scheduling, DuplexKV full-duplex offloading, and 74.7% higher SLO attainment on GH200 superchips.

LLM InferenceSuperchipsNVIDIA GH200KV CacheSLO SchedulingSuperInfer
SYMPHONY Guide: Disaggregated KV Memory for LLM Serving

Master SYMPHONY in 2026: explore USENIX NSDI 2026 compute-memory disaggregation, advisory prefetch requests, priority KV caching, and 2.4x latency cuts.

Distributed SystemsLLM ServingKV CacheCompute-Memory DisaggregationNSDI 2026
TokenWeave Guide: Compute-Communication Overlap for LLMs

Master TokenWeave in 2026: explore MLSys 2026 compute-communication overlap, token-splitting, fused AllReduce-RMSNorm, and 1.28x faster tensor-parallel LLMs.

Distributed SystemsTensor ParallelismLLM ServingCUDA KernelsMLSys 2026
Tree Attention Guide: Topology-Aware LLM Decoding

Master Tree Attention in 2026: explore ICLR 2025 topology-aware decoding, logarithmic O(log P) tree reductions, and 8x faster long-context LLM generation.

Tree AttentionContext ParallelismLLM DecodingICLR 2025Distributed InferenceFlashAttention
TriInfer Guide: EPD Disaggregation for Multimodal LLMs

Master TriInfer in 2026: explore MLSys 2026 Encode-Prefill-Decode (EPD) disaggregation, stage-level batching, and 2.4x higher throughput for multimodal LLMs.

Distributed SystemsMultimodal AILLM ServingDisaggregated InferenceMLSys 2026
YOCO Guide: You Only Cache Once Decoder Architecture

Master Microsoft's YOCO in 2026: explore the Decoder-Decoder architecture, Self-Decoder global KV caching, Cross-Decoder reuse, and 8x memory reduction.

YOCOTransformer ArchitectureKV CacheMicrosoft ResearchLong ContextInference Optimization
Zero-Bubble Pipeline Parallelism Guide for LLMs

Master Zero-Bubble Pipeline Parallelism in 2026: explore ICLR 2024 ZB-1F1B schedules, B_X and B_W backward splitting, and slashing idle bubble rates to 0%.

Pipeline ParallelismZero-BubbleDistributed TrainingMegatron-LMICLR 2024LLM Systems
AgentSpec Guide: Speculative Decoding for Batch LLM Agents

Master AgentSpec in 2026: explore structure-isolated drafting, pushdown automaton semantic tracking, redundancy-aware budgets, and vLLM agent batch speedups.

agentspecspeculative-decodingai-agentsllm-servingvllmbatch-inferencepushdown-automatontutorial
AgSpec Guide: Speculative Decoding for Coding Agents

Master AgSpec in 2026: explore October 2026 retrieval speculative decoding, emission-format workspace corpora, and 4.76x faster coding agent pipelines.

agspecspeculative-decodingcoding-agentsswe-benchllm-inferencevllmretrieval-augmented-decodingtutorial
BatchGen Guide: High-Throughput Batch Inference for MoEs

Master BatchGen in 2026: explore USENIX OSDI 2026 sequence coroutines, DP+EP phase parallelism, expert batching, and 3.8x higher throughput for MoE LLMs.

batchgenbatch-inferencemixture-of-expertsllm-servingosdi-2026rl-rolloutssequence-coroutinestutorial
ContextPilot Guide: Fast Long-Context Inference via Reuse

Master ContextPilot in 2026: explore MLSys 2026 context indexing, block reordering, 4-12x higher KV-cache hits, and 3x faster prefill in vLLM and SGLang.

contextpilotkv-cachelong-contextllm-servingvllmsglangragtutorial
DirectKV Guide: Zero-Copy KV Offloading on GH200 & GB200

Master DirectKV in 2026: explore USENIX OSDI 2026 zero-copy KV offloading on NVIDIA GH200/GB200, NVLink-C2C fused kernels, and 43% GPU memory savings.

directkvkv-cachenvlink-c2cgh200gb200llm-servingosdi-2026tutorial
ECHO Guide: KV Offloading for Native Sparse Attention

Master ECHO in 2026: explore USENIX OSDI 2026 graph-friendly KV offloading, lossless prefetching, and 2.1x higher throughput for sparse-attention LLMs.

LLM ServingKV CacheSparse AttentionSystems EngineeringPerformance Optimization
GraCE Guide: Compiler Support for CUDA Graphs in ML

Master GraCE in 2026: explore USENIX OSDI 2026 compiler support unlocking CUDA Graphs, zero kernel launch overhead, and seamless PyTorch 2 integration.

CUDA GraphsPyTorch 2Compiler OptimizationGPU SystemsOSDI 2026
Hyperlight Guide: Sub-Millisecond MicroVMs for AI Agents

Master Hyperlight in 2026: explore Microsoft's 0.9ms OS-free microVMs, hardware hypervisors, snapshot resets, and secure CodeAct sandboxing for AI agents.

hyperlightmicrovmai-agentscodeactsandboxingwebassemblyvirtualizationtutorial
Inside aiFetchly Voice Mode: On-Device Push-to-Talk AI

Deep dive into aiFetchly Voice Mode: explore on-device Push-to-Talk transcription, zero audio telemetry, local TTS synthesis, and hands-free Plan Mode.

power-usersvoice-aipush-to-talkspeech-to-textfeature-deep-dive
Kairox Guide: Adaptive GPU-CPU Hybrid LLM Inference

Master Kairox in 2026: explore USENIX OSDI 2026 online neuron balancing, Live Pipeline prefetching, and up to 7.57x faster hybrid LLM inference on consumer PCs.

kairoxgpu-cpu-hybridllm-inferenceosdi-2026neuron-balancingpowerinfersparse-llmtutorial
KAN Guide: Kolmogorov-Arnold Networks & Spline AI Models

Master Kolmogorov-Arnold Networks in 2026: explore KAN vs MLP architecture, learnable B-spline edges, symbolic regression, and Kolmogorov-Arnold Transformers.

kankolmogorov-arnold-networkstransformersb-splineneural-scaling-lawsinterpretabilitytutorial
Mirror-SD Guide: Breaking the Serial LLM Inference Barrier

Master Mirror-SD in 2026: explore Apple's concurrent speculative decoding, early-exit proxies, speculative streaming, and 2.8x-5.8x LLM inference speedups.

mirror-sdspeculative-decodingllm-inferenceapple-siliconheterogeneous-computingspeculative-streaminggpu-accelerationtutorial
MPK Guide: Mega-Kernelizing Multi-GPU Tensor Programs

Master MPK in 2026: explore USENIX OSDI 2026 persistent mega-kernels, SM-level task graphs, cross-operator pipelining, and 1.7x faster LLM inference.

GPU CompilersPersistent KernelsMulti-GPU InferenceSystems EngineeringOSDI 2026
Murakkab Guide: Agentic Workflow Cloud Orchestration

Master Murakkab in 2026: explore USENIX OSDI 2026 declarative agentic workflow orchestration, cross-layer optimization, and 4.3x cloud cost reductions.

Agentic WorkflowsCloud OrchestrationCompound AI SystemsSystems EngineeringOSDI 2026
Nanotron Guide: Minimalist 3D-Parallelism LLM Training

Master Nanotron in 2026: explore Hugging Face minimalist 3D-parallelism, Tensor Parallelism, 1F1B pipeline blocks, ZeRO-1, and pre-training SmolLM models.

nanotrondistributed-training3d-parallelismtensor-parallelismpipeline-parallelismzero-1smollmtutorial
Priming Guide: Hybrid Mamba SSMs From Pre-Trained LLMs

Master Priming in 2026: explore AWS's method for converting pre-trained Transformers to Hybrid Mamba-2 SSMs using under 0.5% compute, cutting KV cache by 75%.

priminghybrid-ssmmamba-2transformer-distillationkv-cachellm-inferencemodel-conversiontutorial
Prism Guide: GPU Memory Ballooning for Multi-LLM Serving

Master Prism in 2026: explore USENIX OSDI 2026 GPU memory ballooning, kvcached driver, and 3.89x higher throughput for elastic multi-model LLM serving.

Multi-LLM ServingGPU Memory BallooningKV CacheSystems EngineeringOSDI 2026
RollArt Guide: Disaggregated Agentic RL Training at Scale

Master RollArt in 2026: explore USENIX OSDI 2026 disaggregated agentic RL, trajectory-level decoupling, serverless rewards, and 2.05x faster training at scale.

Agentic RLDistributed TrainingReinforcement LearningSystems EngineeringOSDI 2026
SDCHunter Guide: Diagnosing Silent Data Corruption in GPUs

Master SDCHunter in 2026: explore USENIX OSDI 2026 research diagnosing GPU silent data corruption (SDC), execution replay, and ByteDance production findings.

GPU ReliabilitySilent Data CorruptionDistributed TrainingSystems EngineeringOSDI 2026
Sophia Guide: Second-Order Stochastic Optimizer for LLMs

Master the Sophia optimizer in 2026: explore Hutchinson Hessian estimation, 2x faster LLM pre-training than AdamW, loss-spike immunity, and PyTorch code.

sophiaoptimizerllm-pretrainingadamwsecond-order-optimizationhutchinson-estimatortutorial
SPEX Guide: Speculative Tree-of-Thought Reasoning

Master SPEX in 2026: explore USENIX OSDI 2026 speculative exploration, breaking the reward dependency barrier in Tree-of-Thought LLM reasoning.

Tree-of-ThoughtSpeculative ExecutionLLM ServingSystems EngineeringOSDI 2026
Strata Guide: Hierarchical Context Caching in SGLang

Master Strata in 2026: explore USENIX OSDI 2026 hierarchical context caching across GPU, CPU, and NVMe SSDs, delay-hit scheduling, and 5x SGLang speedups.

stratakv-cachecontext-cachingsglangllm-servingosdi-2026nvme-offloadingtutorial
Syncopate Guide: Overlapping Compute and Communication

Master Syncopate in 2026: explore USENIX OSDI 2026 chunk-centric compute-communication overlap, Triton kernel fusion, and up to 4.7x multi-GPU speedups.

Distributed TrainingGPU KernelsTriton CompilerSystems EngineeringOSDI 2026
Tessera Guide: Pipeline Parallelism for Trillion-Param MoE

Master Tessera in 2026: explore USENIX OSDI 2026 pipeline parallelism for trillion-parameter MoE models, dynamic bubble filling, and 12,288 GPU scaling.

Pipeline ParallelismMixture-of-ExpertsDistributed TrainingSystems EngineeringOSDI 2026
Weave Guide: Co-Scheduling Disaggregated RL Training

Master Weave in 2026: explore USENIX OSDI 2026 cross-cluster co-scheduling, dependency bubble reclamation, and 1.84x cost efficiency for RL post-training.

Reinforcement LearningRL Post-TrainingCluster SchedulingSystems EngineeringOSDI 2026
CUTLASS 3 & CuTe Guide: Hopper & Blackwell High-Speed GEMMs

Master CUTLASS 3 and CuTe in 2026: explore hierarchical layout algebra, asynchronous TMA, warpgroup WGMMA, warp specialization, and saturating H100 TFLOPs.

GPU ArchitectureCUDACUTLASSKernel EngineeringHigh-Performance Computing
ESM-3 Guide: Programmable Protein Generative Architecture

Master ESM-3 in 2026: explore EvolutionaryScale generative biology, multimodal protein tokenization, geometric structure codebooks, and de novo protein design.

esm-3generative-biologyprotein-designbioinformaticsfoundation-modelstutorial
Fast Feedforward Networks: Logarithmic Time LLM Inference

Master Fast Feedforward Networks (FFF) in 2026: replace linear O(N) FFN layers with logarithmic O(log N) binary trees for 78x-220x faster inference.

Transformer ArchitectureFast Feedforward NetworksConditional ComputingInference OptimizationETH Zurich
Grammar-Aligned Decoding: Unbiased Structured LLM Sampling

Master Grammar-Aligned Decoding (GAD) in 2026: eliminate GCD distribution distortion, avoid semantic traps in JSON/SQL, and sample unbiased formal languages.

Constrained DecodingStructured OutputsLLM SamplingFormal GrammarsAgent Reliability
H2O Guide: Heavy Hitter Oracle KV Cache Eviction for LLMs

Master H2O in 2026: explore Heavy Hitter Oracle KV cache eviction, dynamic score accumulation, 80% memory compression, and 3x faster long-context LLM serving.

h2okv-cachellm-inferenceattention-sparsitygpu-optimizationtutorial
Hymba Guide: Hybrid-Head Architecture for Small LLMs

Master Hymba in 2026: explore NVIDIA's hybrid-head parallel SSM-attention architecture, learnable meta tokens, cross-layer KV sharing, and 3.5x throughput.

Small Language ModelsHymbaState Space ModelsHybrid ArchitecturesNVIDIA Research
Jamba Guide: Hybrid Transformer-Mamba MoE Architecture

Master Jamba in 2026: explore AI21 hybrid Transformer-Mamba architecture, 16-expert MoE layers, 256k context windows, and 3x faster long-sequence throughput.

jambamambamixture-of-expertstransformerllm-architecturetutorial
OLMoE Guide: 64-Expert Fine-Grained Open MoE Architecture

Master OLMoE in 2026: explore Allen AI open Mixture-of-Experts architecture, 64 fine-grained experts, top-8 routing, and 1B active parameter efficiency.

olmoemixture-of-expertsallen-aillm-architectureopen-source-aitutorial
OpenVLA Guide: Open-Source Vision-Language-Action Models

Master OpenVLA in 2026: explore the 7B generalist robot manipulation policy, DINOv2-SigLIP vision fusion, action tokenization, and multi-robot fine-tuning.

RoboticsVision-Language-ActionEmbodied AIOpenVLAOpen X-Embodiment
Qwen 2.5-Coder Guide: Open-Source Code LLM Architecture

Master Qwen 2.5-Coder in 2026: explore 5.5T code pre-training, FIM infilling, compiler execution feedback, and matching GPT-4o on LiveCodeBench and SWE-bench.

qwen-2-5-codercode-generationllm-architecturereinforcement-learningai-agentstutorial
Qwen2.5-Coder Guide: Open-Source Code Foundation Models

Master Qwen2.5-Coder in 2026: explore the 32B flagship architecture, 5.5T code pre-training, FIM infilling, 128k context, and matching GPT-4o on SWE-Bench.

Code-LLMsQwen2.5-CoderSoftware EngineeringOpen-Source AISWE-Bench
QwQ-32B Guide: Reinforcement Learning for LLM Reasoning

Master QwQ-32B in 2026: explore Alibaba's 32B reasoning model, scaling RL with verifiable rewards, test-time compute, and rivaling DeepSeek-R1 and o1.

Reasoning-LLMsQwQ-32BReinforcement LearningTest-Time ComputeQwen
SimPO Guide: Reference-Free LLM Preference Optimization

Master SimPO in 2026: explore reference-free direct alignment, length-normalized rewards, target margins, and cutting GPU memory by 50% over standard DPO.

simpollm-alignmentdporeinforcement-learningfine-tuningtutorial
Vision Mamba Guide: Efficient Bidirectional SSM & VMamba

Master Vision Mamba in 2026: explore bidirectional SSMs, 2D cross-scan modules, linear O(N) complexity, and cutting high-resolution vision compute by 75%.

vision-mambastate-space-modelscomputer-visiondeep-learninglinear-attentiontutorial
AdaGen Guide: Workload-Adaptive LLM Cluster Scheduler

Master AdaGen in 2026: explore EuroSys 2026 workload-adaptive cluster scheduling, compute layout optimization, 3.6x SLO attainment, and cost efficiency.

adagenllm-servingcluster-schedulingeurosys-2026compute-layoutsslo-optimizationtutorial
AIMS Guide: Cost-Efficient LLM Agent Deployment Systems

Master AIMS in 2026: explore EuroSys 2026 adaptive iteration-level model selection, hybrid cloud-edge LLM agent deployment, and 27.5% higher accuracy.

aimsai-agentshybrid-cloud-edgemodel-routingllm-deploymenteurosys-2026tutorial
BitNet.cpp Guide: Fast 1-Bit LLM CPU Inference

Master Microsoft bitnet.cpp in 2026: explore TL1 and TL2 lookup kernels, 100B model CPU serving, 6x faster inference, and 80% energy reduction.

bitnet-cpp1-bit-llmcpu-inferenceternary-llmlookup-table-kernelsmicrosoft-aiedge-aitutorial
Cache-Craft Guide: Chunk-Level KV Caching for RAG Serving

Master Cache-Craft in 2026: explore SIGMOD 2025 chunk-level KV caching for RAG, selective token recomputation, 2x latency reduction, and vLLM integration.

cache-craftragllm-servingkv-cachechunk-cachingsigmod-2025tutorial
ChunkKV Guide: Semantic-Preserving KV Cache Compression

Master ChunkKV in 2026: explore semantic-preserving KV cache compression, layer-wise index reuse, and 80% VRAM reduction with zero context fragmentation.

chunkkvkv-cachellm-inferencelong-contextnvidia-kvpressneurips-2025tutorial
CONCUR Guide: High-Throughput Agentic Batch Inference

Master CONCUR in 2026: explore ICML 2026 agentic batch inference, taming middle-phase KV cache thrashing, AIMD admission control, and 4.09x speedups.

concuragentic-inferencellm-servingkv-cacheconcurrency-controlicml-2026tutorial
Declarative OS Guide: LLM Interfaces for Computer-Use Agents

Master declarative OS interfaces for computer-use agents in 2026: explore EuroSys 2026 declarative primitives, state intent contracts, and 3x faster execution.

Computer-Use AgentsOperating SystemsLLM ArchitectureEuroSys 2026System Optimization
DIAMOND Guide: Diffusion World Models for RL Agent Training

Master DIAMOND in 2026: explore diffusion world models, EDM dynamics, overcoming discrete VQ-VAE collapse, and training RL agents entirely in imagination.

World ModelsReinforcement LearningDiffusion ModelsNeurIPS 2024Neural Simulation
FlexPipe Guide: Inflight Pipeline Refactoring for LLMs

Master FlexPipe in 2026: explore EuroSys 2026 inflight pipeline refactoring, fragmented serverless LLM serving, 8.5x resource efficiency, and low latency.

flexpipeserverless-llmpipeline-parallelismllm-servingeurosys-2026gpu-optimizationtutorial
MagicPIG Guide: LSH Attention Sampling for LLM Serving

Master MagicPIG in 2026: explore ICLR 2025 LSH attention sampling, heterogeneous CPU-GPU serving, and 5x faster long-context decoding on RTX 4090.

magicpiglsh-attentionllm-inferencelong-contexticlr-2025sub-quadratictutorial
MFS Guide: Model Family Serving Architecture for LLMs

Master MFS in 2026: explore EuroSys 2026 model family serving, structural similarity weight deduplication, unified batching, and 3.2x memory savings.

mfsllm-servingmodel-familymemory-deduplicationeurosys-2026gpu-optimizationtutorial
Oasis Guide: Real-Time Interactive Diffusion World Models

Master Oasis in 2026: explore interactive open-world diffusion transformers, ViT autoencoders, Diffusion Forcing, and 20 FPS neural game simulation.

World ModelsDiffusion TransformerInteractive AINeural SimulationDecart AI
PiLLM Guide: Predictive Resource-Efficient LLM Serving

Master PiLLM in 2026: explore EuroSys 2026 workload prediction for LLM inference, dynamic KV memory sizing, predictive DVFS, and 34% energy reduction.

pillmllm-servingworkload-predictionkv-cacheenergy-efficiencyeurosys-2026tutorial
QCFuse Guide: Query-Aware Cache Fusion for RAG Serving

Master QCFuse in 2026: explore compressed-view query-aware cache fusion, chunk-anchor probing, critical-layer profiling, and 1.7x faster RAG prefill in SGLang.

qcfuseragcache-fusionllm-servingkv-cachesglangtutorial
RAE Guide: Representation Autoencoders for DiT AI

Master RAE in 2026: explore Representation Autoencoders with DINO and SigLIP, DiT-DH dual heads, and replacing standard VAEs for 1.13 FID generative AI.

raediffusion-transformersditrepresentation-autoencodersdinov2generative-aicomputer-visiontutorial
RAGCache Guide: Multilevel Knowledge Caching for LLMs

Master RAGCache in 2026: explore PKU & ByteDance multilevel knowledge tree caching, PGDSF replacement, speculative pipelining, and 4x lower TTFT latency.

ragcacheragllm-servingknowledge-treekv-cachepipeliningtutorial
SkyWalker Guide: Cross-Region Load Balancing for LLMs

Master SkyWalker in 2026: explore EuroSys 2026 cross-region LLM load balancing, global KV-cache locality, diurnal aggregation, and 25% cost reduction.

skywalkerllm-servingload-balancingcross-regionkv-cacheeurosys-2026tutorial
TokenFlow Guide: Preemptive LLM Text Streaming Serving

Master TokenFlow in 2026: explore EuroSys 2026 preemptive scheduling, buffer-aware KV cache management, 80% lower P99 TTFT, and effective goodput.

tokenflowllm-servingtext-streamingpreemptive-schedulingkv-cacheeurosys-2026tutorial
TransformerFAM: Feedback Attention as Working Memory Guide

Master TransformerFAM in 2026: explore Feedback Attention Memory, block-wise feedback loops, emergent working memory, and infinite context scaling.

Long-Context LLMsAttention MechanismWorking MemoryTransformer ArchitectureInference Optimization
Video-XL Guide: Hour-Scale Vision-Language Models & VST

Master Video-XL in 2026: explore Visual Summarization Tokens (VST), dynamic compression, curriculum learning, and processing 2,048+ frames on a single GPU.

Video-LLMsMultimodal AILong-Context VisionCVPR 2025Vision-Language Models
AdaFlash Guide: Adaptive Diffusion Speculative Decoding

Master AdaFlash in 2026: explore on-policy distilled diffusion drafters, dynamic candidate length gating, and taming speculative variance in SGLang.

adaflashspeculative-decodingdiffusion-modelsllm-inferencesglanggpu-optimizationtutorial
AttnCache Guide: Reusing Attention Maps in LLM Prefill

Master AttnCache in 2026: explore cross-sequence attention map memorization, zero-copy virtual memory caching, and 3x faster self-attention in LLM prefill.

attncacheprefill-optimizationllm-inferenceattention-cachegpu-optimizationsentence-embeddingstutorial
CacheSlide Guide: Cross-Position KV Cache Reuse in Agents

Master CacheSlide in 2026: explore Relative-Position-Dependent Caching (RPDC), solving Positionally Misaligned KV Drift (PMKD), and 3.3x lower TTFT in vLLM.

cacheslidekv-cachellm-inferenceai-agentsvllmprompt-cachingtutorial
CoCoDiff Guide: Distributed DiT Inference Optimization

Master CoCoDiff in 2026: explore collective communication overlap, Tile-Aware All-to-all, V-First scheduling, and 3.6x faster distributed DiT inference.

cocodiffdiffusion-transformersditdistributed-inferencesequence-parallelismgpu-optimizationtutorial
CORE Guide: Coverage-Calibrated KV Cache Compression

Master CORE in 2026: explore exact eviction-error factorization, log-determinant set coverage, evicted-mass redistribution, and 90% KV compression for LLMs.

corekv-cachecontext-compressionllm-inferencelong-contextgpu-optimizationtutorial
DeepServe Guide: Serverless LLM Serving at Hyperscale

Master DeepServe in 2026: explore USENIX ATC 2025 serverless LLM serving, FLOWSERVE microkernel engine, NPU-fork cold starts, and hybrid PD scheduling.

deepserveserverless-aillm-servingflowservenpu-forkdistributed-systemsusenix-atc-2025tutorial
EPIC Guide: Position-Independent Caching for LLM Serving

Master EPIC in 2026: explore ICML 2025 Position-Independent Caching, LegoLink attention repair, RoPE key rotation, and 8x faster non-prefix RAG serving.

epicposition-independent-cachingkv-cachelegolinkrag-servingllm-inferenceicml-2025tutorial
FastKV Guide: Decoupling Context & KV Cache Compression

Master FastKV in 2026: explore Token-Selective Propagation, independent prefill and decoding budget decoupling, and 2.87x faster long-context LLM inference.

fastkvkv-cachellm-inferenceprefill-accelerationtoken-selective-propagationlong-contextdistributed-systemstutorial
ForkKV Guide: Scaling Multi-LoRA Agent Serving with CoW

Master ForkKV in 2026: explore Copy-on-Write disaggregated KV caching, DualRadixTree indexing, ResidualAttention kernels, and 4.5x faster multi-LoRA serving.

forkkvmulti-loraagent-servingkv-cachecopy-on-writellm-inferencedistributed-systemstutorial
Kalypso Guide: Relational LLM Serving & Pipelined Execution

Master Kalypso in 2026: explore relational LLM serving, semantic query plans, pipelined KV-cache reuse, and 4.57x faster enterprise data extraction pipelines.

kalypsorelational-llmllm-servingkv-cachepipelined-executionsemantic-queriesdistributed-systemstutorial
KV-Lingo Guide: Distilled KV Cache Translation for LLMs

Master KV-Lingo in 2026: explore cross-model KV cache translation via distillation, eliminating re-prefills in dynamic routing, and 29x faster TTFT on H100.

kv-lingokv-cachemodel-routingllm-inferencedistillationcascade-servingtutorial
KVTC Guide: 20x KV Cache Transform Coding for LLM Serving

Master NVIDIA KVTC in 2026: explore classical media transform coding for KV caches, PCA decorrelation, adaptive bit-plane quantization, and 20x-40x storage.

kvtckv-cachellm-inferencecompressiongpu-optimizationvllmtutorial
LoongServe Guide: Elastic Sequence Parallelism for LLMs

Master LoongServe in 2026: explore Elastic Sequence Parallelism (ESP), dynamic DoP scaling, token-granular KV management, and 3.85x long-context throughput.

loongservesequence-parallelismllm-servingkv-cachelong-contextdistributed-systemselastic-scalingtutorial
Nitsum Guide: Adaptive Tensor Parallelism for Tiered SLOs

Master Nitsum in 2026: explore runtime tensor parallelism adaptation, reload-free weight reuse, fast KV migration, and 5.3x higher tiered-SLO goodput.

nitsumtensor-parallelismllm-servingtiered-slovllmkv-cachedistributed-systemstutorial
NoMAD-Attention Guide: Multiply-Add-Free CPU LLM Inference

Master NoMAD-Attention in 2026: explore NeurIPS 2024 multiply-add-free attention, Key-Code caches, LUT dot products, and 4x faster CPU LLM inference.

nomad-attentioncpu-inferencemultiply-add-freelut-attentionllm-servingneurips-2024tutorial
Pie Guide: Programmable LLM Serving & Sandboxed Inferlets

Master Pie in 2026: explore SOSP 2025 programmable LLM serving, WebAssembly inferlets, custom KV cache policies, and 3.4x faster agentic workflows.

pieprogrammable-servinginferletswebassemblyllm-servingagentic-workflowssosp-2025tutorial
PowerInfer Guide: Exploiting Activation Sparsity for LLM AI

Master PowerInfer in 2026: explore SOSP 2024 activation sparsity, hot-cold neuron placement, and running 70B LLMs on consumer GPUs up to 11x faster.

powerinferactivation-sparsityconsumer-gpullm-servingneuron-cachingsosp-2024tutorial
PulseInfer Guide: I/O-Centric Sparse KV Cache Offloading

Master PulseInfer in 2026: explore I/O-centric sparse KV offloading, gather-scatter PCIe DMA, SoloHead selection, and 4.7x faster long-context decoding.

pulseinferkv-cachesparse-attentionkv-offloadingllm-servinglong-contextsglangtutorial
rStar Guide: Self-Play Mutual Reasoning for Small LLMs

Master Microsoft rStar in 2026: explore self-play mutual reasoning, 5 human-like MCTS actions, and boosting 7B LLM reasoning to 85%+ without fine-tuning.

rstarmctsreasoning-modelssmall-language-modelstest-time-computemicrosoft-aineurips-2024tutorial
SageAttention Guide: Accurate 8-Bit Attention Quantization

Master SageAttention in 2026: explore accurate 8-bit quantized attention, Smooth-K outlier suppression, and 2.8x faster inference than FlashAttention-2.

sageattentionquantized-attention8-bit-inferenceflashattentionllm-servingtriton-kernelsiclr-2025tutorial
SpeCache Guide: Speculative Key-Value Cache Prefetching

Master SpeCache in 2026: explore speculative KV prefetching, low-bit VRAM importance guides, host CPU offloading, and 4.6x higher LLM serving throughput.

specachekv-cachespeculative-prefetchingllm-inferencecpu-offloadinggpu-optimizationtutorial
SWIFT Guide: On-the-Fly Self-Speculative Layer Skipping

Master SWIFT in 2026: explore training-free on-the-fly layer skipping, context-based layer set search, confidence-aware drafting, and 1.6x faster LLM serving.

swiftspeculative-decodinglayer-skippingllm-inferenceplug-and-playtraining-freetutorial
VPTQ Guide: Extreme 2-Bit Vector Quantization for LLM AI

Master Microsoft VPTQ in 2026: explore extreme 1-bit and 2-bit vector post-training quantization, Residual VQ codebooks, and running 70B LLMs on single GPUs.

vptqvector-quantization2-bit-llmmodel-compressionllm-inferencemicrosoft-aiemnlp-2024tutorial
Asymmetric Credit Policy Optimization (ACPO) Guide

Master Asymmetric Credit Policy Optimization (ACPO) in 2026: explore mode-local entropy surrogates, token-level credit assignment, and reasoning RL.

reinforcement-learningreasoning-modelsacpopolicy-optimizationcredit-assignmentdeepseek-r1llm-training
Attention-Aware Transform Coding Guide: KV Compression

Master Attention-Aware Transform Coding (AATC) in 2026: explore rate-distortion theory, reverse water-filling, and near-lossless 5.8x KV cache compression.

kv-cachequantizationtransform-codinginformation-theoryllm-inferencerate-distortiontransformer-optimization
AutoWebGLM Guide: Autonomous Web Navigating Agent AI

Master AutoWebGLM in 2026: explore human-inspired HTML simplification, hybrid DOM-OCR grounding, DPO reinforcement learning, and browser automation.

autowebglmweb-agentsai-agentsbrowser-automationhtml-simplificationreinforcement-learningllm-agents
Behavior-Preserving KV Cache Compression Guide

Master Behavior-Preserving KV Cache Compression in 2026: eliminate attention-mass heuristics, preserve next-token KL distributions, and scale LLM inference.

kv-cachellm-inferencelong-contextcache-evictionkl-divergencetransformer-optimizationdeep-learning
BitNet b1.58 2B4T Guide: Scaling Native 1-Bit LLMs

Master BitNet b1.58 2B4T in 2026: explore native ternary BitLinear scaling, 4-trillion token pretraining, bitnet.cpp inference, and edge CPU deployment.

bitnet1-bit-llmquantizationedge-aicpu-inferencellm-architecturedeep-learning
DeepSeek Sparse Attention DSA Architecture Guide

Master DeepSeek Sparse Attention (DSA) in 2026: explore the FP8 Lightning Indexer, fine-grained token routing under MLA, and sub-linear long-context scaling.

deepseeksparse-attentionmlalightning-indexerlong-contextllm-inferencetransformer-architecture
DFlash Guide: Block Diffusion for Speculative Decoding

Master DFlash in 2026: explore block diffusion speculative decoding, single-pass parallel drafting, target KV injection, and up to 5.1x inference speedups.

speculative-decodingdflashdiffusion-modelsllm-inferenceinference-accelerationblackwelldeep-learning
DGA-Muon Guide: Geometry-Aligned Optimizer for LLMs

Master DGA-Muon in 2026: resolve NorMuon scaling degeneration via decoupled gradient adaptivity, shape-aware scaling, and faster LLM pretraining.

muon-optimizernormuondga-muonllm-pretrainingnewton-schulzmatrix-optimizationdeep-learning
EAGLE-3 Guide: Scaling Speculative Decoding via TTT

Master EAGLE-3 in 2026: explore multi-layer feature fusion, training-time test (TTT), removing feature prediction loss, and up to 6.5x inference speedups.

speculative-decodingeagle-3llm-inferenceinference-accelerationtraining-time-testfeature-fusiontransformer-optimization
FlashAttention-4 Guide: Kernel Pipelining on Blackwell

Master FlashAttention-4 in 2026: explore algorithm and kernel pipelining co-design for asymmetric hardware scaling on NVIDIA Blackwell, reaching 1613 TFLOPs/s.

flashattentionblackwellgpu-kernelsllm-inferencecutedslhardware-accelerationdeep-learning
Gated DeltaNet-2 Guide: Decoupled Linear Attention

Master Gated DeltaNet-2 in 2026: explore decoupled erase and write gates, channel-wise memory editing, chunkwise parallel kernels, and linear O(N) scaling.

gated-deltanet-2linear-attentiondelta-rulenvidia-researchlong-contextarxiv-2026tutorial
Hardware-Aware FP4 FlashAttention-4: Direct-P Guide

Master Hardware-Aware FP4 FlashAttention-4 in 2026: explore Direct-P log-score mapping, Blackwell Tensor Cores, and 2.13x faster attention throughput.

flashattentionfp4-quantizationblackwelldirect-pgpu-kernelsllm-inferencehardware-acceleration
HRBench Guide: Thinking-Mode Switching in Hybrid LLMs

Master HRBench in 2026: explore thinking-mode switching strategies in hybrid-reasoning LLMs, prompt-tuning vs routing vs speculative modes, and cost savings.

hybrid-reasoninghrbenchthinking-modereasoning-modelstest-time-computellm-inferencedeep-learning
LongFlow Guide: KV Cache Compression for Reasoning AI

Master LongFlow in 2026: explore zero-cost KV cache compression for long-output reasoning models, fused Triton attention-eviction, and 11.8x throughput.

kv-cachereasoning-modelsdeepseek-r1longflowtriton-kernelsllm-inferencechain-of-thought
NorMuon Guide: Scalable Normalized Matrix Optimization

Master NorMuon in 2026: explore neuron-wise normalization, Newton-Schulz matrix orthogonalization, FSDP2 distributed scaling, and 21.7% efficiency gains.

normuonmuon-optimizerllm-trainingdeep-learning-optimizationfsdp2arxiv-2025tutorial
QuantSpec Guide: Self-Speculative Decoding & Quantized KV

Master QuantSpec in 2026: explore hierarchical INT4/INT8 KV cache bit-sharing, double-buffer full-precision caches, and self-speculative LLM acceleration.

quantspecspeculative-decodingkv-cachequantizationllm-inferencelong-contexttutorial
Saguaro Guide: Speculative Speculative Decoding (SSD)

Master Saguaro and Speculative Speculative Decoding (SSD) in 2026: eliminate draft model idle stalls, predict verification outcomes, and scale inference.

speculative-decodingsaguarollm-inferenceinference-accelerationasynchronous-executionsystems-aitransformer-optimization
Sequential KV Cache Compression via Language Tries Guide

Master Sequential KV Cache Compression in 2026: explore Probabilistic Language Tries, predictive delta coding, and beating the per-vector Shannon limit.

kv-cacheprobabilistic-triepredictive-codinginformation-theoryllm-inferencelong-contexttransformer-optimization
Sparse-BitNet Guide: 1.58-Bit LLMs Meet 2:4 Sparsity

Master Sparse-BitNet in 2026: explore unifying 1.58-bit ternary quantization with hardware 2:4 semi-structured sparsity for ultra-fast, sub-1-bit LLM inference.

sparse-bitnetbitnet1-bit-llmsemi-structured-sparsity2-4-sparsitytensor-coresmodel-compression
SpecDecode-Bench: Speculative Decoding in Production

Master SpecDecode-Bench in 2026: evaluate speculative decoding across batch sizes, discover why speedups shrink at scale, and master production vLLM rules.

speculative-decodingvllmllm-inferencebenchmarkingproduction-aigpu-optimizationtutorial
VeriCache Guide: Lossless Inference with Lossy KV Caches

Master VeriCache in 2026: explore turning lossy KV caches into mathematically lossless LLM inference, overlapping HBM and PCIe swaps, and 4x serving throughput.

vericachekv-cachespeculative-decodingllm-inferencegpu-optimizationlong-contexttutorial
AutoWebGLM Guide: Autonomous Web Navigation AI Agents

Master AutoWebGLM in 2026: explore HTML pruning, curriculum SFT, self-sampling RL, rejection sampling finetuning, and real-world browser automation.

autowebglmweb-agentsautonomous-browsingreinforcement-learningbrowser-automationkdd-2024tutorial
BIRD Framework Guide: Bayesian Inference for LLM Agents

Master the BIRD framework in 2026: explore LLM abduction, Bayesian network alignment, deductive reasoning, calibrated decision-making, and agent trust.

bird-frameworkbayesian-inferenceai-agentsllm-reasoningtrustworthy-aiiclr-2025tutorial
BitNet 2B4T Guide: Scaling Native 1.58-Bit LLMs

Master BitNet b1.58 2B4T in 2026: explore native 1-bit pretraining on 4T tokens, BitLinear kernels, squared ReLU, SubLN, and CPU-native energy scaling.

bitnet1-bit-llmquantizationmicrosoft-researchedge-aiarxiv-2025tutorial
Block Diffusion Guide: Hybrid AR & Diffusion AI Models

Master Block Diffusion (BD3-LMs): explore interpolating between autoregressive and diffusion models, KV caching in diffusion, and block-level text generation.

block-diffusiondiffusion-language-modelsautoregressive-modelsllm-architecturekv-cachesemi-autoregressivetutorial
Byte Latent Transformer Guide: Token-Free BLT AI

Master Byte Latent Transformer in 2026: explore Meta FAIR token-free architecture, dynamic entropy patching, local encoders, and 50% inference FLOP cuts.

byte-latent-transformerbltmeta-fairtoken-free-llmllm-architectureentropy-patchingtutorial
DeepSeek-R1 Guide: Incentivizing Reasoning via GRPO

Master DeepSeek-R1 in 2026: explore pure RL incentives, Group Relative Policy Optimization (GRPO), cold-start SFT, and open-weights distillation.

deepseek-r1reinforcement-learninggrporeasoning-modelsopen-source-aidistillationtutorial
DeferKV Guide: Eviction Timing for KV Cache Compression

Master DeferKV in 2026: explore post-prefill eviction timing, decode-aware observation windows, temporal weighting, and zero-overhead KV compression.

deferkvkv-cachellm-inferencelong-contextcompressionarxiv-2026tutorial
EAGLE-3 Guide: Scaling Speculative Decoding Acceleration

Master EAGLE-3 in 2026: explore training-time test simulation, multi-layer feature fusion, inference scaling laws, and 3x LLM decoding speedups.

eagle-3speculative-decodingllm-inferenceinference-accelerationvllmiclr-2026tutorial
FlashAttention-4 Guide: Blackwell Kernel Co-Design

Master FlashAttention-4 in 2026: explore asymmetric hardware scaling, CuTe-DSL kernel pipelining, tcgen05 instructions, and 1613 TFLOPs on Blackwell.

flashattention-4blackwell-gpukernel-optimizationcute-dsltri-daomlsys-2026tutorial
Google Titans Guide: Test-Time Neural Memory for LLMs

Master Google Titans in 2026: explore test-time neural memory, surprise metrics, adaptive forgetting, 2M+ context scaling, and the MAC architecture.

titansgoogle-researchneural-memorylong-contexttest-time-trainingllm-architecturetutorial
High-Deliverability Outreach: aiFetchly SMTP Campaign Guide

Discover how digital marketers run high-deliverability cold email campaigns in aiFetchly with custom SMTP servers, duplicate prevention, and pacing jitter.

digital-marketerscold-emailsmtp-outreachemail-deliverabilityproblem-solution
LookaheadKV Guide: Future Attention KV Cache Eviction

Master LookaheadKV in 2026: explore learnable lookahead tokens, Lookahead LoRA, future attention prediction, and fast long-context LLM inference.

lookaheadkvkv-cachellm-inferencelong-contextefficient-aiiclr-2026tutorial
MoE++ Guide: Accelerating MoE with Zero-Computation AI

Master MoE++ in 2026: explore heterogeneous Mixture-of-Experts with zero-computation experts, gating residuals, dynamic FLOP allocation, and 2x faster serving.

moe-plus-plusmixture-of-expertszero-computation-expertsllm-servinggating-residualsinference-optimizationtutorial
Moonlight 16B Guide: Scalable MoE & Muon Optimizer AI

Master Moonlight 16B in 2026: explore Moonshot AI MoE architecture, Multi-head Latent Attention, Muon orthogonal optimization, and 2x training efficiency.

moonlightmixture-of-expertsmuon-optimizerllm-trainingdeepseek-v3open-source-aitutorial
RocketKV Guide: Two-Stage KV Cache Compression for LLMs

Master RocketKV in 2026: explore two-stage KV cache compression, SnapKV coarse eviction, hybrid sparse attention, and 3.7x long-context decoding.

rocketkvkv-cachellm-inferencesparse-attentionlong-contexttensorrt-llmtutorial
Speculative Speculative Decoding Guide: SSD AI

Master Speculative Speculative Decoding (SSD) in 2026: explore pipelined drafting, speculation caches, asynchronous verification, and 2.5x LLM acceleration.

speculative-decodingssdllm-inferenceflashattentiontri-daoiclr-2026tutorial
TALE Guide: Token-Budget-Aware LLM Reasoning

Master TALE in 2026: explore token-budget-aware reasoning, token elasticity, estimation-and-prompting (TALE-EP), post-training (TALE-PT), and 67% token savings.

taletoken-budget-awaretest-time-computellm-reasoningchain-of-thoughtacl-2025tutorial
VL-Cache Guide: Modality-Aware KV Compression for VLMs

Master VL-Cache in 2026: explore modality-aware token scoring, layer-adaptive KV cache budget allocation, 90% VRAM reduction, and 7x faster VLM decoding.

vl-cachevlmvision-language-modelskv-cachemultimodal-aillm-inferencetutorial
Zigzag Diffusion Guide: Self-Improving Z-Sampling AI

Master Zigzag Diffusion Sampling in 2026: explore guidance gaps, inversion-denoising loops, self-reflection trajectories, and 94% win-rate image AI.

diffusion-modelsz-samplinggenerative-aicomputer-visionimage-synthesisiclr-2025tutorial
Ada-KV Guide: Adaptive Budget KV Cache Eviction AI

Master Ada-KV in 2026: explore head-wise adaptive budget allocation, attention entropy profiling, cutting KV cache memory by 80%, and faster LLM serving.

ada-kvkv-cachellm-servingattention-profilinginference-optimizationvllmtutorial
Guide to CacheGen: Fast KV Cache Streaming for LLMs

Master CacheGen for fast LLM context loading: discover delta encoding, adaptive quantization, and streaming KV cache compression for distributed serving.

CacheGenKV CacheLLM ServingContext LoadingModel Compression
CogAgent Guide: High-Resolution Visual GUI Agent AI

Master CogAgent in 2026: explore high-resolution cross-module attention, dual-stream screen perception, GUI grounding, and autonomous web and mobile navigation.

cogagentgui-agentsvisual-language-modelscomputer-visionautonomous-agentsweb-scrapingtutorial
DeFT Guide: Flash Tree-Attention for LLM Serving

Master DeFT in 2026: explore Decoding with Flash Tree-attention, KV-guided grouping, flattened tree splitting, cutting KV IO by 99%, and 3.6x faster kernels.

deftflash-tree-attentiontree-attentionspeculative-decodingllm-servinggpu-kernelstutorial
Guide to DistServe: Disaggregated LLM Serving Architecture

Master DistServe for high-goodput LLM serving: explore prefill-decode disaggregation, independent parallelism, and cross-node KV cache streaming architectures.

DistServeLLM ServingDisaggregated Prefill-DecodeDistributed SystemsInference Optimization
EM-LLM Guide: Human-Inspired Episodic Memory AI

Master EM-LLM in 2026: explore surprise-driven event segmentation, human-inspired episodic memory, and scaling foundation models to 5M+ token contexts.

em-llmepisodic-memorylong-contextcognitive-architectureskv-cachellm-inferencetutorial
Guide to Flash-VStream: Real-Time Long Video Understanding

Master Flash-VStream for real-time video understanding: explore dynamic memory mechanisms, streaming frame compression, and online long video-LLM inference.

Flash-VStreamVideo-LLMMultimodal AIVideo StreamingMemory Mechanism
Hydra Guide: Sequentially-Dependent Speculative AI

Master Hydra in 2026: explore sequentially-dependent draft heads, embedding conditioning, eliminating Medusa conditional independence, and 2.7x LLM decoding.

hydraspeculative-decodingmedusallm-servingtree-attentioninference-optimizationtutorial
Kimi Linear Guide: KDA Hybrid Linear Attention AI

Master Kimi Linear in 2026: explore Kimi Delta Attention, 3:1 hybrid MLA layers, channel-wise gating, cutting KV cache by 75%, and 6x faster LLM serving.

kimi-linearlinear-attentionkdadelta-rulemlallm-servingtutorial
Guide to LLaDA: Large Language Diffusion Models

Master LLaDA text diffusion models: explore masked generative diffusion, bidirectional attention, parallel token decoding, and non-autoregressive scaling.

LLaDADiffusion ModelsNon-AutoregressiveLanguage ModelingBidirectional Attention
Guide to LoongTrain: 2D Head-Context Parallelism for LLMs

Master LoongTrain for distributed long-context LLM training: explore 2D head-context parallelism, paired-block load balancing, and Ulysses-Ring hybrid scaling.

LoongTrainContext ParallelismDistributed TrainingLong-ContextRing Attention
Guide to MagicDec: Fast Long-Context Speculative Decoding

Master MagicDec for long-context LLM serving: discover bounded-cache draft models, speculative verification, and high-throughput non-blocking inference.

MagicDecSpeculative DecodingLLM ServingLong-ContextInference Optimization
MaskGCT Guide: Masked Generative Codec TTS AI

Master MaskGCT in 2026: explore two-stage masked generative codec transformers, w2v-BERT semantic tokens, RVQ acoustics, and zero-shot voice cloning.

maskgcttext-to-speechvoice-cloningmasked-generative-modelingaudio-codecsspeech-synthesistutorial
Medha Guide: 3D Parallelism for 10M-Token LLM Serving

Master Medha in 2026: explore 3D parallelism unifying TP, SPP, and KVP to tackle extreme request heterogeneity and serve 10M-token contexts efficiently.

medha3d-parallelismlong-contextllm-servingdistributed-systemskv-cachetutorial
Guide to Meta Movie Gen: 30B Media Foundation Models

Master Meta Movie Gen: explore the 30B video DiT, 13B flow-matching audio generator, personalized video synthesis, and synchronized multi-track audio models.

Movie GenMeta AIVideo GenerationFlow MatchingMultimodal AI
Guide to Quest: Query-Aware KV Cache Sparsity for LLMs

Master Quest for efficient long-context LLM serving: discover query-aware KV cache sparsity, min-max page bounding, and top-k attention acceleration.

QuestKV CacheLong-ContextLLM InferenceQuery-Aware Sparsity
Sarathi-Serve Guide: Chunked-Prefills & LLM Serving

Master Sarathi-Serve in 2026: explore chunked-prefills, stall-free scheduling, piggybacking decodes, and eliminating tail latency in production LLM inference.

sarathi-servechunked-prefillsllm-servingvllmgpu-schedulinginference-optimizationtutorial
Guide to Seed-TTS: High-Quality Speech Generation Models

Master ByteDance Seed-TTS: explore autoregressive speech token prediction, diffusion acoustic modeling, zero-shot voice cloning, and in-context speech editing.

Seed-TTSByteDanceSpeech SynthesisVoice CloningDiffusion Models
Guide to ShadowKV: Scalable Long-Context LLM Inference

Master ShadowKV for high-throughput LLM serving: discover low-rank key caching, CPU value offloading, and sparse PCIe streaming for 1M+ context windows.

ShadowKVKV CacheLLM ServingLong-ContextHeterogeneous Computing
SpecInfer Guide: Tree-Based Speculative LLM Serving

Master SpecInfer in 2026: explore tree-based speculative inference, tree attention kernels, topology-aware causal masking, and 3.5x faster LLM serving.

specinferspeculative-decodingllm-servingtree-attentiongpu-optimizationinference-accelerationtutorial
Speculative Cascades Guide: Smarter, Faster LLM Serving

Master Speculative Cascades from Google Research: learn how unifying model cascades with speculative decoding eliminates re-computation and accelerates LLMs.

speculative-cascadesspeculative-decodingmodel-cascadesgoogle-researchllm-servinginference-optimizationtutorial
SpinQuant Guide: Learned Rotations for 4-Bit LLMs

Master SpinQuant from Meta AI: explore learned rotations, Cayley optimization, suppressing activation outliers, and achieving lossless W4A4KV4 LLM serving.

spinquantllm-quantizationw4a4meta-ailearned-rotationsinference-optimizationtutorial
Splitwise Guide: Phase Splitting for LLM Serving

Master Splitwise in 2026: explore phase splitting for LLMs, disaggregating prefill and decode hardware pools, RDMA KV transfer, and cutting TCO by 2.35x.

splitwisedisaggregated-servingllm-inferencekv-cachegpu-clusteringsystems-architecturetutorial
StripedHyena Guide: Hybrid Convolutional Attention AI

Master StripedHyena in 2026: explore gated long convolutions, FlashFFTConv, hybrid attention striping, and cutting KV-cache memory by 50% for 128k contexts.

stripedhyenahyena-hierarchylong-convolutionshybrid-architecturesflashfftconvllm-servingtutorial
VD3D Guide: 3D Camera Control for Video DiT Models

Master VD3D in 2026: explore 3D camera control for Video Diffusion Transformers, Plücker ray conditioning, FIT latent blocks, and precise camera motion.

vd3dvideo-diffusiondiffusion-transformerscamera-controlcomputer-visiongenerative-videotutorial
AirLLM Guide: Running 70B Models on a Single 4GB VRAM GPU

Master AirLLM in 2026: explore layer-wise streaming inference, overlapped prefetching, NVMe mmap loading, and running 70B LLMs on 4GB GPUs without quantization.

airllmllm-inferencememory-optimizationedge-aillama-70bgpu-efficiencytutorial
BiRefNet Guide: High-Resolution Dichotomous Segmentation

Master BiRefNet in 2026: explore bilateral reference modules, sub-pixel edge matting, 4K dichotomous image segmentation, and production background removal.

birefnetcomputer-visionimage-segmentationmattingbackground-removaldeep-learningtutorial
BitNet a4.8 Guide: 4-Bit Activation 1-Bit LLMs

Master BitNet a4.8: explore hybrid 1.58-bit ternary weights, 4-bit activations, hardware INT4 GEMM acceleration, and zero-degradation LLM inference.

bitnet-a4.81-bit-llmquantizationint4-gemmternary-weightshardware-accelerationtutorial
DeDLOC Guide: Decentralized Long-Context Attention

Master DeDLOC: explore bandwidth-aware dynamic ring topologies, compute-communication overlapping, and training million-token LLMs on decentralized GPUs.

dedloclong-contextring-attentiondistributed-trainingdecentralized-aicudatutorial
DeepSpeed-FastGen Guide: Dynamic SplitKV Serving

Master DeepSpeed-FastGen: explore Dynamic SplitKV attention, prompt-decode decoupling, 2.5x lower latency, and high-goodput enterprise LLM serving.

deepspeed-fastgendynamic-splitkvllm-servingcontinuous-batchinginference-optimizationcuda-kernelstutorial
Distil-Whisper Guide: Fast Robust Speech Recognition

Master Distil-Whisper: explore frozen encoder distillation, 6x faster inference, speculative decoding, and hallucination-free enterprise ASR serving.

distil-whisperspeech-recognitionwhisperknowledge-distillationspeculative-decodingaudio-aitutorial
EdgeSAM Guide: Real-Time Promptable Mobile Segmentation

Master EdgeSAM in 2026: explore prompt-in-the-loop distillation, sub-15ms edge inference, mobile Vision Transformers, and real-time spatial AI segmentation.

edgesamcomputer-visionsegment-anythingedge-aiknowledge-distillationspatial-aitutorial
FastFold: High-Performance Distributed AlphaFold

Master FastFold architecture: Dynamic Axial Parallelism, DMM memory management, and CUDA fused kernels to scale AlphaFold2 training and inference.

BioinformaticsDistributed TrainingCUDAAlphaFoldHPC
FastViT Guide: Hybrid Vision Transformer with RepMixer

Master Apple FastViT in 2026: explore RepMixer token mixing, structural reparameterization, hybrid self-attention, and sub-millisecond edge computer vision.

fastvitcomputer-visionvision-transformersedge-aistructural-reparameterizationapple-researchtutorial
Guide to Flash-Decoding++: Fast Asynchronous LLM Inference

Master Flash-Decoding++ for high-throughput LLM serving: explore asynchronous softmax reduction, unified flat paged memory, and dynamic GPU chunking.

LLM InferenceGPU ArchitectureFlash AttentionCUDA OptimizationHigh-Throughput Serving
Grounding DINO Guide: Open-Set Object Detection with Text

Master Grounding DINO in 2026: explore multi-modal feature enhancers, language-guided query selection, zero-shot 52.5 AP on COCO, and open-set visual grounding.

grounding-dinoopen-set-detectioncomputer-visionvisual-groundingmultimodalobject-detectiontutorial
InternLM-XComposer2.5 Guide: 96-Image & Video Reasoning

Master InternLM-XComposer2.5 in 2026: explore 96-image long-context reasoning, 4,000-frame video comprehension, dynamic vision slicing, and 7B VLM serving.

internlm-xcomposervision-language-modelsmultimodalvideo-reasoninglong-contextshanghai-ai-labtutorial
LGM Guide: High-Resolution 3D Gaussian Splatting Generation

Master LGM in 2026: explore multi-view 3D Gaussian Splatting, asymmetric U-Net backbones, differentiable rasterization, and sub-second 3D asset generation.

lgm3d-gaussian-splatting3d-generationcomputer-visionneural-renderingeccv-2024tutorial
Long-CLIP Guide: Breaking the 77-Token Limit in Vision AI

Master Long-CLIP in 2026: explore positional embedding decomposition, unlocking 248-token context, long-text image retrieval, and zero-shot preservation.

long-clipclipmultimodalcomputer-visionimage-retrievalvector-searchtutorial
LongAlign Guide: Long-Context LLM Alignment & Packing

Master LongAlign in 2026: explore loss-balanced sequence packing, sorted batching, long-context instruction tuning, and 64k+ LLM alignment recipes.

longalignlong-contextinstruction-tuningllm-alignmentsequence-packingtsinghua-aitutorial
MagicPony Guide: Single-Image 3D Animal Mesh AI

Master MagicPony in 2026: explore self-supervised 3D animal reconstruction, DINO feature distillation, articulated mesh skinning, and zero-annotation 3D AI.

magicpony3d-reconstructioncomputer-visiondino-vitneural-renderingmesh-generationtutorial
MobileCLIP Guide: Fast Image-Text Models on Mobile & Edge

Master Apple MobileCLIP in 2026: explore multi-modal reinforced training, RepMixer vision backbones, knowledge distillation, and sub-3ms on-device zero-shot AI.

mobileclipclipon-device-aicomputer-visionknowledge-distillationapple-researchtutorial
MobileVLM Guide: Efficient Vision-Language Models

Master MobileVLM: explore Lightweight Downsample Projectors (LDP), MobileLLaMA architectures, 75% token reduction, and edge multimodal serving.

mobilevlmmultimodalvision-language-modelson-device-aiedge-computingvlmtutorial
Pyramid Flow Guide: Multi-Scale Pyramidal Video AI

Master Pyramid Flow in 2026: explore pyramidal flow matching, multi-scale 3D DiTs, 768p/1080p video generation, and efficient open-weights video serving.

pyramid-flowvideo-generationflow-matchingdiffusion-transformersditopen-source-aitutorial
S2-Wrapper Guide: Multi-Scale Vision Without Larger Models

Master S2-Wrapper in 2026: explore UC Berkeley's multi-scale S2 scaling, patch tiling, frozen ViT enhancement, and boosting MLLM visual perception.

s2-wrappercomputer-visionvision-transformersmllmmultimodaluc-berkeleytutorial
Samba Guide: Hybrid Mamba & Sliding Window Architecture

Master Samba in 2026: explore Microsoft's hybrid Mamba and Sliding Window Attention architecture, linear-time scaling, and infinite context window reasoning.

sambamambastate-space-modelssliding-window-attentionllm-architecturelong-contexttutorial
Sequoia Guide: Hardware-Aware Speculative Decoding for LLMs

Master Sequoia in 2026: explore dynamic programming token trees, hardware-aware budget calibration, robust sampling, and up to 4x faster lossless LLM inference.

sequoiaspeculative-decodingllm-inferencedynamic-programminggpu-optimizationtogether-aitutorial
SliceGPT Guide: Post-Training Structured LLM Pruning

Master SliceGPT: explore computational invariance, principal dimension slicing, zero-overhead dense matrix reduction, and 30% parameter compression.

slicegptmodel-pruningstructured-compressionllm-inferencecomputational-invariancepcatutorial
SpecExec Guide: Speculative Execution for LLM Agents

Master SpecExec in 2026: explore speculative tool execution, transactional sandboxing, branch pruning, and accelerating AI agent latency by up to 2.8x.

specexecai-agentsspeculative-executionllm-inferencelatency-optimizationtool-usetutorial
SpQR Guide: Near-Lossless 3-Bit LLM Weight Compression

Master SpQR in 2026: explore sparse outlier isolation, bi-level tile quantization, near-lossless 3-bit LLM compression, and high-speed memory-bound GPU kernels.

spqrquantizationllm-compressionsparse-matrixgpu-kernelsmodel-servingtutorial
Star-Attention Guide: Million-Token Context Scaling

Master Star-Attention: explore two-phase star topologies, anchor token compression, 11x faster inference, and million-token distributed LLM serving.

star-attentionlong-contextdistributed-trainingllm-inferenceattention-mechanismsequence-parallelismtutorial
SVDQuant Guide: 4-Bit DiT Acceleration & Outlier Absorption

Master SVDQuant in 2026: explore low-rank outlier absorption, 4-bit Diffusion Transformers, the Nunchaku inference engine, and sub-7GB FLUX.1 GPU serving.

svdquantquantizationdiffusion-transformersfluxnunchakugpu-optimizationtutorial
Token Merging (ToMe) Guide: 2x Faster ViT & Diffusion Models

Master Token Merging (ToMe) in 2026: explore bipartite soft matching, proportional attention, 2x faster ViT inference, and training-free diffusion acceleration.

tometoken-mergingvision-transformersdiffusion-modelsinference-accelerationmeta-aitutorial
TripoSR Guide: Fast 3D Object Reconstruction in Under 0.5s

Master Stability AI TripoSR in 2026: explore DINOv2 vision encoding, feed-forward triplane transformers, NeRF fields, and sub-second 3D mesh generation.

triposr3d-generationnerfcomputer-visionmesh-reconstructionstability-aitutorial
AlphaFold 3 Guide: All-Atom Biomolecular Diffusion AI

Master DeepMind AlphaFold 3 in 2026: explore Pairformer architecture, all-atom 3D diffusion modules, protein-ligand complexes, and drug discovery.

alphafold-3structural-biologydiffusion-modelspairformerbiomolecular-aidrug-discoverytutorial
AppAgent Guide: Multimodal Smartphone GUI Agents

Master Tencent AppAgent in 2026: explore autonomous mobile app exploration, touch gesture action spaces, visual reflection, and Android automation.

appagentmobile-agentsvision-language-modelssmartphone-automationgui-agentsandroidtutorial
Aria Guide: Open Multimodal Native MoE Architecture

Master Rhymes AI Aria in 2026: explore native multimodal Mixture-of-Experts, 3.9B activated parameters, 64K context window, and high-efficiency video AI.

ariamultimodalmixture-of-expertsrhymes-aivlm-architecturevideo-aitutorial
AudioLDM 2 Guide: Universal Text-to-Audio Generation

Master AudioLDM 2 in 2026: explore Language of Audio (LOA) representations, latent diffusion modeling, sound effects, and Foley AI generation.

audioldm-2audio-generationsound-effectslatent-diffusionmultimodal-aifoley-generationtutorial
Cartesia Sonic Guide: State-Space Real-Time Voice AI

Master Cartesia Sonic in 2026: explore State-Space Models for audio, sub-100ms TTS streaming latency, SSM neural codecs, and real-time voice agents.

cartesiavoice-aistate-space-modelsmambatext-to-speechaudio-synthesistutorial
Depth Pro Guide: Sharp Monocular Metric Depth in 0.3s

Master Apple Depth Pro in 2026: explore multi-scale ViT backbones, zero-shot focal length estimation, razor-sharp metric depth, and sub-second 3D vision.

depth-procomputer-visionmetric-depthspatial-aiapple-research3d-visiontutorial
Diffusion-DPO Guide: Direct Preference Optimization for AI

Master Diffusion-DPO in 2026: explore direct preference alignment for text-to-image models, eliminating RL reward models with closed-form loss.

diffusion-dpodiffusion-modelsdporeinforcement-learninggenerative-aitext-to-imagetutorial
FastSAM Guide: Real-Time Segment Anything at 50 FPS

Master FastSAM in 2026: explore YOLOv8-seg instance architecture, 32 prototype masks, 50 FPS real-time speed, and zero-shot promptable segmentation.

fastsamsegment-anythingcomputer-visioninstance-segmentationyolov8real-time-aitutorial
JanusFlow Guide: Unified Multimodal Understanding & Flow

Master DeepSeek JanusFlow in 2026: explore unifying autoregressive understanding and rectified flow generation within a single LLM architecture.

janusflowdeepseekmultimodalrectified-flowflow-matchingvision-languagetutorial
LightGlue Guide: Real-Time Local Feature Matching AI

Master LightGlue in 2026: explore adaptive transformer depth, dynamic keypoint pruning, sub-10ms matching, and replacing SuperGlue for vision AI.

lightgluecomputer-visionfeature-matchingsuperpointslamtransformerstutorial
LLaMA-Omni Guide: Real-Time Speech-to-Speech Voice AI

Master LLaMA-Omni in 2026: explore end-to-end speech interaction, sub-250ms voice latency, streaming speech decoders, and Llama-3.1 integration.

llama-omnivoice-aispeech-to-speechllama-3-1whispermultimodaltutorial
LongWriter Guide: 10,000+ Word Output Generation AI

Master LongWriter in 2026: explore AgentWrite decomposition, 10k+ word generation, LongWriter-6k SFT, and breaking the 2,000-word LLM output ceiling.

longwriterlong-contextagentwritellm-generationultra-long-texttsinghua-aitutorial
MemoRAG Guide: Memory-Augmented Information Retrieval

Master MemoRAG in 2026: explore working memory models, clue-guided retrieval, global long-context synthesis, and ultra-accurate enterprise RAG.

memoragraglong-contextworking-memoryllm-retrievalvector-databasetutorial
MoE-Infinity Guide: Activation-Aware MoE Offloading AI

Master MoE-Infinity in 2026: explore activation-aware expert caching, predictive PCIe prefetching, and serving 100B+ MoE models on a single GPU.

moe-infinitymixture-of-expertsmoellm-inferencegpu-offloadingpcie-optimizationtutorial
NV-Embed-v2 Guide: Generalist Embedding Model for RAG

Master NVIDIA NV-Embed-v2 in 2026: explore latent attention pooling, bidirectional Mistral-7B backbones, MTEB benchmarks, and enterprise RAG retrieval.

nv-embed-v2embedding-modelsrag-retrievalnvidialatent-attentionmtebtutorial
olmOCR Guide: Scalable PDF-to-Markdown with Vision AI

Master Ai2 olmOCR in 2026: explore fine-tuned Vision-Language Models, anchor text conditioning, LaTeX tables, and low-cost PDF parsing at scale.

olmocrdocument-aipdf-to-markdownvision-language-modelsragopen-source-aitutorial
OmniGlue Guide: Generalizable Vision Feature Matching AI

Master Google OmniGlue in 2026: explore DINOv2 foundation model guidance, cross-domain feature matching, and zero-shot geometric correspondence.

omnigluecomputer-visionfeature-matchingdinov2superpointgoogle-researchtutorial
OpenCodeInterpreter Guide: Code Generation with Execution

Master OpenCodeInterpreter in 2026: explore closed-loop code generation, execution feedback, automated debugging, and self-healing AI agents.

opencodeinterpretercode-generationai-agentsexecution-feedbackself-healing-codepythontutorial
OpenRLHF Guide: Scalable Ray & vLLM Alignment AI

Master OpenRLHF in 2026: explore Ray distributed orchestration, vLLM rollout acceleration, DeepSpeed ZeRO-3 training, and 70B+ GRPO post-training.

openrlhfrlhfreinforcement-learningrayvllmdeepspeedllm-alignmenttutorial
Sana Guide: Linear Diffusion Transformer 4K Image AI

Master NVIDIA Sana in 2026: explore Linear DiT, DC-AE 32x deep compression, Gemma-2 text encoding, and sub-second 4K generative flow matching.

sanadiffusion-transformerditcomputer-visiongenerative-aiimage-synthesistutorial
Toolformer Guide: How LLMs Teach Themselves Tool Calling

Master Meta Toolformer in 2026: explore self-supervised API calling, loss-filtering bootstrapping, tool-use execution, and autonomous AI agents.

toolformertool-callingfunction-callingai-agentsapi-integrationself-supervised-learningtutorial
TRELLIS Guide: Structured 3D Latents for Scalable AI

Master Microsoft TRELLIS in 2026: explore Structured 3D Latents, Rectified Flow transformers, Gaussian splats, and clean textured mesh generation.

trellis3d-generationgaussian-splattingcomputer-visionmesh-generationdiffusion-transformerstutorial
V-STaR Guide: Training Verifiers for Reasoning LLMs

Master V-STaR in 2026: explore self-taught reasoning loops, negative trajectory verification, test-time compute scaling, and Best-of-N reranking.

v-starreasoning-modelsverifierstest-time-computereinforcement-learningai-agentstutorial
WebVoyager Guide: End-to-End Multimodal Web Agents

Master WebVoyager in 2026: explore multimodal web agents, visual action spaces, Set-of-Mark grounding, and autonomous web browsing automation.

webvoyagerweb-agentsvision-language-modelsweb-scrapingautonomous-agentsbrowser-automationtutorial
AdalFlow Guide: Auto-Optimizing Compound AI Systems

Master AdalFlow in 2026: explore PyTorch-like modular design, declarative pipelines, auto-prompt optimization, and hardware-efficient AI architectures.

adalflowcompound-aiprompt-optimizationllm-frameworkragpythontutorial
AgentOps Guide: AI Agent Observability & Session Replay

Master AgentOps in 2026: explore autonomous agent observability, time-travel session replay, recursive loop detection, multi-agent tracking, and evals.

agentopsai-agentsllm-observabilitysession-replaycrewailanggraphtutorial
Bamba Guide: Hybrid Mamba2-Transformer 9B Architecture

Master IBM Bamba-9B in 2026: explore hybrid Mamba2 state space duality, 3 strategic full attention layers, 80% KV cache reduction, and linear-time inference.

bambamamba2hybrid-modelsstate-space-modelsibm-researchllm-inferencetutorial
ChatTTS Guide: Conversational Voice AI & Prosody Control

Master ChatTTS in 2026: explore conversational text-to-speech architecture, laughter injection, spontaneous prosody control, and streaming voice agents.

chatttsvoice-aitext-to-speechconversational-aiaudio-generationpythontutorial
Command R+ Guide: Enterprise RAG & Grounded Citations

Master Cohere Command R+ in 2026: explore native grounded citations, multi-step tool use, 128K context, and scalable enterprise RAG deployment.

command-r-pluscohereraggrounded-citationstool-useenterprise-aitutorial
CoTracker3 Guide: Dense Point Tracking in Video with AI

Master Meta CoTracker3 in 2026: explore Transformer point tracking, sliding-window cross-attention, real video pseudo-labeling, and spatial AI.

cotracker3point-trackingcomputer-visionvideo-aitransformersspatial-aitutorial
DeepSeek-Math Guide: Mathematical Reasoning and GRPO

Master DeepSeek-Math in 2026: explore Group Relative Policy Optimization (GRPO), math web corpus filtering, and tool-integrated code reasoning.

deepseek-mathgrporeinforcement-learningmathematical-reasoningai-agentsopen-source-llmtutorial
Denser Retriever Guide: Hybrid Search & ML Reranking

Master Denser Retriever in 2026: explore dual vector-keyword retrieval, gradient-boosted XGBoost score fusion, and ML cross-reranking for enterprise RAG.

denser-retrieverhybrid-searchragxgboostvector-databaseelasticsearchtutorial
Depth Anything V2 Guide: Monocular Depth Foundation Model

Master Depth Anything V2 in 2026: explore DINOv2 backbones, synthetic teacher distillation, metric depth estimation, and real-time spatial AI.

depth-anything-v2computer-visiondepth-estimationdinov2spatial-ai3d-visiontutorial
GLM-4-Voice Guide: End-to-End Speech-to-Speech AI

Master GLM-4-Voice in 2026: explore end-to-end speech tokenization, Flow Matching acoustic decoders, emotion control, and real-time voice agents.

glm-4-voicespeech-to-speechvoice-aiflow-matchingmultimodal-aiai-agentstutorial
MiniMax-01 Guide: 456B MoE & 4M Lightning Attention

Master MiniMax-01 in 2026: discover how Lightning Attention, intra-block tiling, linear complexity, and 4M context scale long-sequence MoE foundation models.

minimax-01lightning-attentionlinear-attentionmixture-of-expertslong-contextfoundation-modelstutorial
Molmo Guide: Open-Weights VLM with Point Grounding

Master Ai2 Molmo in 2026: explore how open-weights vision architectures, PixMo data, and direct 2D point grounding beat proprietary frontier VLMs.

molmovision-language-modelsmultimodalpoint-groundingallen-institute-for-aivlm-architecturetutorial
OmniParser Guide: Screen Parsing for Vision GUI Agents

Master Microsoft OmniParser in 2026: explore YOLOv8 UI detection, icon captioning, visual grounding, and high-accuracy desktop GUI agent automation.

omniparsergui-agentsvision-language-modelsweb-scrapingcomputer-useai-agentstutorial
OpenManus Guide: Autonomous General AI Agent Architecture

Master OpenManus in 2026: explore open-source autonomous general agent architecture, dual-stage planning, Playwright browser loops, and local LLM execution.

openmanusai-agentsautonomous-agentsbrowser-automationplaywrightlocal-llmtutorial
Polars Guide: High-Performance DataFrames for AI Pipelines

Master Polars in 2026: explore Rust-powered columnar DataFrames, lazy query optimization, out-of-core streaming, and zero-copy Apache Arrow AI data pipelines.

polarsdata-engineeringai-pipelinesdataframesrustapache-arrowtutorial
Promptfoo Guide: Automated LLM Red Teaming & CI/CD Evals

Master Promptfoo in 2026: explore automated LLM red teaming, prompt injection defense, assertion matrix testing, and CI/CD pipeline integration.

promptfoollm-red-teamingai-securityprompt-evaluationci-cdprompt-injectiontutorial
Step-Video-T2V Guide: 30B Open Video DiT Architecture

Master Step-Video-T2V in 2026: explore 30B Diffusion Transformers, deep compression 3D VAEs, bilingual LLM encoders, and high-fidelity video AI.

step-video-t2vvideo-generationdiffusion-transformerflow-matchinggenerative-aideep-compression-vaetutorial
Tabby Guide: Self-Hosted AI Coding Assistant Architecture

Master Tabby in 2026: explore self-hosted AI code completion, Fill-In-The-Middle (FIM) inference, Tree-sitter codebase indexing, and enterprise IP privacy.

tabbyai-code-assistantself-hosted-aideveloper-toolslocal-llmtree-sittertutorial
TabPFN Guide: Tabular Foundation Models & In-Context AI

Master TabPFN in 2026: explore Prior-Data Fitted Networks, Bayesian posterior approximation, two-way structural attention, and zero-tuning tabular AI.

tabpfntabular-foundation-modelsin-context-learningbayesian-inferencemachine-learningxgboosttutorial
TiTok Guide: ByteDance 1D 32-Token Visual Architecture

Master ByteDance TiTok in 2026: explore how 1D visual tokenization compresses images into 32 discrete tokens, slashing sequence lengths and generation latency.

titokvisual-tokenizercomputer-visionmultimodalbytedanceautoregressive-modelstutorial
Meta Transfusion Guide: Unified Token & Diffusion Models

Master Meta Transfusion in 2026: discover how unifying next-token language modeling with continuous image diffusion creates native mixed-modal AI models.

transfusionmultimodaldiffusionfoundation-modelsmeta-aicomputer-visiontutorial
Unstructured.io Guide: Document Partitioning & RAG ETL

Master Unstructured.io in 2026: explore multi-format document partitioning, vision layout models, chunking-by-title, and enterprise RAG ingestion pipelines.

unstructureddocument-processingragdocument-partitioningdata-engineeringpythontutorial
Whisper-Medusa Guide: Fast Speculative Speech Recognition

Master Whisper-Medusa in 2026: explore multi-head speculative decoding, single-model drafting, tree verification, and 2.5x faster ASR with zero accuracy loss.

whisper-medusawhisperspeech-to-textspeculative-decodingasraudio-transcriptiontutorial
BAML Guide: Type-Safe Structured AI Output Architecture

Master BAML in 2026: discover how schema-aligned parsing, type-safe DSL compilation, and partial streaming eliminate fragile JSON extraction for AI agents.

bamlstructured-outputstype-safetyai-agentsjson-parsingstreamingtutorial
Cline Guide: Autonomous Coding Agent & MCP Architecture

Master Cline in 2026: explore autonomous coding agent loops, Model Context Protocol (MCP) tool extensibility, diff editing, and terminal test self-correction.

clineai-agentscoding-assistantmcpdeveloper-toolsvs-codetutorial
Codestral Guide: Mistral 22B Open Code LLM Architecture

Master Codestral in 2026: explore Mistral 22B code architecture, Fill-in-the-Middle infilling, 32K context, Codestral Mamba, and local vLLM serving.

codestralmistral-aicode-llmfill-in-the-middlemambavllmtutorial
GLM-4-9B Guide: 1M Context & Multimodal Architecture

Master GLM-4-9B in 2026: explore Zhipu AI 1M-token context window, GLM-4V high-resolution vision, native tool calling, and local vLLM serving.

glm-4glm-4vopen-weightslong-contextmultimodalvllmtutorial
GPTCache Guide: Semantic Caching Architecture for LLM Apps

Master GPTCache in 2026: explore semantic query caching, vector similarity evaluation, scalar-vector storage, and sub-15ms latency for production LLMs.

gptcachesemantic-cachingllm-optimizationvector-searchai-agentsragtutorial
InternVL 2.5 Guide: Multimodal Vision Architecture

Master InternVL 2.5 in 2026: explore dynamic high-resolution ViT tiling, pixel-shuffle token compression, GUI navigation, and 4K visual document AI.

internvlmultimodalvision-language-modelsvlm-architecturegui-agentdocument-aitutorial
LightLLM Guide: Triton Kernels & Tri-Process Architecture

Master LightLLM in 2026: explore pure Triton TokenAttention, Tri-Process GIL elimination, Prefill-Decode disaggregation, and high-speed serving.

lightllmtritonllm-servinginference-optimizationtokenattentionkv-cachetutorial
Mini-Omni Guide: Real-Time Speech-to-Speech Architecture

Master Mini-Omni in 2026: explore end-to-end speech-to-speech modeling, Text-Instructed Delayed Parallel Decoding, SNAC tokens, and sub-250ms voice AI.

mini-omnispeech-to-speechvoice-aimultimodalsnacreal-time-aitutorial
MobileLLM Guide: Deep & Thin On-Device Architecture for AI

Master Meta MobileLLM in 2026: explore deep-and-thin architectures, immediate-block weight sharing, GQA, and sub-billion parameter on-device AI inference.

mobilellmon-device-aiedge-aismall-language-modelsweight-sharingtransformer-architecturetutorial
Open-WebUI Guide: Self-Hosted AI Interface & Pipelines

Master Open-WebUI in 2026: explore self-hosted LLM orchestration, Python Pipelines middleware, local document RAG, multi-model routing, and enterprise RBAC.

open-webuiself-hosted-ailocal-llmollamaragai-pipelinestutorial
OpenELM Guide: Layer-Wise Non-Uniform Scaling for Edge AI

Master Apple OpenELM in 2026: explore layer-wise non-uniform parameter scaling, CoreNet pre-training, GQA, and sub-3B on-device foundation model inference.

openelmappleon-device-aismall-language-modelslayer-wise-scalingtransformer-architecturetutorial
Qwen2-Audio Guide: Auditory Language Model Architecture

Master Qwen2-Audio in 2026: explore native audio-language modeling, dual-mode voice chat, acoustic scene analysis, and multi-task auditory AI.

qwen2-audioaudio-aispeech-to-textmultimodalvoice-chatacoustic-aitutorial
Semantic Kernel Guide: Enterprise AI Agent Architecture

Master Microsoft Semantic Kernel in 2026: explore kernel plugins, function filters, vector memory connectors, and enterprise agent orchestration in Python.

semantic-kernelmicrosoftai-agentsenterprise-aipythonllm-orchestrationragtutorial
verl Guide: Volcano Engine RL Framework for LLMs

Master verl in 2026: explore Volcano Engine RL for LLMs, hybrid vLLM and FSDP integration, GRPO training, and scalable reasoning post-training.

verlreinforcement-learningrlhfgrpodeepseek-r1vllmtutorial
Whisper.cpp Guide: High-Performance C/C++ Speech AI

Master Whisper.cpp in 2026: explore pure C/C++ ASR, GGML quantization, Apple Metal and CoreML acceleration, and real-time streaming speech AI.

whisper-cppggmlspeech-to-textasron-device-aiedge-aitutorial
Agent S Guide: Autonomous GUI Computer-Use Architecture

Master Agent S in 2026: explore experience-augmented hierarchical planning, Agent-Computer Interfaces (ACI), OSWorld benchmarks, and desktop GUI automation.

agent-scomputer-usegui-automationosworldai-agentsmultimodaltutorial
Apple MLX Guide: Unified Memory AI on Apple Silicon

Master Apple MLX in 2026: explore unified memory architecture, lazy evaluation, Metal kernel compilation, and mlx-lm for high-speed local AI on Mac.

mlxapple-siliconlocal-llmunified-memorymetalmlx-lmquantizationtutorial
Arize Phoenix Guide: OpenTelemetry Tracing & LLM Evals

Master Arize Phoenix in 2026: explore OpenTelemetry tracing, LLM-as-a-judge evals, UMAP embedding visualization, and RAG observability for AI applications.

arize-phoenixllm-observabilityopentelemetryrag-evaluationai-agentsevalstutorial
CogVideoX Architecture: 3D VAE & Expert DiT Video Guide

Master CogVideoX in 2026: explore the 3D causal VAE, Expert Diffusion Transformer, 3D RoPE, and 1080p cinematic video generation with Hugging Face Diffusers.

cogvideoxvideo-generationdiffusion-transformersdit3d-vaemultimodaltutorial
Continue.dev Guide: Open-Source AI Code Assistant Engine

Master Continue.dev in 2026: explore Fill-In-The-Middle (FIM) tab autocomplete, AST codebase indexing, LanceDB vector search, and multi-model routing for IDEs.

continue-devai-code-assistantdeveloper-toolslocal-llmollamatree-sittertutorial
CosyVoice 2 Guide: Scalable Streaming Speech Synthesis

Master Alibaba CosyVoice 2 in 2026: explore LLM tokens, chunk-aware streaming flow matching, 150ms latency, zero-shot voice cloning, and prosody control.

cosyvoicespeech-synthesisttsflow-matchingvoice-cloningaudio-aitutorial
E2B Guide: Firecracker MicroVM Sandboxes for AI Agents

Master E2B in 2026: explore Firecracker microVM sandboxing, sub-150ms cold starts, secure agent code execution, and rich artifact streaming for autonomous AI.

e2bai-agentssandboxingfirecrackermicrovmcode-interpretersecuritytutorial
Fish Speech Guide: Dual-AR Multilingual TTS Architecture

Master Fish Speech in 2026: explore the Dual-AR transformer architecture, Firefly-GAN vocoder, 44.1kHz studio synthesis, and zero-shot voice cloning.

fish-speechttsspeech-synthesisdual-arvoice-cloningfirefly-ganaudio-aitutorial
Hugging Face TRL: Full-Stack SFT, DPO & GRPO Guide

Master Hugging Face TRL in 2026: explore SFTTrainer, DPOTrainer, GRPOTrainer for reasoning models, vLLM rollout co-location, and full post-training alignment.

trlhugging-facepost-traininggrpodporeinforcement-learningtutorial
HunyuanVideo Guide: 13B Open-Source DiT Video Architecture

Master Tencent HunyuanVideo in 2026: explore the 13B dual-stream DiT, 3D causal VAE, MLLM text encoder, and flow matching for high-definition video generation.

hunyuanvideovideo-generationdiffusion-transformersflow-matchingmllmmultimodaltutorial
Infinity Guide: High-Throughput Embeddings & Reranking

Master Infinity in 2026: explore dynamic batching, FlashAttention unpadding, ONNX/TensorRT backends, and sub-5ms embedding and reranking serving.

infinityembeddingsrerankingragmodel-servingflashattentiontensorrttutorial
Janus-Pro: Decoupled Multimodal AI Architecture Guide

Master DeepSeek Janus-Pro in 2026: explore decoupled visual encoding, SigLIP semantic tokens, VQ generation, and unified 1B/7B multimodal intelligence.

janus-prodeepseekmultimodalvision-language-modelsimage-generationautoregressivetutorial
llama.cpp Architecture: C++ Local LLM Inference Guide

Master llama.cpp in 2026: explore the GGML tensor library, mmap cold starts, layer-by-layer GPU offloading, FlashAttention, and high-concurrency llama-server.

llamacppggmllocal-llmcppgpu-offloadingllm-inferencetutorial
Megatron-Core Guide: 5D Distributed Training Architecture

Master NVIDIA Megatron-Core in 2026: explore Tensor, Sequence, Context, Pipeline Parallelism, 1F1B scheduling, Distributed Optimizer, and FP8 acceleration.

megatron-coredistributed-trainingtensor-parallelismpipeline-parallelismcontext-parallelismnvidiafp8tutorial
Milvus 2.5 Guide: BM25 Full-Text Search & Milvus Lite

Master Milvus 2.5 in 2026: explore native Sparse-BM25 full-text search, multi-vector hybrid reranking, Knowhere C++, and embedded Milvus Lite for RAG.

milvusmilvus-litevector-databasefull-text-searchhybrid-searchragtutorial
NVIDIA Cosmos: World Foundation Models for Physical AI

Master NVIDIA Cosmos in 2026: explore causal video tokenizers, Cosmos-Diffusion, Cosmos-Autoregressive, and physical AI world simulation for robotics.

nvidiacosmosphysical-aiworld-modelsroboticsdiffusiontutorial
Ovis Guide: Structural Visual Alignment Architecture

Master Ovis in 2026: explore structural visual alignment, probabilistic visual tokenization, native-resolution NaViT, and zero-hallucination document OCR.

ovismultimodalmllmvisual-alignmentdocument-aiocrcomputer-visiontutorial
Pydantic Logfire Guide: OpenTelemetry Tracing for AI

Master Pydantic Logfire in 2026: explore OpenTelemetry tracing, schema validation tracking, SQL analytics, and full-stack observability for AI agents.

pydantic-logfirelogfireopentelemetryobservabilityai-agentspythontracingtutorial
RAGFlow Guide: Deep Document Understanding & Agentic RAG

Master RAGFlow in 2026: explore DeepDoc vision layout analysis, template-based chunking, visual bounding box citations, and hybrid search for enterprise RAG.

ragflowragdocument-understandinglayout-analysishybrid-searchai-agentstutorial
RouteLLM Guide: Dynamic LLM Routing & Cost Optimization

Master RouteLLM in 2026: explore LMSYS preference routing, matrix factorization, BERT classifiers, and cost-quality calibration to cut LLM bills by 80%.

routellmlmsysllm-routingcost-optimizationai-agentsmatrix-factorizationopen-sourcetutorial
TensorRT-LLM Guide: High-Throughput GPU Inference Engine

Master NVIDIA TensorRT-LLM in 2026: explore in-flight batching, paged KV caching, FP8 GEMM, and C++ runtimes for high-throughput enterprise LLM serving.

tensorrt-llmnvidiallm-inferencegpu-optimizationpaged-attentionin-flight-batchingtutorial
vLLM-Omni Guide: Disaggregated Multimodal Model Serving

Master vLLM-Omni in 2026: explore disaggregated serving, asynchronous inter-stage streaming, PagedAttention for audio/vision, and sub-200ms voice pipelines.

vllm-omnivllmmultimodalllm-servingspeech-to-speechvoice-aidisaggregated-servingtutorial
Weaviate Guide: Hybrid Vector Search & Multi-Tenancy

Master Weaviate in 2026: explore native multi-tenancy, HNSW and BM25 hybrid search, binary quantization (BQ), and the Python v4 gRPC client for scalable AI.

weaviatevector-databasehybrid-searchmulti-tenancyquantizationragtutorial
Agentless: Deterministic Software Engineering LLM Guide

Master Agentless in 2026: explore how hierarchical fault localization, patch synthesis, and test validation beat complex SWE-bench agents at 10x lower cost.

agentlessswe-benchai-codingsoftware-engineeringllm-agentsfault-localizationtutorial
Agno Guide: High-Performance Multi-Agent Architecture

Master Agno in 2026: explore microsecond agent runtimes, native Team collaboration, multi-tier memory, and MCP integrations for enterprise multi-agent AI.

agnoai-agentsmulti-agentpythonllm-orchestrationragtutorial
Emu3 Guide: Next-Token Prediction for Vision & Language

Master BAAI Emu3 in 2026: see how a single autoregressive transformer unifies vision understanding, image generation, and video via pure next-token prediction.

emu3multimodalautoregressivevision-language-modelsimage-generationvideo-generationtutorial
F5-TTS Guide: Non-Autoregressive Flow-Matching Speech AI

Master F5-TTS in 2026: explore how non-autoregressive Flow Matching, DiT backbones, Sway Sampling, and zero-shot voice cloning revolutionize speech synthesis.

f5-ttstext-to-speechvoice-cloningflow-matchingdiffusion-transformersspeech-aitutorial
FastMCP Guide: High-Performance Python MCP Servers

Master FastMCP in 2026: learn how to build production Model Context Protocol servers in Python with typed tools, dynamic resources, SSE, and aiFetchly.

fastmcpmcpmodel-context-protocolai-agentspythonpydantictutorial
GOT-OCR 2.0: General OCR Theory 580M Architecture Guide

Master GOT-OCR 2.0 in 2026: explore how a unified 580M encoder-decoder replaces cascaded pipelines for scene text, LaTeX, tables, and document AI.

got-ocrocrvision-language-modelsdocument-ailatex-ocrtable-extractiontutorial
Haystack Guide: Composable RAG Pipeline Architecture

Master Haystack 2.0 in 2026: explore typed component sockets, explicit DAG pipelines, cyclic agent loops, and enterprise document stores for production RAG.

haystackragai-agentspipeline-architecturedeepsetvector-databasetutorial
Langfuse Guide: Open-Source LLM Observability & Tracing

Master Langfuse in 2026: explore distributed agent tracing, OpenTelemetry spans, automated LLM-as-a-judge evals, and prompt versioning for production AI.

langfuseobservabilityllm-tracingai-agentsopentelemetryevaluationstutorial
LeRobot Guide: Open-Source AI for Real-World Robotics

Master Hugging Face LeRobot in 2026: explore low-cost SO-100 arms, ACT, Diffusion Policy, and Hub datasets to train real-world physical robot agents.

lerobotroboticsphysical-aiimitation-learningactdiffusion-policytutorial
LLMLingua Guide: Prompt Compression for Fast RAG

Master LLMLingua in 2026: explore how perplexity-aware token pruning, budget control, and query-guided re-ranking compress prompts up to 20x for faster RAG.

llmlinguaprompt-compressionraglong-contextllm-inferencecost-optimizationtutorial
LMCache Guide: Multi-Tier KV Cache Layer for vLLM

Master LMCache in 2026: explore how hierarchical CPU-SSD memory pools, pipelined prefetching, and cross-worker cache sharing speed up vLLM TTFT by 10x.

lmcachevllmkv-cachellm-servinggpu-optimizationdistributed-systemstutorial
Magentic-One Guide: Generalist Multi-Agent Web & Code AI

Master Magentic-One in 2026: explore how Microsoft dual-loop ledgers, WebSurfer, FileSurfer, and Coder agents solve complex multi-step web and coding tasks.

magentic-oneautogenai-agentsmulti-agent-systemsweb-agentscode-executiontutorial
Moondream 2 Guide: Tiny 1.86B Vision AI for Edge Devices

Master Moondream 2 in 2026: explore how the 1.86B parameter VLM combines SigLIP, Phi-1.5, visual grounding, and sub-second CPU inference for local AI pipelines.

moondreamvision-language-modelsedge-aion-device-aivlmmultimodaltutorial
Moonlight 16B Guide: 3B-Active MoE Trained with Muon

Master Moonlight 16B: explore how Moonshot AI scaled the Muon optimizer across 5.7T tokens to build a 3B-active MoE matching 8B-14B models on edge hardware.

moonlight-16bmoonshot-aimoemuon-optimizermixture-of-expertsedge-aitutorial
PaliGemma 2 Guide: Google Vision-Language Architecture

Master PaliGemma 2 in 2026: explore how SigLIP-So400m, Gemma 2 backbones, 896px resolution, and location tokens revolutionize document AI and OCR.

paligemma-2google-deepmindvision-language-modelsmultimodalgemma-2document-aitutorial
pgvector Guide: PostgreSQL Vector Search & HNSW Indexing

Master pgvector in 2026: explore HNSW indexing, halfvec fp16 compression, iterative index scans, and SQL hybrid search to unify relational data with AI vectors.

pgvectorpostgresqlvector-databaseraghnswhybrid-searchtutorial
Phi-4 Guide: 14B Reasoning Model & Synthetic Data AI

Master Microsoft Phi-4 in 2026: explore how synthetic data curriculums, multi-turn reasoning, and DPO enable a 14B model to match 70B frontier intelligence.

phi-4microsoftslmsynthetic-datareasoningdpotutorial
Qdrant Guide: Rust-Native Vector Search & Quantization

Master Qdrant in 2026: explore how Rust concurrency, HNSW payload filtering, Binary Quantization, and disk-native mmap storage scale vector search by 32x.

qdrantvector-databaserustquantizationraghnswtutorial
Rig Guide: High-Performance Rust AI Agent Architecture

Master Rig in 2026: explore how Rust's zero-cost abstractions, Tokio concurrency, typed Tool traits, and compile-time safety build ultra-fast AI agents.

rigrustai-agentsllm-orchestrationtype-safetyqdranttutorial
ScrapeGraphAI Guide: Graph-Based Agentic Web Scraping

Master ScrapeGraphAI in 2026: explore how DAG scraping pipelines, DOM pruning, RAG nodes, and ScriptCreatorGraph automate web extraction without brittle CSS.

scrapegraphaiweb-scrapingai-agentsragllm-extractionpydantictutorial
TextGrad Guide: Textual Gradient Descent for AI Agents

Master Stanford TextGrad in 2026: explore how automatic differentiation via text, computational graphs, and textual gradient descent optimize LLM agent systems.

textgradtextual-gradient-descentllm-optimizationai-agentsstanfordbackpropagationtutorial
DeepSeek-Prover-V1.5: Lean 4 Theorem Proving Guide

Master DeepSeek-Prover-V1.5 in 2026: explore how Lean 4 formal verification, RLPAF compiler feedback, and RMaxTS tree search eliminate math hallucinations.

deepseek-proverlean-4formal-verificationtheorem-provingrlpafmctstutorial
DocETL: Agentic Complex Document Processing Guide

Master UC Berkeley's DocETL in 2026: explore agentic query rewriting, semantic operators, and LLM pipeline optimization for complex document processing.

docetldocument-processingllm-pipelinesagentic-workflowsdata-engineeringragtutorial
FastV Guide: Visual Token Pruning for Fast VLM Inference

Master FastV in 2026: discover how pivot layer attention ranking, visual token pruning, and KV eviction cut VLM prefill latency and VRAM by 50%.

fastvvlmvision-language-modelstoken-pruningllm-inferencekv-cachetutorial
Firecrawl Guide: Web Scraping & Crawling API for LLMs

Master Firecrawl in 2026: explore how distributed BullMQ queues, stealth Playwright scrapers, /map URL discovery, and /extract deliver clean LLM markdown.

firecrawlweb-scrapingai-agentsllm-extractionragplaywrighttutorial
FlashRank Guide: Fast Cross-Encoder Reranking for RAG

Master FlashRank in 2026: discover how lightweight ONNX cross-encoders eliminate bi-encoder retrieval errors and boost RAG accuracy with sub-10ms latency.

flashrankrerankingragcross-encoderonnxvector-searchtutorial
IBM Granite 3.0 Guide: Open Enterprise AI & Guardian

Master IBM Granite 3.0 in 2026: explore 8B dense & MoE architectures, Apache 2.0 licensing, and Granite Guardian RAG hallucination guardrails.

ibm-granitegranite-3-0granite-guardianenterprise-airagllm-architecturetutorial
Instructor Guide: Type-Safe Structured LLM Outputs

Master Instructor in 2026: learn how Pydantic validation, client patching, automatic retry loops, and streaming models guarantee typed JSON from any LLM.

instructorpydanticstructured-outputsllm-extractionjson-schemapythontutorial
LiteLLM Guide: Universal AI Gateway & Load Balancing

Master LiteLLM in 2026: explore how the universal proxy, automated fallback routing, virtual key budgets, and multi-provider load balancing unify LLM stacks.

litellmai-gatewayload-balancingllm-proxyinference-optimizationtutorial
LiveKit Agents Guide: Real-Time Multimodal Voice AI

Master LiveKit Agents in 2026: explore WebRTC voice pipelines, Silero VAD turn detection, barge-in interruption handling, and multimodal vision streaming.

livekitvoice-aiwebrtcmultimodalai-agentspythontutorial
Llama Stack Guide: Standardized Agentic AI Architecture

Master Meta Llama Stack in 2026: explore standardized agent loops, pluggable local & cloud providers, native safety shields, and vector memory APIs.

llama-stackmeta-aiai-agentsragllm-architecturesafety-shieldstutorial
Marker Guide: High-Accuracy PDF to Markdown AI

Master Marker in 2026: explore how deep learning layout analysis, Surya OCR, and LaTeX math extraction convert complex PDFs to clean Markdown.

marker-pdfdocument-aipdf-to-markdownsurya-ocrragdata-extractiontutorial
MiniCPM-V 2.6 Guide: 8B Edge Multimodal Vision AI

Master MiniCPM-V 2.6 in 2026: explore how OpenBMB's 8B architecture achieves 75% token compression, GPT-4V parity, and real-time edge video understanding.

minicpm-vvision-language-modelsmultimodaledge-aivideo-understandingon-device-aitutorial
NVIDIA Minitron Guide: Fast LLM Pruning & Distillation

Master NVIDIA Minitron in 2026: discover how structured depth and width pruning with distillation create compact 4B LLMs using 40x less training compute.

minitronnvidiamodel-compressionpruningdistillationsmall-language-modelstutorial
NVLM 1.0: NVIDIA Frontier Multimodal Architecture Guide

Master NVIDIA NVLM 1.0 in 2026: explore the NVLM-H hybrid architecture, dynamic tile tags, GPT-4o vision parity, and zero text degradation in multimodal LLMs.

nvlmnvidiamultimodalvision-language-modelsvlm-architecturegpt-4otutorial
OpenAI Swarm Guide: Lightweight Multi-Agent Orchestration

Master OpenAI Swarm in 2026: explore how stateless agents, routine definitions, and dynamic tool handoffs build ergonomic, lightweight multi-agent AI systems.

openai-swarmai-agentsmulti-agent-systemsagent-orchestrationpythontutorial
Outlines Guide: Fast Grammar-Constrained LLM Generation

Master Outlines in 2026: explore how FSM compilation, regex indexing, and token logit masking guarantee 100% valid JSON and structured LLM outputs.

outlinesstructured-generationfsmconstrained-decodingvllmjson-schematutorial
Semantic Caching Guide: Fast Vector Caching for LLMs

Master semantic caching in 2026: discover how dense vector similarity, dynamic thresholding, and cache evaluators cut LLM latency and API bills by 60%.

semantic-cachinggptcachevector-databasellm-optimizationai-agentsredistutorial
Surya Guide: Multilingual OCR, Layout & Reading Order

Master Surya in 2026: discover how deep learning layout analysis, reading order detection, table parsing, and 90+ language OCR power AI document extraction.

suryaocrdocument-ailayout-analysisreading-orderai-agentstutorial
TorchInductor Guide: PyTorch 2 Compiler & Triton

Master TorchInductor in 2026: explore how TorchDynamo bytecode tracing, AOTAutograd, and fused Triton GPU kernels accelerate PyTorch by up to 2x.

torchinductorpytorch-2torch-compiletritongpu-optimizationdeep-learning-compilertutorial
Tree-sitter Guide: AST Code Chunking for AI Agents

Master Tree-sitter in 2026: explore incremental AST parsing, syntax-aware chunking, repo map generation, and guarded code editing for AI coding agents.

tree-sitterast-parsingcode-ragai-agentssemantic-chunkingcode-intelligencetutorial
V-JEPA: Meta Non-Generative Video Architecture Guide

Master Meta's V-JEPA in 2026: explore how Joint Embedding Predictive Architecture replaces pixel generation with latent feature prediction for fast video AI.

v-jepameta-aivideo-understandingself-supervised-learningcomputer-visionyann-lecuntutorial
Whisper Large-v3-Turbo: Fast Speech AI Guide

Master Whisper Large-v3-Turbo in 2026: explore how OpenAI's 4-layer decoder architecture delivers 8x faster speech transcription with near-zero accuracy loss.

whisperspeech-to-textasropenaion-device-aillm-inferencetutorial
WhisperX Guide: Fast Speech Recognition & Diarization

Master WhisperX in 2026: explore how batched CTranslate2 inference, Wav2Vec2 forced alignment, and pyannote speaker diarization achieve 70x faster ASR.

whisperxspeech-to-textasrdiarizationforced-alignmentctranslate2tutorial
Aider Guide: AI Pair Programming & Repo-Map Architecture

Master Aider in 2026: explore Tree-sitter repo-maps, PageRank symbol indexing, search-replace edit formats, and git-driven autonomous pair programming.

aiderai-codingpair-programmingrepo-maptree-sittergit-automationtutorial
Crawl4AI Guide: Async Web Scraping for LLMs & AI Agents

Master Crawl4AI in 2026: explore async Playwright crawling, heuristic markdown pruning, LLM-driven structured extraction, and stealth anti-bot pipelines.

crawl4aiweb-scrapingai-agentsllm-extractionplaywrightragtutorial
DeepSeek-Coder-V2 Guide: 236B MoE Code Architecture

Master DeepSeek-Coder-V2 in 2026: explore 236B MoE architecture, Multi-Head Latent Attention, 128K context, 338 programming languages, and GPT-4o parity.

deepseek-coder-v2code-llmmoemlasoftware-engineeringswe-benchtutorial
DeepSeek-V3 MLA: Multi-Head Latent Attention Guide

Master DeepSeek-V3 Multi-Head Latent Attention in 2026: explore low-rank KV compression, decoupled RoPE, and matrix absorption cutting KV cache VRAM by 93%.

deepseek-v3mlamulti-head-latent-attentionkv-cachellm-architecturedeepseektutorial
DeepSeek-VL2 Guide: MoE Vision-Language Architecture

Master DeepSeek-VL2 in 2026: explore how dynamic tiling, SigLIP + SAM dual encoders, and DeepSeekMoE deliver cutting-edge multimodal AI and GUI agents.

deepseek-vl2deepseekvision-language-modelsmultimodalmoemixture-of-expertsgui-agentstutorial
DeepSeekMoE Guide: Fine-Grained Experts & Dynamic Routing

Master DeepSeekMoE in 2026: explore fine-grained expert segmentation, shared expert isolation, and auxiliary-loss-free dynamic bias routing for 671B LLMs.

deepseekmoemoemixture-of-expertsdeepseek-v3llm-architecturesparse-computationtutorial
FastRTC Guide: Real-Time WebRTC Voice AI for Python Agents

Master Hugging Face FastRTC in 2026: explore sub-200ms WebRTC voice streaming, Silero VAD barge-in, Opus frame packing, and full-duplex AI agent pipelines.

fastrtcwebrtcvoice-aispeech-to-speechhugging-faceai-agentstutorial
FLUX.1 Guide: Flow Matching, MMDiT & 12B Rectified Flow

Master FLUX.1 in 2026: explore how Black Forest Labs MMDiT, 12B Rectified Flow matching, and 2D-RoPE set new frontiers for open-weights image generation.

flux-1black-forest-labsflow-matchingmmditdiffusion-transformersimage-generationtutorial
Inside aiFetchly Plan Mode: Governing Autonomous Agents

Deep dive into aiFetchly Plan Mode: explore inline plan approvals, live CTX context tracking, file operations diffing, and safe agent execution for developers.

developersai-agentsplan-modecontext-trackingfeature-deep-dive
Kimi k1.5 Guide: Long-Context Multimodal RL Architecture

Master Kimi k1.5 in 2026: explore long-context reinforcement learning, MCTS-free policy optimization, multimodal Long-CoT, and test-time compute scaling.

kimi-k1-5reinforcement-learninglong-contextreasoning-modelsmultimodalllm-alignmenttutorial
Kokoro-82M Guide: Lightweight Open-Source TTS Architecture

Master Kokoro-82M in 2026: explore how StyleTTS 2 diffusion, differentiable duration modeling, and iSTFTNet vocoding deliver studio TTS at 82M parameters.

kokorottstext-to-speechspeech-synthesisedge-aiaudio-modelstutorial
Llama 3.3 70B Guide: Distilling 405B AI into a 70B Model

Master Llama 3.3 70B in 2026: discover how online 405B distillation, synthetic data pipelines, and iterative DPO match frontier AI at 1/5th the compute cost.

llama-3-3llamameta-aiknowledge-distillationllm-architecturesynthetic-datatutorial
LM Studio Guide: Headless LMS CLI & Local AI Serving

Master LM Studio in 2026: explore the headless lms CLI, multi-GPU layer offloading, OpenAI API gateway, and local agent orchestration for desktop workflows.

lm-studiolms-clilocal-llmggufgpu-offloadingai-agentstutorial
Multi-Token Prediction Guide: DeepSeek-V3 MTP Architecture

Master Multi-Token Prediction (MTP) in 2026: explore DeepSeek-V3 sequential MTP modules, dense planning loss, and 1.8x speculative decoding acceleration.

multi-token-predictionmtpdeepseek-v3speculative-decodingllm-trainingllm-architecturetutorial
Nemotron-4 340B Guide: Synthetic Data & Reward Models

Master Nemotron-4 340B in 2026: explore how NVIDIA synthetic data generation, multi-attribute reward modeling, and iterative DPO train frontier-grade SLMs.

nemotron-4nvidiasynthetic-datareward-modelsllm-alignmentdpotutorial
OpenHands Guide: Autonomous AI Software Engineer Framework

Master OpenHands in 2026: explore how event-stream state machines, Dockerized sandboxed runtimes, and CodeAct agents solve complex SWE-bench software tasks.

openhandsopendevinai-agentssoftware-engineeringswe-benchcodeacttutorial
Pixtral 12B Guide: Native Variable-Resolution Vision AI

Master Pixtral 12B in 2026: explore how Mistral native vision encoders, 2D RoPE, arbitrary aspect ratios, and 128K context revolutionize multimodal AI.

pixtralmistral-aivision-language-modelsmultimodalvariable-resolutionvllmtutorial
Pydantic AI Guide: Type-Safe Python Agent Architecture

Master Pydantic AI in 2026: explore type-safe dependency injection, structured validation, ModelRetry self-correction, and Logfire observability for AI agents.

pydantic-aipydanticai-agentspythontype-safetystructured-outputstutorial
Qwen2.5-VL Guide: Dynamic Vision & Agent Architecture

Master Qwen2.5-VL in 2026: explore window attention ViTs, dynamic FPS video grounding, M-RoPE 3D coordinates, and visual agent computer use for automated AI.

qwen2-5-vlvision-language-modelsmultimodalvisual-agentsm-ropedocument-aitutorial
RadixAttention: Tree-Based KV Cache Reuse in SGLang Guide

Master SGLang RadixAttention in 2026: discover how radix tree KV cache reuse, LRU leaf eviction, and cache-aware scheduling slash agent TTFT by up to 80%.

radix-attentionsglangkv-cachellm-inferenceai-agentsvllmtutorial
Speculative Streaming: Fast Draft-Free LLM Acceleration

Master Speculative Streaming in 2026: explore how multi-stream attention, future token prediction, and tree verification deliver 2.8x faster LLM inference.

speculative-streamingspeculative-decodinggoogle-deepmindllm-inferencekv-cacheinference-accelerationtutorial
Stagehand Guide: AI Web Automation with Playwright

Master Stagehand in 2026: explore how act(), extract(), and observe() primitives, self-healing selectors, and Playwright power resilient browser automation.

stagehandbrowserbaseplaywrightweb-scrapingai-agentsbrowser-automationtutorial
Wan 2.1 Guide: Open-Source Video Generation Architecture

Master Wan 2.1 in 2026: explore how 3D causal VAEs, video flow matching, 3D-RoPE, and 14B DiTs rival Sora and Kling for open-weights video generation.

wan-2-1video-generationdiffusion-transformersflow-matching3d-vaetext-to-videotutorial
Anti-Detect Scraping: TLS JA4 & Headless Stealth Guide

Master anti-detect web scraping in 2026: explore how TLS JA4 fingerprinting, CDP leaks, and canvas spoofing are detected and bypassed in AI data pipelines.

web-scrapinganti-detecttls-fingerprintingja4playwrightai-agentstutorial
AutoRound Guide: Advanced Weight-Rounding for LLMs & VLMs

Master AutoRound in 2026: explore how Intel Labs signed gradient descent and block reconstruction optimize 2-bit, 3-bit, and 4-bit LLMs without Hessian errors.

autoroundquantizationintel-labslow-bit-llmvlmvllmtutorial
BitDelta Guide: 1-Bit Delta Quantization for LLM Serving

Master BitDelta in 2026: discover how 1-bit weight delta quantization and scale distillation compress 70B LLMs by 15x for high-throughput multi-tenant serving.

bitdeltaquantization1-bit-llmmulti-tenant-servingmodel-compressionpefttutorial
BitNet b1.58 Guide: 1-Bit LLMs & Ternary Architecture

Master BitNet b1.58 in 2026: explore ternary weights {-1, 0, 1}, absmean quantization, integer addition kernels, and 70x energy-efficient CPU LLM serving.

bitnet1-bit-llmternary-weightsquantizationllm-inferencecpu-inferencetutorial
Cut Cross-Entropy: Memory-Efficient Large-Vocab LLM Guide

Master Cut Cross-Entropy (CCE) in 2026: learn how fused kernels eliminate logit materialization to slash LLM training VRAM by 85% on large vocabularies.

cut-cross-entropyccellm-traininglarge-vocabularygpu-optimizationapple-mltutorial
DeepSeek-R1 Distillation: Reasoning Transfer to Small LLMs

Master DeepSeek-R1 reasoning distillation: explore how 800k reasoning traces transfer SOTA reflection, backtracking, and math capabilities to 1.5B–70B small LLMs.

deepseek-r1distillationreasoning-modelssmall-language-modelsslmtutorial
DeepSeek-R1-Zero Guide: Pure RL Emergent Reasoning

Master DeepSeek-R1-Zero in 2026: discover how pure reinforcement learning on base LLMs unlocks the famous Aha moment, self-verification, and emergent reasoning.

deepseek-r1-zeroreinforcement-learninggrporeasoning-modelsllm-alignmentemergent-abilitiestutorial
Diffusion Forcing: Next-Token Diffusion Architecture Guide

Master Diffusion Forcing in 2026: explore how independent per-token noise levels unify next-token prediction with full-sequence diffusion for infinite rollouts.

diffusion-forcingdiffusion-modelsnext-token-predictionsequence-modelingworld-modelsroboticstutorial
GGUF & K-Quants Guide: Local LLM Quantization

Master GGUF and K-quants in 2026: explore llama.cpp 2-level block scaling, I-matrix calibration, and hybrid VRAM offloading to run 70B LLMs on consumer GPUs.

ggufk-quantsquantizationllama-cpplocal-llmollamatutorial
Graphiti Guide: Temporal Knowledge Graphs for AI Agents

Master Graphiti: explore how bi-temporal knowledge graphs, episodic edges, and dynamic invalidation solve temporal blindness in long-term AI agent memory.

graphitiknowledge-graphstemporal-kgai-agentslong-term-memorytutorial
LanceDB Guide: Disk-Native Serverless Vector Search

Master LanceDB in 2026: explore how the Lance columnar format, disk-native IVF-PQ indexing, and zero-RAM vector search power scalable, serverless AI pipelines.

lancedblancevector-databaseragivf-pqembeddingstutorial
LayerSkip Guide: Early Exit & Self-Speculative Decoding

Master LayerSkip in 2026: explore how layer dropout, early exit loss, and self-speculative decoding with a shared KV cache deliver 2x faster LLM inference.

layerskipself-speculative-decodingearly-exitllm-inferencemeta-fairkv-cachetutorial
LlamaIndex Workflows Guide: Event-Driven AI Agent Systems

Master LlamaIndex Workflows: explore how event-driven architecture, typed event streaming, and async fan-out replace rigid DAGs for resilient multi-agent AI.

llamaindexai-agentsevent-drivenagentic-workflowsmulti-agenttutorial
MinerU Guide: Multimodal PDF Layout & Formula Extraction

Master MinerU in 2026: explore how PDF-Extract-Kit, UniMERNet formula OCR, TableMaster, and topological reading order solve complex document parsing for RAG.

minerupdf-extract-kitdocument-parsingmultimodal-ragunimernetocrtutorial
MInference 1.0 Guide: Dynamic Sparse Attention for 1M Context

Master MInference 1.0: explore how dynamic sparse attention patterns (A-shape, vertical-slash, block-sparse) accelerate 1M prefill by 10x with zero fine-tuning.

minferencesparse-attentionlong-contextllm-inferencetriton-kernelstutorial
Open-R1 Guide: Reproducing DeepSeek-R1 with GRPO & Ray

Master Hugging Face Open-R1 in 2026: explore how open synthetic data, verifiable reward functions, and distributed GRPO on Ray and vLLM replicate DeepSeek-R1.

open-r1deepseek-r1grporeinforcement-learninghugging-facerayvllmtutorial
Prompt Lookup Decoding: Zero-Cost Speculative LLM Guide

Master Prompt Lookup Decoding (PLD) in 2026: explore how n-gram prompt matching delivers 2x-4x faster LLM inference with zero VRAM and no draft model.

prompt-lookup-decodingspeculative-decodingllm-inferencevllmhuggingfacetutorial
Qwen2.5-Math Guide: Tool-Integrated Mathematical Reasoning

Master Qwen2.5-Math in 2026: explore how Tool-Integrated Reasoning (TIR), 500B token pretraining, and Python execution enable 85.9% MATH benchmark accuracy.

qwen2-5-mathmathematical-reasoningtool-integrated-reasoningtirchain-of-thoughtrlhftutorial
Real-Time Voice AI: Full-Duplex Speech-to-Speech Guide

Master real-time voice AI agents in 2026: explore how WebRTC streaming, full-duplex speech-to-speech models, and VAD barge-in deliver sub-300ms conversations.

voice-aispeech-to-speechwebrtcreal-time-agentsfull-duplexfastrtctutorial
Representation Engineering Guide: Top-Down LLM Steering

Master Representation Engineering (RepE) in 2026: learn how LAT reading and control vectors steer LLM honesty, safety, and reasoning without fine-tuning.

representation-engineeringrepemechanistic-interpretabilitymodel-steeringcontrol-vectorsai-safetytutorial
Smolagents Guide: Code-First AI Agents & Execution Sandbox

Master Hugging Face smolagents in 2026: discover how CodeAgent replaces JSON tool calling with Python code actions, AST sandboxing, and 3x faster workflows.

smolagentshugging-faceai-agentscode-agentspython-sandboxgaia-benchmarktutorial
TorchInductor & TorchDynamo: PyTorch 2.5 Compiler Guide

Master PyTorch 2.5 compilation in 2026: explore how TorchDynamo PEP 523 frame evaluation, AOTAutograd, and TorchInductor Triton codegen accelerate LLMs by 2x.

pytorchtorch-compiletorchdynamotorchinductortritondeep-learning-compilerstutorial
XGrammar Guide: Fast Structured Output & JSON Decoding

Master XGrammar in 2026: discover how context-free grammar bitmasks, vocabulary tries, and GPU kernels eliminate structured JSON decoding latency in vLLM.

xgrammarconstrained-decodingstructured-outputsvllmsglangllm-inferencetutorial
AutoGen Architecture: Multi-Agent Conversational Systems

Master Microsoft AutoGen in 2026: explore ConversableAgent design, code execution sandboxes, GroupChat speaker selection, and nested chat agentic workflows.

autogenag2ai-agentsmulti-agent-systemscode-executiontutorial
CrewAI Architecture: Multi-Agent Role-Playing Orchestration

Master CrewAI in 2026: explore role-playing agent design, hierarchical process delegation, task dependency contexts, and multi-tier memory systems for AI.

crewaiai-agentsmulti-agent-systemsagentic-workflowshierarchical-agentstutorial
ESM3 Guide: Generative Biology Foundation Model Architecture

Master ESM3 in 2026: explore how sequence-structure-function tokenization, 3D VQ-VAE, and 98B masked language modeling simulate 500M years of evolution.

esm3biology-aiprotein-designmultimodalgenerative-aievolutionaryscaletutorial
FlexAttention Guide: Custom Fast Attention in PyTorch 2.5

Master FlexAttention in 2026: explore how PyTorch 2.5 unifies custom attention masks, score_mod functions, and block sparsity into fused Triton kernels.

flexattentionpytorchattention-mechanismstritoncuda-optimizationllm-inferencetutorial
Florence-2 Guide: Unified Vision Foundation Model for AI

Master Microsoft Florence-2 in 2026: explore how sequence-to-sequence vision architectures unify OCR, object detection, and spatial grounding in 0.77B params.

florence-2computer-visionmultimodalocrobject-detectionspatial-groundingtutorial
Hymba Guide: NVIDIA Hybrid-Head Mamba & Attention SLM

Master NVIDIA Hymba in 2026: explore parallel hybrid-head Mamba and attention, cross-layer KV sharing, and meta-tokens powering high-efficiency 1.5B SLMs.

hymbanvidiamambastate-space-modelsslmhybrid-architecturetutorial
Jamba Guide: Hybrid Mamba-Transformer & MoE Architecture

Master AI21 Jamba in 2026: explore hybrid Mamba-Transformer blocks, 16-expert MoE layers, 256K context scaling, and 8x smaller KV caches for fast LLM inference.

jambaai21mambamixture-of-expertshybrid-architecturellm-inferencetutorial
LangGraph Architecture: Cyclical Multi-Agent State Machines

Master LangGraph in 2026: explore cyclical state machines, checkpoint persistence, human-in-the-loop interrupts, and multi-agent systems for robust AI.

langgraphai-agentsstate-machinesmulti-agent-systemsagentic-workflowstutorial
MambaVision Guide: Hybrid Mamba-Transformer Vision AI

Master NVIDIA MambaVision in 2026: explore how integrating selective state space models with self-attention delivers 3x faster vision throughput on GPUs.

mambavisioncomputer-visionmambastate-space-modelshybrid-architecturenvidiatutorial
MemGPT Architecture: OS-Inspired Agent Memory Management

Master MemGPT in 2026: explore how OS-inspired virtual memory, core memory editing, archival retrieval, and context paging enable perpetual, stateful AI agents.

memgptlettaai-agentsmemory-managementcontext-windowtutorial
Meta Chameleon Guide: Early-Fusion Mixed-Modal Models

Master Meta Chameleon in 2026: explore early-fusion mixed-modal tokenization, QK-normalization, and unified text-image autoregressive foundation models.

chameleonmeta-aimultimodalearly-fusionvision-language-modelsdiscrete-tokenstutorial
MetaGPT Guide: Multi-Agent Software Development with SOPs

Master MetaGPT in 2026: explore how Standard Operating Procedures (SOPs), role-based agents, and pub-sub message buses turn 1-line prompts into full codebases.

metagptai-agentsmulti-agentsoftware-engineeringsoptutorial
Min-P Sampling Guide: Dynamic LLM Decoding Beyond Top-P

Master Min-P sampling in 2026: explore how dynamic confidence thresholds replace Top-P and Top-K for coherent, hallucination-free LLM text generation.

min-p-samplingllm-decodingtop-pnucleus-samplingllm-inferencevllmtutorial
ModernBERT Guide: 8K Context, FlashAttention & Unpadding

Master ModernBERT in 2026: explore how FlashAttention-2, sequence unpadding, RoPE, and 8,192 context length modernize encoder models for fast RAG retrieval.

modernbertbertencodersflashattentionrag-retrievalembedding-modelstutorial
Moonshine Guide: Fast On-Device Speech-to-Text Architecture

Master Moonshine in 2026: explore how variable-rate audio encoding, RoPE, and dynamic duration chunking replace Whisper for fast, on-device edge speech-to-text.

moonshineuseful-sensorsspeech-to-textwhisperedge-aiaudio-transcriptiontutorial
Moshi Guide: Full-Duplex Real-Time Speech AI Architecture

Master Kyutai Moshi in 2026: explore how Mimi 12.5Hz RVQ neural codecs, Helium 7B transformers, and Inner Monologue enable sub-200ms conversational speech AI.

moshikyutaispeech-aimimifull-duplexvoice-agentsaudio-modelstutorial
OmniGen Guide: Unified In-Context Image Generation Model

Master OmniGen in 2026: explore how unified in-context conditioning replaces ControlNet and IP-Adapter for text-to-image, image editing, and subject fusion.

omnigenbaaimultimodalimage-generationin-context-learningdiffusion-transformertutorial
OpenVLA Guide: Vision-Language-Action Models for Robotics

Master OpenVLA in 2026: explore how open 7B Vision-Language-Action models tokenize continuous 7-DoF robot control and run 10Hz policies on consumer GPUs.

openvlaroboticsvlaembodied-aivision-language-modelsaction-tokenizationtutorial
Qwen2.5-Coder Guide: Open-Source Code LLM Architecture

Master Qwen2.5-Coder in 2026: explore how 5.5T token pre-training, file-level FIM, 128K context, and execution-guided alignment match GPT-4o for coding.

qwen2-5-codercode-llmsoftware-engineeringswe-benchai-agentstutorial
SigLIP Architecture: Sigmoid Loss Vision-Language Models

Master SigLIP in 2026: explore how sigmoid loss replaces softmax CLIP, removes multi-GPU all-gather bottlenecks, and powers models like PaliGemma and OpenVLA.

siglipclipvision-language-modelsmultimodalcontrastive-learningtutorial
SmolLM2 Guide: 11T Token On-Device SLM Architecture

Master SmolLM2 in 2026: explore how 11T token pretraining, FineWeb-Edu curation, 8K context, and on-device tool calling power sub-2B local AI agents.

smollm2slmon-device-aiedge-aihugging-faceagentic-aitutorial
SmolVLM Guide: Compact On-Device Vision-Language Model

Master SmolVLM in 2026: explore how dynamic multi-tile patch decomposition and compact SigLIP encoders bring high-accuracy multimodal AI to edge devices.

smolvlmhugging-facevision-language-modelsedge-aimultimodaldocument-understandingtutorial
Tree of Thoughts: Deliberate LLM Problem Solving Guide

Master Tree of Thoughts (ToT) in 2026: explore how thought decomposition, state evaluation, and BFS/DFS search trees boost complex LLM reasoning by up to 70%.

tree-of-thoughtsprompt-engineeringreasoningllm-searchai-planningtutorial
AI Email Auto-Reply: Grounding Inbound Outreach in RAG

Discover how digital marketers automate inbound email responses in aiFetchly with Knowledge Library grounding, owner voice personas, and human approvals.

digital-marketersemail-marketingauto-replyragproblem-solution
BGE-M3 Explained: Multi-Functionality Hybrid RAG Guide

Master BGE-M3 in 2026: learn how unifying dense vectors, sparse lexical weights, and ColBERT late interaction boosts RAG accuracy across 100+ languages.

bge-m3hybrid-searchragembeddingssparse-retrievalcolberttutorial
CodeAct Guide: Executable Python Code for AI Agents

Master CodeAct in 2026: explore how executable Python actions replace brittle JSON tool calling, reduce token costs, and power autonomous agent workflows.

codeactai-agentstool-usepython-executionopenhandstutorial
Constitutional AI Guide: Automated Alignment & RLAIF

Master Constitutional AI and RLAIF in 2026: learn how automated self-critique, rule-based constitutions, and AI feedback eliminate human annotator bottlenecks.

constitutional-airlaifai-alignmentrlhfanthropicsafetytutorial
DPO Guide: Direct Preference Optimization Beyond RLHF

Master Direct Preference Optimization (DPO) in 2026: explore implicit reward modeling, closed-form loss derivation, beta tuning, and RL-free LLM alignment.

dpodirect-preference-optimizationrlhfllm-alignmentpost-trainingreinforcement-learningtutorial
Dual-Chunk Attention: Training-Free 100k+ Context Guide

Master Dual-Chunk Attention (DCA) in 2026: discover how intra-chunk and inter-chunk position factorizations scale LLMs to 100k+ tokens without fine-tuning.

dual-chunk-attentiondcalong-contextropellm-inferencetutorial
Griffin Guide: RecurrentGemma, RG-LRU & Hybrid Attention

Master Griffin and RecurrentGemma in 2026: explore RG-LRU gated recurrences, local sliding window attention, and constant-memory LLM serving at scale.

griffinrecurrentgemmarg-lrulinear-recurrencetransformer-architecturellm-inferencetutorial
HyDE Guide: Hypothetical Document Embeddings for RAG

Master HyDE in 2026: explore how generating hypothetical document embeddings eliminates query-document asymmetry and boosts zero-shot RAG retrieval accuracy.

hyderagembeddingsvector-searchdense-retrievaltutorial
Inference-Optimal Scaling: Why Over-Training LLMs Wins

Master inference-optimal scaling in 2026: explore why over-training small LLMs past Chinchilla laws cuts serving TCO and maximizes production token efficiency.

scaling-lawschinchillainference-optimizationllm-trainingcost-efficiencytutorial
Llama 3.1 Architecture: 128K Context, GQA & 405B Systems

Master Llama 3.1 in 2026: explore 128K RoPE frequency scaling, Grouped-Query Attention, 4D distributed parallelism, and native FP8 training on 16K GPUs.

llama-3-1meta-aillm-architecturelong-contextdistributed-trainingrope-scalingtutorial
Llama 3.2 Guide: Lightweight Edge & Multimodal Vision

Master Llama 3.2 in 2026: explore 1B/3B structured pruning and distillation for edge devices alongside 11B/90B cross-attention multimodal vision adapters.

llama-3-2meta-aiedge-aimultimodalvision-language-modelsknowledge-distillationtutorial
LongRoPE Guide: Extending Context to 2M Tokens via Search

Master Microsoft LongRoPE in 2026: discover how non-uniform evolutionary frequency search and progressive scaling extend LLM contexts to 2 million tokens.

longroperope-scalinglong-contextllm-architectureevolutionary-searchtutorial
LoRA Guide: Low-Rank Adaptation & PEFT Architecture

Master LoRA in 2026: explore intrinsic rank hypothesis, low-rank decomposition math, alpha scaling, zero-latency weight merging, and efficient LLM fine-tuning.

lorapeftfine-tuningllm-architectureparameter-efficientdeep-learningtutorial
Mixture-of-Depths: Dynamic Compute Allocation in LLMs

Master Mixture-of-Depths (MoD) in 2026: explore how dynamic top-k routing and static token capacity cut transformer FLOPs by 50% with zero quality loss.

mixture-of-depthsmoddynamic-computetransformer-architecturellm-efficiencydeepmindtutorial
Model Merging Guide: MergeKit, TIES, DARE & SLERP

Master LLM model merging in 2026: explore SLERP, TIES, DARE, and MergeKit configurations to combine specialized models without GPUs or training data.

model-mergingmergekitties-mergingdareslerpllm-architecturetutorial
muP Guide: Zero-Shot Hyperparameter Transfer in LLMs

Master Maximal Update Parametrization (muP): discover how coordinate scaling and muTransfer allow zero-shot hyperparameter transfer from small LLMs to 70B+.

mupmaximal-update-parametrizationllm-trainingscaling-lawshyperparameter-tuningtutorial
QLoRA Explained: 4-Bit NormalFloat & PEFT Tuning Guide

Master QLoRA in 2026: explore 4-bit NormalFloat (NF4), Double Quantization, and Paged Optimizers to fine-tune 70B LLMs on a single 48GB GPU with zero loss.

qlorapeftquantizationnf4fine-tuningbitsandbytestutorial
QuIP# Guide: 2-Bit Quantization via E8 Lattice Vectors

Master QuIP# in 2026: explore how randomized Hadamard incoherence and E8 lattice vector quantization run 70B LLMs at 2 bits on a single GPU with zero loss.

quip-sharpquantization2-bit-llme8-latticellm-inferencetutorial
ReAct Pattern Guide: Synergizing Reasoning & Acting in AI

Master the ReAct agent framework in 2026: explore Thought-Action-Observation loops, dynamic error recovery, tool grounding, and autonomous AI subagents.

reactai-agentsagentic-workflowstool-usereasoning-loopautonomous-systemstutorial
RetNet Guide: Retentive Networks & The Impossible Triangle

Master RetNet in 2026: explore multi-scale retention, parallel training, O(1) recurrent inference, and chunkwise recurrence breaking the impossible triangle.

retnetretentive-networkslinear-attentiontransformer-architecturellm-inferencetutorial
RLOO Guide: Critic-Free Online RLHF Alignment for LLMs

Master RLOO (REINFORCE Leave-One-Out) in 2026: discover how critic-free baselines and cohort sampling cut RLHF VRAM by 50% with unbiased policy gradients.

rlooreinforce-leave-one-outrlhfreinforcement-learningllm-alignmenttutorial
SAM 2 Guide: Segment Anything in Video & Streaming Memory

Master SAM 2 in 2026: explore Meta FAIR streaming memory, Hiera multi-scale visual tokens, memory attention banks, and 44 FPS real-time video tracking.

sam-2computer-visionvideo-segmentationmultimodal-aihierastreaming-memorytutorial
Schedule-Free Optimizer: Train LLMs Without LR Decay

Master Schedule-Free optimizers in 2026: explore how Meta FAIR primal-dual averaging eliminates cosine decay, enables continual training, and matches AdamW.

schedule-freeoptimizersadamwllm-trainingmeta-fairtutorial
Sparse Autoencoders Guide: LLM Monosemanticity & Steering

Master Sparse Autoencoders (SAEs) in 2026: explore how overcomplete feature dictionaries resolve neuron superposition and enable precise LLM steering.

sparse-autoencodersmechanistic-interpretabilitymonosemanticitymodel-steeringllm-architecturetutorial
xLSTM Guide: Extended LSTM Architecture & Matrix Memory

Master xLSTM in 2026: explore exponential gating, sLSTM scalar memory mixing, mLSTM matrix associative memory, and parallel training beyond Transformers.

xlstmlstmrecurrent-neural-networkslinear-attentionllm-architecturetutorial
Binary Embeddings: 1-Bit Quantization & Hamming Search

Master Binary Quantization for vector search in 2026: learn how 1-bit embeddings and bitwise POPCNT cut vector DB RAM by 32x with 40x faster query speeds.

binary-quantizationvector-searchembeddingsragvector-databasetutorial
Browser-Use Guide: Vision-Driven Web Agents in 2026

Master Browser-Use in 2026: explore how accessibility tree parsing, visual bounding box grounding, and multi-tab state machines automate complex web tasks.

browser-useweb-agentsautomationvision-language-modelsplaywrighttutorial
Coconut: Latent Space Reasoning & Continuous Thought Guide

Master Meta Coconut in 2026: explore how continuous latent reasoning bypasses the language bottleneck, cuts thinking tokens by 75%, and enables parallel search.

coconutlatent-reasoningchain-of-thoughtllm-reasoningmeta-fairtutorial
Continuous Batching: Iteration-Level LLM Serving Guide

Master Continuous Batching in 2026: see how Orca iteration-level scheduling eliminates padding waste, slashes queue delays, and boosts LLM throughput by 10x.

continuous-batchingorcallm-servingvllminference-optimizationtutorial
DeltaNet: Linear Transformers with the Delta Rule Guide

Master DeltaNet in 2026: explore how the Delta Rule and chunkwise parallel associative scan solve linear attention memory decay with constant O(1) inference.

deltanetlinear-transformersdelta-ruleassociative-memoryllm-architecturetutorial
DiT Architecture: Diffusion Transformers & adaLN-Zero Guide

Master Diffusion Transformers (DiT) in 2026: explore latent patchification, adaLN-Zero conditioning, and vision scaling laws behind Sora and Flux models.

diffusion-transformersditgenerative-aicomputer-visiontransformer-architecturetutorial
Gated Linear Attention: Data-Dependent Decay & FLA Guide

Master Gated Linear Attention (GLA) in 2026: explore data-dependent decay, 2D matrix memory, and Triton chunkwise parallel scans for FlashAttention parity.

gated-linear-attentionlinear-attentionflash-linear-attentionsub-quadratictriton-kernelstutorial
Gemma 2 Guide: Soft-Capping & Interleaved Attention

Master Google Gemma 2 in 2026: explore logit soft-capping, alternating sliding window attention, post-norm scaling, and pre-training knowledge distillation.

gemma-2google-deepmindllm-architecturesliding-window-attentionknowledge-distillationtutorial
HippoRAG Guide: Hippocampal Memory & Multi-Hop RAG

Master HippoRAG in 2026: explore how hippocampal memory indexing, knowledge graphs, and Personalized PageRank deliver 20% higher multi-hop recall.

hipporagragknowledge-graphspersonalized-pageranklong-term-memorytutorial
KTransformers: Serving 671B MoE on a Single 24GB GPU Guide

Master KTransformers in 2026: learn how CPU AMX offloading, activation transfers, and quantized experts run 671B MoE models on a 24GB GPU at interactive speeds.

ktransformersmoe-servingdeepseek-v3cpu-offloadingllm-inferencetutorial
Liquid Foundation Models: Non-Transformer Architecture Guide

Master Liquid Foundation Models in 2026: explore how adaptive linear operators, dynamical systems, and constant memory state spaces outperform transformers.

liquid-foundation-modelslfmdynamical-systemsllm-architecturestate-space-modelstutorial
Matryoshka Embeddings: Adaptive MRL Vector Search Guide

Master Matryoshka embeddings in 2026: learn how nested vectors and adaptive funnel retrieval cut vector DB RAM by 80% while preserving 98% search accuracy.

matryoshka-embeddingsmrlvector-searchragembeddingstutorial
OmniParser Guide: Vision-Based GUI Screen Parsing for AI

Master Microsoft OmniParser in 2026: learn how interactable region detection, icon captioning, and Set-of-Marks grounding power vision-based GUI AI agents.

omniparsergui-agentscomputer-usevision-language-modelsset-of-markstutorial
QServe Guide: W4A8KV4 Quantization for LLM Serving

Master QServe in 2026: explore how W4A8KV4 quantization, progressive dequantization, and SmoothAttention unlock 2.4x higher LLM serving throughput on GPUs.

qservequantizationw4a8llm-servingkv-cachetutorial
QuaRot Guide: Outlier-Free 4-Bit W4A4 LLM Quantization

Master QuaRot in 2026: see how randomized Hadamard rotations eliminate outliers to enable true W4A4 weights, activations, and KV cache LLM quantization.

quarotw4a4quantizationhadamard-transformllm-inferencetutorial
Qwen2-VL: Dynamic Resolution & M-RoPE Architecture Guide

Master Qwen2-VL in 2026: learn how dynamic aspect-ratio patching, 2D visual compression, and 3D M-RoPE positional encodings revolutionize multimodal AI.

qwen2-vlvision-language-modelsmultimodalm-ropedocument-aitutorial
Reasoning Distillation: DeepSeek-R1 CoT Transfer Guide

Master reasoning distillation in 2026: learn how transferring DeepSeek-R1 thinking traces into small dense LLMs outperforms pure RL at a fraction of the cost.

reasoning-distillationdeepseek-r1chain-of-thoughtllm-distillationqwentutorial
SGLang Guide: RadixAttention & Fast Structured Decoding

Master SGLang in 2026: explore how RadixAttention KV cache reuse and compressed FSM structured decoding deliver 5x faster agentic and JSON inference.

sglangradix-attentionstructured-decodingllm-servingkv-cachetutorial
TorchTitan Guide: Native PyTorch 3D Parallelism for LLMs

Master TorchTitan in 2026: explore how Meta composable 3D parallelism, DTensor, DeviceMesh, and native FP8 achieve 68% MFU for distributed LLM pre-training.

torchtitandistributed-training3d-parallelismpytorchdtensortutorial
VeRA Guide: Vector-Based Random Matrix Adaptation

Master VeRA in 2026: explore how frozen shared random matrices and trainable scaling vectors reduce LoRA parameters by 99% for high-density multi-tenant LLMs.

verapeftlorafine-tuningmulti-tenant-llmtutorial
3FS: DeepSeek Fire-Flyer Parallel File System Guide

Master DeepSeek 3FS in 2026: explore the Fire-Flyer parallel file system, RDMA-backed chunk storage, stateless metadata, and 6.6 TiB/s AI data ingestion.

3fsdeepseekdistributed-storageai-infrastructurerdmatutorial
Agentic Text-to-SQL: Enterprise Data Fetching Guide

Master Agentic Text-to-SQL in 2026: learn how schema pruning, entity linking, and execution-guided self-repair achieve 85%+ accuracy on BIRD-SQL.

text-to-sqlai-agentsdatabase-fetchingsqlbird-sqltutorial
Anatomy of an AI Agent: Blueprint for Autonomous Systems

Master AI agent architecture in 2026: explore how foundation LLMs, short/long-term memory, planning loops, and tool execution power autonomous AI actors.

ai-agentsagent-architecturellm-agentsautonomous-systemstutorial
DeepEP: High-Throughput MoE Communication Guide

Master DeepSeek DeepEP in 2026: explore high-throughput and low-latency MoE kernels, NVLink-RDMA forwarding, and FP8 All-to-All dispatch with 20 SMs.

deepepdeepseekexpert-parallelismmoe-communicationall-to-alltutorial
DeepGEMM: Clean FP8 MoE Matrix Multiplication Guide

Master DeepSeek DeepGEMM in 2026: explore clean FP8 matrix multiplication, fine-grained block scaling, and MoE Grouped GEMMs reaching 1350+ TFLOPS.

deepgemmfp8-gemmdeepseekmoe-servinggpu-optimizationtutorial
DeepSpeed Ulysses: Long-Context Sequence Parallelism Guide

Master DeepSpeed Ulysses in 2026: explore All-to-All sequence-to-head transposition, FlashAttention integration, and 1M+ token LLM training.

deepspeed-ulyssessequence-parallelismlong-contextall-to-alldistributed-trainingtutorial
Docling: Document Parsing for Multimodal RAG Guide

Master Docling in 2026: explore how IBM Research layout analysis, TableFormer, and structure-aware chunking eliminate PDF parsing failures in RAG.

doclingragdocument-parsingmultimodal-ragibm-researchtutorial
DuoAttention: Dual Retrieval & Streaming Heads Guide

Master DuoAttention in 2026: learn how splitting retrieval and streaming attention heads slashes KV cache memory by 2.55x and accelerates decoding by up to 3x.

duoattentionkv-cachellm-inferencelong-contextattention-sinkstutorial
EPLB: Expert Parallelism Load Balancer Guide for MoE

Master DeepSeek EPLB in 2026: learn how redundant expert replication, hierarchical packing, and token dispatch eliminate MoE stragglers and cut latency.

eplbdeepseekmixture-of-expertsexpert-parallelismdistributed-trainingtutorial
LightRAG: Fast Incremental Knowledge Graph RAG Guide

Master LightRAG in 2026: learn how dual-level retrieval and incremental graph indexing cut GraphRAG costs by 99% while boosting global query accuracy.

lightraggraphragknowledge-graphsragllm-retrievaltutorial
LLM Cascades Guide: Adaptive Model Routing with FrugalGPT

Master LLM Cascades in 2026: learn how FrugalGPT adaptive model routing and confidence scoring slash API costs by up to 98% while preserving frontier accuracy.

llm-cascadesfrugalgptmodel-routingcost-optimizationai-infrastructuretutorial
Mem0: Building Scalable Long-Term Memory for AI Agents

Master Mem0 in 2026: learn how multi-tier scoping, atomic fact extraction, and dynamic CRUD reconciliation slash agent prompt tokens by up to 90%.

mem0agentic-memoryai-agentspersonalizationvector-databasetutorial
PyramidKV: Dynamic Layer-Adaptive KV Cache Guide

Master PyramidKV in 2026: discover how pyramidal layer-adaptive allocation cuts KV cache memory by 8x while preserving long-context retrieval accuracy.

pyramidkvkv-cachellm-servinglong-contextgpu-optimizationtutorial
RAG Triad Guide: Evaluating RAG Pipelines with Ragas

Master the RAG Triad and Ragas in 2026: learn how faithfulness, answer relevance, and context precision eliminate hallucinations in production RAG systems.

rag-triadragasrag-evaluationfaithfulnesshallucination-detectiontutorial
RankRAG: Unified Context Ranking and Generation Guide

Master RankRAG in 2026: explore how NVIDIA unified ranking and generation instruction tuning eliminates reranker latency and cuts RAG hallucinations.

rankragragrerankingllm-retrievalnvidia-researchtutorial
RAPTOR: Recursive Tree Retrieval for Long-Context RAG

Master RAPTOR in 2026: learn how recursive GMM clustering, multi-tier tree summarization, and multi-scale retrieval solve holistic RAG queries.

raptorragtree-retrievallong-contextinformation-retrievaltutorial
Reflexion Guide: Verbal Reinforcement Learning for Agents

Master Reflexion in 2026: discover how verbal reinforcement learning, evaluator loops, and episodic memory eliminate agent failures without model fine-tuning.

reflexionai-agentsreinforcement-learningverbal-reflectionreacttutorial
RLVR Guide: Training Reasoning AI with Verifiable Rewards

Master RLVR in 2026: discover how reinforcement learning with verifiable rewards replaces reward hacking to train self-reflective reasoning models like R1.

rlvrreinforcement-learningreasoning-modelsverifiable-rewardsdeepseek-r1tutorial
s1: Simple Test-Time Scaling & Budget Forcing Guide

Master s1 in 2026: learn how budget forcing, thinking token control, and the s1K dataset scale LLM reasoning to rival o1 for just $20 in compute.

s1test-time-scalingbudget-forcingreasoning-modelsllm-inferencetutorial
Self-Discover: Composing Dynamic LLM Reasoning Structures

Master Self-Discover in 2026: explore how DeepMind atomic reasoning modules and dynamic self-composition boost LLM reasoning by 32% over CoT.

self-discoverai-reasoningprompt-engineeringgoogle-deepmindllm-agentstutorial
Semantic Chunking Guide: Embedding-Based Text Splitting

Master Semantic Chunking in 2026: discover how cosine distance thresholds and sentence embeddings eliminate RAG context fragmentation with zero token overlap.

semantic-chunkingragtext-segmentationembeddingsvector-databasetutorial
Semantic Router: Sub-5ms Vector Dispatch for AI Agents

Master Semantic Router in 2026: discover how vector-based intent classification replaces slow LLM tool routing to execute sub-5ms agent decisions at zero cost.

semantic-routerai-agentsvector-embeddingstool-callingllm-routingtutorial
Set-of-Marks Guide: Visual Grounding for Web AI Agents

Master Set-of-Marks in 2026: discover how visual overlay badges and accessibility trees eliminate VLM coordinate errors to boost web agent accuracy by 3x.

set-of-marksweb-agentsvision-language-modelsbrowser-automationvlmtutorial
Turn Any Website into a RAG Knowledge Base: aiFetchly

Step-by-step guide to converting public websites, docs, and pricing pages into private, searchable RAG knowledge base documents using aiFetchly desktop.

power-usersragknowledge-basewebsite-importtutorial
Differential Transformer: Canceling LLM Attention Noise

Master Differential Transformer in 2026: explore how DiffAttn cancels attention noise via dual softmax maps, tames activation outliers, and boosts RAG.

differential-transformerdiffattnllm-architectureattention-mechanismmicrosoft-researchtutorial
FlashAttention-3: Asynchronous Hopper Attention Guide

Master FlashAttention-3 on NVIDIA Hopper: explore WGMMA, TMA warp specialization, overlapped GEMM-softmax pipelining, and FP8 block scaling for 2x faster LLMs.

flashattention-3hoppergpu-kernelfp8llm-inferencetutorial
FP8 Mixed Precision: DeepSeek-V3 Training Architecture

Master FP8 mixed precision training: learn how DeepSeek-V3 uses fine-grained tile scaling, E4M3, and decoupled accumulation to cut training costs by 50%.

fp8-trainingdeepseek-v3mixed-precisiongpu-optimizationquantizationtutorial
Gorilla LLM Guide: Function Calling & BFCL Evaluation

Master Gorilla LLM and BFCL in 2026: learn how retriever-aware tool calling, AST validation, and API evaluation eliminate hallucinated arguments in AI agents.

gorilla-llmfunction-callingbfcltool-useai-agentstutorial
Infini-Attention: Scaling LLMs to 1M+ Context Guide

Master Google Infini-attention: learn how compressive memory matrices and hybrid local gating scale LLMs to 1M+ tokens with bounded GPU VRAM in 2026.

infini-attentioncompressive-memorylong-contextllm-architecturegoogle-researchtutorial
LATS Architecture: Language Agent Tree Search Guide

Master LATS in 2026: learn how Language Agent Tree Search unifies MCTS, environment acting, and self-reflection to achieve 94% success on autonomous tasks.

latsai-agentsmctsreasoningplanningtutorial
Liger Kernel: Fused Triton Kernels for LLM Training

Master Liger Kernel in 2026: learn how fused Triton kernels eliminate logits materialization, cut training VRAM by 60%, and boost throughput by 20%.

liger-kerneltritonllm-traininggpu-optimizationpytorchtutorial
LongLoRA: Efficient 100k Context LLM Fine-Tuning Guide

Master LongLoRA in 2026: learn how Shifted Short Attention and trainable norm layers scale LLM context to 100k tokens on GPUs with zero inference changes.

longloras2-attnlong-contextllm-fine-tuningtutorial
Mixture-of-Agents: Scaling LLM Quality with Layered MoA

Master Mixture-of-Agents (MoA): learn how layered proposers and aggregators leverage the collaborativeness phenomenon to outperform GPT-4o using open models.

mixture-of-agentsmoamulti-agenttogether-aillm-collaborationtutorial
Muon Optimizer: Fast LLM Training via Orthogonalization

Master the Muon optimizer in 2026: learn how Newton-Schulz matrix orthogonalization cuts optimizer VRAM by 45% and accelerates LLM training by up to 2x.

muon-optimizernewton-schulzllm-traininggpu-optimizationdeep-learningtutorial
Native Sparse Attention: DeepSeek NSA Architecture Guide

Master Native Sparse Attention: explore how DeepSeek NSA combines token compression, top-k selection, and sliding windows to outspeed FlashAttention.

native-sparse-attentionnsadeepseeklong-contextsparse-attentiontutorial
Prefill-Decode Disaggregation: Scaling LLM Serving Goodput

Master Prefill-Decode Disaggregation: explore DistServe, Splitwise, and how separating P and D instances with RDMA KV transfer boosts serving goodput up to 5x.

prefill-decode-disaggregationllm-servingdistservevllminference-optimizationtutorial
REST: Retrieval-Based Speculative Decoding Guide

Master REST: learn how model-free retrieval, Trie candidate trees, and tree attention deliver 2x speculative decoding speedups with zero draft model VRAM.

restspeculative-decodingretrieval-basedllm-inferencetrietutorial
Inside aiFetchly Hooks: Securing Agent Tool Calls

Deep dive into aiFetchly lifecycle hooks: intercept PreToolUse events, rewrite inputs, enforce security policies, and maintain tamper-resistant audit logs.

developershookssecurityguardrailsfeature-deep-dive
Titans Architecture: Neural Long-Term Memory for LLMs

Master Google Titans in 2026: explore how surprise-based neural memory, test-time learning, and MAC/MAG gating scale LLM contexts to 2M+ tokens.

titansneural-memorylong-contextllm-architecturegoogle-researchtutorial
TriForce: Hierarchical Speculative Decoding for LLMs

Master TriForce in 2026: learn how hierarchical speculative decoding, sparse KV retrieval, and tree attention deliver 4.8x speedups on 128k+ contexts.

triforcespeculative-decodinglong-contextkv-cachellm-inferencetutorial
Unsloth Architecture: 5x Faster LLM Training via Triton

Master Unsloth in 2026: learn how manual Triton backprop, fused cross-entropy, and custom RoPE kernels cut LLM training VRAM by 80% with 0% accuracy loss.

unslothtriton-kernelsllm-traininggpu-optimizationfine-tuningtutorial
vAttention: Serving LLMs Without PagedAttention Guide

Master vAttention in 2026: learn how CUDA Virtual Memory Management replaces PagedAttention software lookups to run native FlashAttention with zero VRAM waste.

vattentionpagedattentioncuda-vmmkv-cachellm-servingtutorial
Bypassing Rate Limits: aiFetchly Proxy Setup Guide

Step-by-step guide for data analysts to configure rotating HTTPS and SOCKS5 proxies in aiFetchly, with 2-stage health checks and batch CSV importing.

data-analystsproxy-setupweb-scrapingtutorialanti-bot
Cross-Layer Attention: Slashing LLM KV Cache by 50%

Master Cross-Layer Attention (CLA): learn how sharing Key-Value activations across transformer layers cuts KV cache memory by 50% without quality loss in 2026.

cross-layer-attentionclakv-cachellm-inferencetutorial
DeepSeekMoE Guide: Fine-Grained Expert Specialization

Master DeepSeekMoE: learn how fine-grained expert segmentation and shared expert isolation achieve ultimate specialization with constant FLOPs in 2026.

deepseekmoemixture-of-expertstransformer-architecturetutorial
DoLa: Decoding by Contrasting Layers for Factuality

Master DoLa decoding: learn how contrasting mature and premature transformer layers cuts LLM hallucinations by 40% with zero retraining in 2026.

dolahallucination-mitigationfactualityllm-inferencetutorial
FlashInfer Guide: Split-KV & Paged Attention Acceleration

Master FlashInfer in 2026: learn how Split-KV decoding, paged attention kernels, and composite fusion achieve 3x LLM serving throughput with zero memory waste.

flashinferpaged-attentionsplit-kvllm-inferencegpu-kernelstutorial
Graph of Thoughts: Scaling Non-Linear LLM Reasoning

Master Graph of Thoughts (GoT) in 2026: learn how DAG reasoning, thought merging, and feedback loops boost LLM problem solving by 62% over Tree of Thoughts.

graph-of-thoughtsprompt-engineeringreasoningllm-agentstutorial
Lookahead Decoding: Draft-Free Parallel LLM Inference

Master Lookahead Decoding: learn how Jacobi iteration and parallel n-gram verification achieve 2x LLM speedups without draft models or training in 2026.

lookahead-decodingspeculative-decodingllm-inferencejacobi-iterationtutorial
Mamba-2 Architecture: State Space Duality Explained

Master Mamba-2 in 2026: learn how Structured State Space Duality (SSD) unifies SSMs with attention and uses Tensor Cores for 8x faster sequence modeling.

mamba-2state-space-dualityssmlinear-attentiontutorial
ORPO Explained: Reference-Free LLM Alignment Guide

Master Odds Ratio Preference Optimization (ORPO): learn how monolithic reference-free alignment cuts training VRAM by 50% without prior SFT in 2026.

orpollm-alignmentfine-tuningrlhftutorial
ReFT Guide: Representation Finetuning Beyond LoRA

Master ReFT and LoReFT in 2026: learn how Representation Finetuning manipulates hidden representations to train models with 50x fewer parameters than LoRA.

reftloreftpeftlorafine-tuningtutorial
Skeleton-of-Thought: Ultra-Fast Parallel LLM Generation

Master Skeleton-of-Thought (SoT) in 2026: learn how decoupling outlines from parallel point expansion slashes generative LLM latency by up to 4x.

skeleton-of-thoughtparallel-decodingllm-latencyinference-optimizationtutorial
SWE-agent & ACI: Designing Agent-Computer Interfaces

Master SWE-agent and ACI in 2026: learn how Agent-Computer Interfaces, linting gatekeepers, and paginated viewers turn LLMs into reliable software engineers.

swe-agentagent-computer-interfaceaciai-agentstutorial
vLLM V1 Architecture: Zero-Overhead LLM Serving Guide

Master vLLM V1: learn how the C++ core rewrite, Ray-free tensor parallelism, and ZeroMQ IPC slash scheduling latency and boost throughput in 2026.

vllmllm-servinggpu-inferencesystems-architecturetutorial
Auxiliary-Loss-Free Load Balancing: MoE Routing Guide

Master auxiliary-loss-free load balancing in MoE: learn how dynamic router bias prevents expert collapse and representation degradation in 2026 models.

moemixture-of-expertsdeepseekload-balancingtutorial
Chunked Prefill: Taming Latency Spikes in LLM Serving

Master Chunked Prefill and piggybacking: learn how splitting prompt prefills and co-scheduling decode tokens slashes TPOT latency variance by 80% in 2026.

chunked-prefillvllmllm-servinglatency-optimizationtutorial
ColBERT: Multi-Vector Late Interaction RAG Guide in 2026

Master ColBERT and late interaction: learn how token-level MaxSim multi-vector retrieval bridges the gap between dense bi-encoders and cross-encoders in 2026.

colbertlate-interactionraginformation-retrievaltutorial
Custom AI Subagents in aiFetchly: Developer Walkthrough

Step-by-step guide to creating custom AI subagents in aiFetchly: configure specialist modes, scoped tool allowlists, runtime limits, and strict JSON schemas.

developerssubagentsagentic-workflowstutorialjson-schema
Diffusion Language Models: Discrete Text Diffusion Guide

Master Diffusion Language Models: learn how discrete masked diffusion (MDLM) breaks the autoregressive barrier with bidirectional parallel decoding in 2026.

diffusion-modelsdiscrete-diffusionmdlmtransformer-architecturetutorial
DualPipe: Bidirectional Pipeline Parallelism Guide

Master DualPipe: learn how bidirectional micro-batch streams and decoupled backward scheduling overlap communication and eliminate bubbles in 2026.

dualpipepipeline-parallelismdeepseekdistributed-trainingtutorial
EAGLE-2: Feature-Level Speculative Decoding Guide

Master EAGLE-2: learn how feature-level autoregression and dynamic draft trees accelerate LLM inference by 3x to 4x with zero quality loss in 2026.

eagle-2speculative-decodingllm-inferencevllmtutorial
FlashDecoding: Fast Long-Context Generation Guide

Master FlashDecoding: learn how splitting KV cache across GPU SMs and online softmax reduction accelerates long-context LLM generation by 8x in 2026.

flashdecodingllm-inferencelong-contextcuda-kernelstutorial
Heavy Hitter Oracle: Dynamic KV Cache Eviction Guide

Master the Heavy Hitter Oracle (H2O): learn how dynamic attention-based KV cache eviction slashes long-context VRAM by 80% without quality loss in 2026.

h2okv-cachellm-inferencelong-contexttutorial
KTO Explained: Binary LLM Alignment via Prospect Theory

Master Kahneman-Tversky Optimization (KTO): learn how prospect theory and unpaired binary feedback eliminate preference pairs in LLM alignment in 2026.

ktollm-alignmentprospect-theoryreinforcement-learningtutorial
Multi-Token Prediction: Architecture and Serving Guide

Master Multi-Token Prediction (MTP): learn how sequential prediction heads, causal drafting, and DeepSeek-V3 techniques boost LLM throughput by 2x in 2026.

mtpmulti-token-predictiondeepseekspeculative-decodingtutorial
Process Reward Models: Step-Level LLM Reasoning Guide

Master Process Reward Models (PRMs): learn how step-level verification, Math-Shepherd rollouts, and tree search eliminate reasoning errors in 2026.

prmprocess-reward-modelsllm-reasoningreinforcement-learningtutorial
Prompt Compression: LongLLMLingua RAG Guide for 2026

Master prompt compression: learn how LongLLMLingua uses perplexity budgets to slash RAG token costs by up to 80% while boosting accuracy in 2026.

prompt-compressionlongllmlinguaragcost-optimizationtutorial
RingAttention: Scaling LLM Context to 10M Tokens

Master RingAttention: learn how blockwise circular context parallelism overlaps communication with computation to scale LLMs to 10M tokens in 2026.

ring-attentioncontext-parallelismdistributed-traininglong-contexttutorial
SimPO Guide: Reference-Free LLM Alignment in 2026

Master SimPO: learn how reference-free preference optimization and target reward margins eliminate verbosity bias and outperform DPO in 2026.

simpodpollm-alignmentpreference-optimizationtutorial
Test-Time Training: Linear Complexity Beyond Attention

Master Test-Time Training (TTT): learn how replacing RNN hidden states with neural networks updated via test-time gradient descent beats attention in 2026.

ttttest-time-trainingrecurrent-modelslinear-attentiontutorial
TypeSafe Jev Guide: Non-Autoregressive System-1 AI

Master TypeSafe Jev in 2026: learn how non-autoregressive System-1 inference, RLCD calibration, and typed decision primitives cut agent costs by 400x.

typesafe-jevsystem-1-modelai-agentsrlcdtutorial
Agent-to-Agent Protocol: Building Semantic Event Buses

Master the Agent-to-Agent (A2A) protocol: learn how semantic event buses, structured handoffs, and typed schemas orchestrate multi-agent swarms in 2026.

ai-agentsmulti-agenta2a-protocolevent-driventutorial
Agentic Sagas: Compensating Transactions for AI Guide

Master the Saga pattern for AI agents: learn how compensating transactions, durable journals, and rollback coordinators eliminate partial failures in 2026.

ai-agentssaga-patterndistributed-systemsreliabilitytutorial
ColPali Visual RAG: OCR-Free Document Retrieval Guide

Master ColPali for multimodal RAG: learn how vision-language models and late interaction multi-vectors index complex PDF pages without brittle OCR in 2026.

ragcolpalimultimodalvision-language-modelstutorial
Context-Aware Marketing: Inside aiFetchly AI Assistant

Deep dive into aiFetchly AI Marketing Assistant: learn how digital marketers leverage Knowledge Library RAG to draft GTM campaigns and tailored copy.

digital-marketersmarketing-automationragcampaign-strategyfeature-deep-dive
Flow Matching & Rectified Flow: Generative AI Guide

Master Flow Matching and Rectified Flow: learn how straight ODE trajectories and velocity fields replace curved diffusion for ultra-fast generation in 2026.

flow-matchingrectified-flowgenerative-aidiffusion-modelstutorial
Hierarchical Agent Memory: Cognitive Architecture Guide

Master hierarchical agent memory: learn how working, episodic, and semantic memory systems eliminate AI amnesia with reflection and decay scoring in 2026.

ai-agentsagentic-memoryepisodic-memoryvector-databasetutorial
Hybrid Mamba-Transformers: Scaling Beyond Attention Guide

Master Hybrid Mamba-Transformers: learn how interleaving Mamba-2 state-space layers with attention cuts KV cache by 85% with 4x throughput in 2026.

mamba-2state-space-modelstransformer-architecturellm-inferencetutorial
Late Chunking for RAG: Context-Aware Embeddings Guide

Learn how Late Chunking uses long-context embedding models and span pooling to eliminate RAG context loss with zero extra LLM generation costs in 2026.

raglate-chunkingembeddingsvector-databasetutorial
Mixture-of-Depths: Dynamic Token Routing in LLMs Guide

Master Mixture-of-Depths (MoD): learn how per-block token routing cuts transformer FLOPs by 50% with fixed-capacity execution and zero perplexity loss in 2026.

mixture-of-depthstransformer-architecturellm-inferenceefficiencytutorial
Multi-Agent Debate: Consensus Architectures for AI Guide

Learn how multi-agent debate and consensus councils eliminate single-model hallucinations and solve complex reasoning tasks with structured critique in 2026.

multi-agentmulti-agent-debateconsensusai-reasoningtutorial
Programmable AI Guardrails: Semantic Firewalls Guide

Learn how programmable AI guardrails and semantic firewalls protect LLM agents against jailbreaks, PII leakage, and hallucination drift in 2026.

ai-safetyguardrailssemantic-firewallsecuritytutorial
Speculative RAG: Accelerating LLM Retrieval in 2026

Master Speculative RAG: learn how parallel drafter models and single-pass verification cut retrieval latency by 51% while boosting accuracy in 2026.

ragspeculative-ragretrieval-augmented-generationllm-inferencetutorial
StreamingLLM: Infinite Context with Attention Sinks Guide

Master StreamingLLM and attention sinks: learn how preserving initial tokens allows 4M+ token generation with fixed KV cache memory and zero fine-tuning in 2026.

streaming-llmattention-sinkskv-cachellm-inferencetutorial
Test-Time Compute Scaling: Modern LLM Reasoning Guide

Master test-time compute scaling: learn how inference search, process reward models, and extended thinking tokens unlock frontier reasoning in 2026.

reasoning-modelstest-time-computeinference-scalingdeepseek-r1tutorial
LLM-as-a-Judge: Production AI Evaluation Guide

Master LLM-as-a-judge evaluation: learn how to build calibrated rubric evaluators, mitigate position and verbosity bias, and automate CI/CD tests in 2026.

aievaluationllm-as-a-judgebenchmarkingtutorial
Local LLMs in aiFetchly: Zero-Cost Offline Analysis

Learn how data analysts connect local Ollama and vLLM models to aiFetchly—achieving 100% offline data privacy and zero API token costs on desktop hardware.

data-analystslocal-llmollamaprivacyproblem-solution
Prompt Caching: Slashing Agent Costs & Latency by 90%

Learn how prompt caching and KV cache reuse cut multi-turn AI agent latency and token costs by up to 90% across Anthropic, OpenAI, and vLLM in 2026.

ai-agentsprompt-cachingkv-cacheoptimizationtutorial
Real-Time Search Grounding: Architecture & Attribution

Learn how real-time search grounding connects LLMs to live web engines, resolves conflicting sources, and automates verified citation attribution in 2026.

aisearch-groundingreal-time-searchcitationstutorial
Self-Healing Web Scrapers: Automated DOM Repair Guide

Learn how self-healing web scrapers use AI anomaly detection and dynamic DOM repair to survive frontend redesigns with zero downtime in 2026.

web-scrapingai-automationself-healingdata-fetchingtutorial
Speculative Decoding: Accelerating LLM Inference Guide

Learn how speculative decoding accelerates LLM inference by 2-3x using small draft models and parallel verification with zero accuracy loss in 2026.

aispeculative-decodingllm-inferenceoptimizationtutorial
Constrained Decoding: Guiding LLMs to 100% Valid JSON

Learn how constrained decoding and grammar-based sampling eliminate LLM JSON parse failures by masking logits at the token level in production pipelines.

aistructured-outputsconstrained-decodingllm-inferencetutorial
Extending aiFetchly with MCP: Developer Tutorial

Step-by-step developer tutorial for connecting Model Context Protocol (MCP) servers, Stdio transports, and Claude Desktop configs to aiFetchly desktop.

developersmcptutorialmodel-context-protocolclaude-desktop
Durable Workspace Memory: Stop AI Context Amnesia

Learn how power users eliminate AI context amnesia using aiFetchly Workspace Memory—retaining project decisions, conventions, and workflows in local SQLite.

power-usersworkspace-memoryproblem-solutionlocal-firstcontext-management
Local Market Intelligence: aiFetchly Extraction Deep Dive

Deep dive into how data analysts extract structured geospatial and directory intelligence across Google Maps, Yelp, and global Yellow Pages with aiFetchly.

data-analystsmarket-intelligencegeospatial-datadirectory-extractionfeature-deep-dive
Computer-Use AI Agents: Architecture & GUI Guide

Learn how computer-use AI agents leverage vision grounding, coordinate mapping, and OS-level loops to automate desktop and web GUIs in 2026.

ai-agentscomputer-usegui-automationarchitecturetutorial
Context Engineering for AI Agents: Architecture Guide

Master context engineering for AI agents: learn token budgeting, working memory compaction, and scratchpad state pruning to build resilient systems.

ai-agentscontext-engineeringmemory-managementarchitecturetutorial
B2B Lead Enrichment: AI Cold Outreach with aiFetchly

Learn how digital marketers automate B2B lead discovery, contact enrichment, and personalized cold email campaigns using aiFetchly and local RAG.

digital-marketerslead-generationemail-outreachcontact-extractiontutorial
Desktop vs. Web AI Agents: The Power User Advantage

Discover why power users choose desktop-native AI agents over cloud SaaS for heavy web extraction, local browser control, and autonomous loop execution.

power-usersdesktop-vs-webautomationmcplocal-first
On-Device Edge AI: Run Inference Locally

A practical guide to on-device edge AI. Learn how local inference on NPUs, browsers, and phones cuts cloud latency and data exposure, and when it beats the cloud.

aiedge-aidata-engineeringprivacytutorial