☀️ AI Hardware & Accelerators: Illuminating the Future
A Professional Analysis of Next-Generation Computing Hardware for Faculty & Students

🎓 AI Hardware Education: A Global Comparison

How MIT, Stanford, ETH Zurich, UC Berkeley, and CMU are integrating modern AI hardware, accelerators, and hardware-software co-design into their curricula - and what sets them apart.

Executive Summary

Leading universities are fundamentally reimagining their computer architecture and VLSI curricula to address the shift from general-purpose processors to domain-specific AI accelerators. This comparison examines how these institutions structure courses related to modern AI hardware, computer architecture, VLSI, and machine learning accelerators.

Institutional Approaches

University Program Focus Approach to AI Hardware Notes
MIT (EECS) Strong integration between architecture, systems, and ML; hardware-software co-design emphasized. Courses directly bridging deep learning and hardware (e.g. Hardware Architecture for Deep Learning, TinyML). Many offerings tied to research groups (Sze/Emer labs, Han group). Very hands-on with labs; course numbers 6.x in EECS. Emphasizes full-stack (algorithms→architecture→circuits).
Stanford (EE/CS) Heavy emphasis on efficient ML systems, accelerators, and circuits; strong industry alignment (especially with silicon valley). Dedicated tracks for "Hardware/Architecture" and courses on ML systems, VLSI, and specialized architectures. Often cross-listed between EE and CS. Strong in VLSI design (EE271/272 series), computer architecture (EE282/372), and ML systems/hardware (often under EE/CME/CS).
ETH Zurich (D-ITET) Rigorous theoretical foundation with strong VLSI/systems design. European approach with more structured curriculum. Focus on digital design, VLSI, computer architecture, and increasingly on AI/ML for circuits and hardware accelerators. Integration with robotics/edge AI. Known for VLSI Systems Lab, rigorous courses in digital integrated circuits, computer architecture. Growing focus on neuromorphic computing and AI chip design.
UC Berkeley (EECS) Pioneering in RISC-V, agile hardware design, and AI systems. Strong open-source culture. Courses span from computer architecture (CS 152) to domain-specific accelerators and ML systems. Emphasizes research-driven courses and labs with modern tools. Home to Berkeley Architecture Research (BAR), ADEPT Lab (Asanović), and strong in agile chip design, RoCC, and full-stack accelerator design.
CMU (ECE/CS) Interdisciplinary, strong in computer architecture, compilers, and emerging architectures. Focus on systems + ML. Robust offerings in computer architecture, parallel systems, VLSI, and ML hardware/efficiency. Often project-heavy with connections to industry. Known for 18-740/741/742 architecture sequence, 18-847/18-848 related to ML systems, and courses from the Computer Architecture Lab and CALCM.

Specific Courses (Representative Offerings)

MIT (6.x EECS)

Course Level Focus Notes
6.1910 Computation Structures UG Digital systems, CPU design, memory hierarchies Core traditional architecture; foundation for advanced courses.
6.1920 Constructive Computer Architecture UG HDL-based processor design, multicore, caches Project-heavy, constructive/Bluespec approach.
6.5900 Computer System Architecture G Pipelining, OOO, speculation, multicore, coherence Graduate-level traditional arch.
6.5930/5931 Hardware Architecture for Deep Learning UG/G DNN accelerators, dataflows, sparsity, co-design, modeling Flagship AI hardware course (Sze/Emer). Includes labs + project.
6.5940 TinyML and Efficient Deep Learning Computing G Quantization/pruning, NAS, efficient training/inference, edge deployment Focus on efficiency and deployment on constrained devices (Han group).
6.2060 Microcomputer Project Lab UG Embedded systems, full system design Hands-on integration of hardware/software.

Stanford (EE/CS)

Course Level Focus Notes
EE 180/282 (or equivalents) UG/G Digital system design, VLSI Core to circuits/VLSI track.
EE 272 Design Projects in VLSI Systems UG/G Custom IC design, tapeouts Hands-on VLSI with industry tools; often includes chip fabrication.
EE 282 Computer Architecture G Advanced arch, memory systems, multicore Core architecture course.
EE 372 Design of Digital Systems II / related G Advanced topics, often includes ML accelerators/custom compute Varies by year; strong project focus.
CS 149 Parallel Computing / CS 316 Advanced Multi-Core Systems UG/G Parallelism relevant to accelerators Often cross-listed; covers parallel arch for ML workloads.
EE 292E/CS 349M topics (ML Systems) G ML hardware/software systems, efficient inference/training Covers systems aspects of ML (compilers, runtime, accelerators).

ETH Zurich (D-ITET)

Course Level Focus Notes
Digital Design and Computer Architecture UG RISC-V based, core arch (Hennessy/Patterson style) Strong foundation; often taught by Onur Mutlu's group influence and local faculty.
VLSI I/II UG/G CMOS design, logic, layout, timing Rigorous, includes labs/projects.
Advanced Computer Architecture G Out-of-order, prefetching, memory systems Research-oriented.
AI Chip Design / Machine Learning on Hardware G Emerging course; covers accelerators, in-memory computing, neuromorphic Appears more recently as response to demand; topics vary by semester.
Seminar/Projects on Heterogeneous Computing G Often tied to systems groups (e.g. SAFARI) Project-based with research connections.

UC Berkeley (EECS)

Course Level Focus Notes
CS 61C Great Ideas in Computer Architecture (Machine Structures) UG C, RISC-V, memory, parallelism Foundational; widely taken.
CS 152 Computer Architecture and Engineering UG/G Pipelining, caches, out-of-order, parallelism, RISC-V Core arch course with strong labs (often using RISC-V).
EE 194/CS 194 Agile Hardware Design / Tapeout courses UG/G Chisel, agile development, full chip tapeouts Distinctive Berkeley offering - students build and tape out chips.
CS 262A/CS 294-?? ML Systems G ML compilers, frameworks, hardware-software co-design Covers the full stack for ML systems.
CS 250 VLSI Systems Design G Custom IC design, testing, project tapeout Classic VLSI course with tapeout opportunities.

CMU (ECE/CS)

Course Level Focus Notes
18-240/18-447 Introduction/Computer Architecture UG Core architecture, pipelining, memory Solid foundation.
18-740 Computer Architecture G Advanced topics, often includes research papers Rigorous, classic CMU arch course.
18-741 Advanced Computer Architecture G Deeper coverage of memory, multiprocessors, etc. Follow-up to 18-740.
18-742 Parallel Computer Architecture G Parallelism, coherence, interconnects Focused on parallel systems relevant to accelerators.
18-613/18-723 or VLSI courses (e.g. 18-322/18-421) UG/G Digital IC design, VLSI Strong circuits/VLSI offerings.
15-849/related ML Systems/Accelerators G Often co-taught, covers hardware for ML, efficiency Project-heavy with systems focus.

Comparison with Traditional Curriculum

Aspect Traditional ECE/EE Curriculum Modern AI Hardware-Oriented Curriculum
Focus General-purpose processors, analog/digital circuits, signals/systems. Domain-specific architectures, accelerators, co-design with ML workloads.
Core Architecture Single-core CPU, pipelining, basic memory hierarchies. Multi-core, GPUs, systolic arrays, dataflow, near-memory/in-memory compute, sparsity.
Programming/Design Assembly, Verilog/VHDL, schematic capture. HDL (Chisel/SystemVerilog), hardware-software co-design, simulation/modeling (e.g., Timeloop/Accelergy), and using ML frameworks.
Labs/Projects Discrete labs building basic circuits/processors. End-to-end projects: design accelerators for DNN layers, optimize for energy/performance, often with tapeouts or FPGA prototypes.
Theory vs Systems Balanced between theory and implementation. Stronger emphasis on empirical evaluation (roofline models, energy efficiency, performance per watt) and full-stack thinking.
VLSI Integration Separate track, often optional or later. Tightly integrated - understanding circuits/technology constraints is essential for efficient AI accelerators.
ML Knowledge Minimal or none traditionally. Required/prerequisite knowledge of DNNs, tensor computations, and common ML workloads.

Key Trends

  1. Hardware-software co-design is central: All five universities emphasize designing hardware in context of ML workloads, not in isolation.
  2. Shift from general-purpose to specialized: Courses focus heavily on dataflows (systolic arrays), sparsity exploitation, quantization, and mapping to hardware.
  3. Hands-on tapeouts/FPGA work: Berkeley's agile hardware, MIT's labs, and Stanford/ETH VLSI projects provide real silicon experience.
  4. Efficiency as first-class metric: Energy, area, and memory bandwidth are treated as primary constraints (especially for edge/embedded AI).
  5. Tooling modernization: Move from pure Verilog to higher-level HDLs (Chisel), architectural simulators, and analytical models (e.g., Accelergy/Timeloop).
  6. Full-stack perspective: Students learn compilers/mapping, runtime, and architecture together rather than as separate silos.

Recommendations for Course Planning

Note: Course offerings change frequently; always verify current catalogs for the target academic year.

← Previous: Hardware Breakthroughs | Home | Next: Gap Analysis →