Presentation
Near-Memory Processing is Becoming a Reality
DescriptionAs AI scales, both industry and academia have long pursued near-data processing as a path to major performance gains. Today, performance is no longer the only challenge—energy is the real bottleneck. Data movement now consumes orders of magnitude more energy than computation itself, making traditional architectures increasingly unsustainable for next-generation AI data centers as well as battery-constrained edge devices. In this new energy-limited computing era, near-data processing has moved from an intriguing idea to a practical necessity. Approaches span in-sensor, in-memory, in-storage, and in-network processing, depending on where data is created and resides. Among them, near-memory processing is rapidly becoming reality. This talk explores the shift toward tightly integrated compute-memory systems, including 3D architectures that dramatically cut data movement and energy use. I expect we will see more domain-specific architectures and heterogeneous systems built around that idea. It's really a move toward a memory-centric design for AI infrastructure.
Event Type
Research Special Session
TimeTuesday, July 283:30pm - 4:00pm PDT
LocationMtg Room 201A
