Michigan startup MemryX, Inc. promises faster, cheaper AI processing

The ECE startup builds neuromorphic computer chips uniquely suitable for AI applications
MemryX team
Early members of the MemryX team (left to right): Prof. Zhengya Zhang, Prof. Wei Lu, Tim Wesley (Principal Engineer, MS ECE 2019), Fan-hsuan Meng (Principal Engineer, ECE doctoral student), Jacob Botimer (Principal Engineer, ECE doctoral student), Dr. Chester Liu (Sr. Director of Engineering, PHD ECE 2021), Dr. Mohammed Zidan (Sr. Director of Architecture Engineering)

University of Michigan ECE startup MemryX, Inc. is developing a programmable AI accelerator chip that promises unmatched performance at relatively low power for high-performance applications, including autonomous driving, smart cameras for robots, smart manufacturing, and smart retail. 

Our devices are cheap and powerful, but not power hungry.

Wei Lu, Co-founder and CEO, MemryX

While their technology is scalable for use in large data centers, the company is currently focusing on edge computing applications where speed, power, cost and security are paramount. And their technology could save a company thousands of dollars per chip.

“Our devices are cheap and powerful, but not power hungry,” said Wei Lu, company co-founder, CEO, and professor of Electrical Engineering and Computer Science.

The company’s devices are specifically targeted at running neural networks, which drive AI.

“Neural networks are a disruptive technology used everywhere,” said Mohammed Zidan, senior director of architecture at MemryX. “However, classical architectures are not designed for this type of application.”

Much of traditional computer processing is done in either the central processing unit (CPU) or graphics processing unit (GPU). CPUs are general purpose processors, making them suitable for a variety of neural networks, but they tend to be very slow, offering low efficiency.

GPUs, used by gamers, have thousands of cores that run in parallel, which theoretically greatly improves the speed of a machine learning algorithm. However, they not only require high power (up to hundreds of watts), there is a very high energy and latency price to pay to utilize all of the cores in parallel which makes them better suited to cloud applications than edge applications, and, says Lu, they are extremely expensive, with a single high-end GPU designed for AI running about $10K.

Even at that price, GPUs are not offering the performance companies want for their applications, and so companies like Google, Facebook, and Amazon have resorted to designing their own special-purpose chips.

Memory processing unit
Memory Processing Unit, 1st generation presented at CES 2020.

MemryX offers a new solution with their patent-protected memory processing unit (MPU). This technology offers high-performance with low latency and low power, making it ideally suitable for edge computing. It is also capable of supporting many different machine learning models, or neural networks, making it a programmable chip.

Edge computing, where processing is handled on-chip in close proximity to the application instead of being sent to the cloud, offers significant advantages in terms of speed and security.

For example, you want your self-driving car to process incoming data in time to avoid an accident. You also want sensitive medical data that is being collected through sensors to process the data in real-time on site.

MemryX’s technology is ideally suited for anything that includes an intelligent robot, including those used in industrial and hospital settings.

The team

MemryX is founded on the complementary expertise of Lu and Zhengya Zhang, co-founder and associate professor of Electrical Engineering and Computer Science. Lu, who is also co-founder of Crossbar, Inc., brings expertise in neuromorphic computing and in-memory computing systems. Zhang brings expertise in VLSI circuits and systems for computing, communications and signal processing.

Each and every member of our team in the company is amazing.

Mohammed Zidan, Senior Director of Architecture Engineering

Leading the architecture and circuit design teams at MemryX are Lu’s former postdoctoral researcher, Mohammed Zidan, and Zhang’s former doctoral student, Chester Liu, respectively. Liu is senior director of engineering.

“Each and every member of our team in the company is amazing,” said Zidan. “At this point, all the members of my team were products of the University of Michigan.”

MemryX has about 25 employees, and is in the process of doubling that number. Opportunities are open to those with bachelor’s, master’s, and doctoral degrees.

The company

MemryX officially launched in 2019, when they received their first seed funding. Within seven months, they had their first chip – a process that would normally take more like 1.5 years. They presented their first chip at CES in January 2020, and are currently working on the third generation. Several companies are testing out the chip right now.

MemryX is collaborating with Taiwan Semiconductor Manufacturing Co. (TSMC), which is among the world’s largest chip makers and offers advanced fabrication technology. The company is based in Ann Arbor, MI, with a second office in Taiwan. They recently announced the closing of Series A funding and the addition of Rick Wallace (President and CEO, KLA) to the Board of Directors, and Dr. Peter Hsieh (VP of Innovation & Investment, ARM) to the Technical Advisory Board.

January 11, 2024 :

First PC AI accelerator cards from MemryX, Kinara debut at CES

PCWorld: MemryX, a startup so-Founded by Prof. Wei Lu, debuted their MX3 Edge AI Accelerator chips, which are the first to support AI enabled PC (AI PC), at CES this year.
December 9, 2022 :

MemryX Inc. opens R&D center in Bangalore, India - advancing simple and scalable processing solutions for Edge AI

The opening of the Bangalore site is complementary to existing MemryX engineering capabilities in Taipei, Hsinchu, and Ann Arbor. MemryX, co-founded by Prof. Wei Lu, offers a differentiated high efficiency, low power, and scalable Edge AI solutions.
August 16, 2022 : Business Wire

MemryX Begins Customer Sampling of AI Accelerator Chip

MemryX Inc., a pioneering start-up co-founded by Prof. Wei Lu that designs breakthrough silicon for artificial intelligence (AI) processing for edge devices, announced today it has begun customer sampling of its revolutionary MX3 AI Accelerator.
December 8, 2021 : Reuters

Qualcomm's AI chip chief departs to take helm at startup MemryX

MemryX Inc., a pioneering startup building breakthrough silicon for artificial intelligence processing co-founded by Professors Wei Lu and Zhengya Zhang, has appointed semiconductor industry veteran Keith Kressin as its new president and CEO.