Artificial intelligence (AI) tasks become increasingly abundant and complex fueled by large-scale datasets. With the plateau of Moore's law and end of Dennard scaling, energy consumption becomes a major barrier to more widespread applications of today's heavy electronic deep neural models, especially in terminal/edge systems.