As Moore’s law continues to unfold, two important trends have recently emerged. Second, the parallelization of the computation and 3D integration technologies lead to distributed memory architectures. It addresses the architectural design of many core chips, memory and data management, power management, design and programming methodologies.