{"id":41789,"date":"2021-02-17T11:40:41","date_gmt":"2021-02-17T11:40:41","guid":{"rendered":"http:\/\/icloud.pe\/blog\/?guid=89d1a959c0796d7958dcc62ff2c7ac01"},"modified":"2021-02-17T11:40:41","modified_gmt":"2021-02-17T11:40:41","slug":"samsung-debuts-industrys-first-ai-powered-memory","status":"publish","type":"post","link":"https:\/\/icloud.pe\/blog\/samsung-debuts-industrys-first-ai-powered-memory\/","title":{"rendered":"Samsung debuts ‘industry’s-first’ AI-powered memory"},"content":{"rendered":"


\n Keumars Afifi-Sabet<\/a><\/span>
\n <\/span><\/p>\n

\n
\n
17 Feb, 2021<\/span><\/div>\n<\/p><\/div>\n<\/div>\n

\n<\/a><\/p>\n

\n

Samsung has developed a computing architecture that combines memory with\u00a0artificial intelligence (AI)<\/a>\u00a0processing power to double the performance of data centres and high-performance computing (HPC) tasks while reducing power consumption.<\/p>\n

Branded an ‘industry first’, this processor-in-memory (PIM) architecture brings AI computing capabilities to systems normally powered by high-bandwidth memory (HBM), such as data centres and\u00a0supercomputers<\/a>. HBM is an existing technology developed by companies including AMD and SK Hynix.<\/p>\n

<\/p>\n

\nThe result, according to Samsung, is twice the performance in high-powered systems, and a reduction in power consumption by more than 70%. This is driven largely by the fact the memory and processor components are integrated and no longer separated, vastly reducing the latency in the data transferred between them.<\/p>\n

\u201cOur groundbreaking HBM-PIM is the industry\u2019s first programmable PIM solution tailored for diverse AI-driven workloads such as HPC, training and inference,\u201d said Samsungs vice president of memory product planning, Kwangil Park.\u00a0<\/p>\n

\u201cWe plan to build upon this breakthrough by further collaborating with AI solution providers for even more advanced PIM-powered applications.\u201d<\/p>\n

Most computing systems today are based on an architecture which uses separate memory and processor units to carry out data processing tasks, known as von Neumann architecture.\u00a0<\/p>\n

This approach requires data to move back and forth on a constant basis between the two components, which\u00a0can result in a bottleneck when handling ever-increasing volumes of data<\/a>, slowing system performance.<\/p>\n

HBM-PIM, developed by Samsung, places a\u00a0DRAM<\/a>-optimised AI engine within each memory bank, enabling parallel processing and minimising the movement of data.<\/p>\n

\u201cI\u2019m delighted to see that Samsung is addressing the memory bandwidth\/power challenges for HPC and AI computing,\u201d said Argonne\u2019s associate laboratory director for computing, environment and life sciences, Rick Stevens. Argonne National Laboratory is a US Department of Energy research centre.\u00a0\u00a0<\/p>\n

\u201cHBM-PIM design has demonstrated impressive performance and power gains on important classes of AI applications, so we look forward to working together to evaluate its performance on additional problems of interest to Argonne National Laboratory.\u201d<\/p>\n

Samsung\u2019s innovation is being tested inside AI accelerators by third-parties in the AI sector, with work expected to be completed within the first half of 2021. Early tests with Samsung\u2019s HBM2 Aquabolt memory system demonstrated the performance improvements and power consumption reduction cited previously. <\/p>\n<\/p><\/div>\n","protected":false},"excerpt":{"rendered":"

Keumars Afifi-Sabet<\/p>\n

17 Feb, 2021 <\/p>\n

Samsung has developed a computing architecture that combines memory with\u00a0artificial intelligence (AI)\u00a0processing power to double the performance of data centres and high-performance compu…<\/p>\n","protected":false},"author":433,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[],"tags":[],"class_list":["post-41789","post","type-post","status-publish","format-standard","hentry"],"_links":{"self":[{"href":"https:\/\/icloud.pe\/blog\/wp-json\/wp\/v2\/posts\/41789","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/icloud.pe\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/icloud.pe\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/icloud.pe\/blog\/wp-json\/wp\/v2\/users\/433"}],"replies":[{"embeddable":true,"href":"https:\/\/icloud.pe\/blog\/wp-json\/wp\/v2\/comments?post=41789"}],"version-history":[{"count":1,"href":"https:\/\/icloud.pe\/blog\/wp-json\/wp\/v2\/posts\/41789\/revisions"}],"predecessor-version":[{"id":41790,"href":"https:\/\/icloud.pe\/blog\/wp-json\/wp\/v2\/posts\/41789\/revisions\/41790"}],"wp:attachment":[{"href":"https:\/\/icloud.pe\/blog\/wp-json\/wp\/v2\/media?parent=41789"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/icloud.pe\/blog\/wp-json\/wp\/v2\/categories?post=41789"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/icloud.pe\/blog\/wp-json\/wp\/v2\/tags?post=41789"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}