{"id":41557,"date":"2020-11-13T13:42:26","date_gmt":"2020-11-13T13:42:26","guid":{"rendered":"http:\/\/icloud.pe\/blog\/?guid=19c2214afa95f09e1a15b56a3d576cf0"},"modified":"2020-11-13T13:42:26","modified_gmt":"2020-11-13T13:42:26","slug":"aws-ditches-nvidia-for-in-house-inferentia-silicon","status":"publish","type":"post","link":"https:\/\/icloud.pe\/blog\/aws-ditches-nvidia-for-in-house-inferentia-silicon\/","title":{"rendered":"AWS ditches Nvidia for in-house ‘Inferentia’ silicon"},"content":{"rendered":"


\n Bobby Hellard<\/a><\/span>
\n <\/span><\/p>\n

\n
\n
13 Nov, 2020<\/span><\/div>\n<\/p><\/div>\n<\/div>\n

\n<\/a><\/p>\n

\n

\u200b<\/span>Amazon Web Services (AWS) will ditch\u00a0Nvidia chips responsible for the processing of\u00a0Alexa queries and will instead use its\u00a0own in-house\u00a0silicon, the company confirmed on Friday.<\/p>\n

The cloud giant will\u00a0also be shifting data processing for its cloud-based facial recognition system, ‘Rekognition<\/a>‘, over to these in-house chips, according to Reuters<\/em><\/a>.<\/p>\n

Alexa queries, issued through Amazon’s Echo line of smart speakers, are sent through the company’s data centres\u00a0where they undergo several stages of processing\u00a0before coming\u00a0back to users with an answer, including translating the processed text into audible speech.<\/p>\n

The company said that the “majority” of this processing will now be handled using Amazon’s own “Inferentia” computing chips. These were first launched in 2018 as Amazon’s first custom silicon-designed chips for accelerating deep learning<\/a> workloads.<\/p>\n

Amazon has said that the shift to Inferentia for Alexa processing had resulted in a 25% latency boost and 30% lower cost. The firm hopes the same will happen with its Rekognition system, which has also started to adopt the Inferentia chip.<\/p>\n

The cloud giant didn’t specify which company previously handled Rekognition processing, but the service has come under some scrutiny from civil rights groups for its involvement with law enforcement. Police were temporarily banned<\/a> from using it earlier in the year, following the Black Lives Matter protests.<\/p>\n

Nvidia and Intel are two of the biggest providers of computing chips, often for data centres, with companies like Amazon and Microsoft included in their clientele. However, a number of firms\u00a0have begun to move away from vendors and are bringing the technology in-house. For example, Apple has recently moved away from\u00a0Intel chips in favour of the\u00a0A14 Bionic processors<\/a>, which will be used going forward. <\/p>\n<\/p><\/div>\n","protected":false},"excerpt":{"rendered":"

Bobby Hellard<\/p>\n

13 Nov, 2020 <\/p>\n

\u200bAmazon Web Services (AWS) will ditch\u00a0Nvidia chips responsible for the processing of\u00a0Alexa queries and will instead use its\u00a0own in-house\u00a0silicon, the company confirmed on Friday.
\nThe cloud gian…<\/p>\n","protected":false},"author":403,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[],"tags":[],"class_list":["post-41557","post","type-post","status-publish","format-standard","hentry"],"_links":{"self":[{"href":"https:\/\/icloud.pe\/blog\/wp-json\/wp\/v2\/posts\/41557","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/icloud.pe\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/icloud.pe\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/icloud.pe\/blog\/wp-json\/wp\/v2\/users\/403"}],"replies":[{"embeddable":true,"href":"https:\/\/icloud.pe\/blog\/wp-json\/wp\/v2\/comments?post=41557"}],"version-history":[{"count":1,"href":"https:\/\/icloud.pe\/blog\/wp-json\/wp\/v2\/posts\/41557\/revisions"}],"predecessor-version":[{"id":41558,"href":"https:\/\/icloud.pe\/blog\/wp-json\/wp\/v2\/posts\/41557\/revisions\/41558"}],"wp:attachment":[{"href":"https:\/\/icloud.pe\/blog\/wp-json\/wp\/v2\/media?parent=41557"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/icloud.pe\/blog\/wp-json\/wp\/v2\/categories?post=41557"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/icloud.pe\/blog\/wp-json\/wp\/v2\/tags?post=41557"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}