{"id":42060,"date":"2021-05-04T13:55:33","date_gmt":"2021-05-04T13:55:33","guid":{"rendered":"http:\/\/icloud.pe\/blog\/?guid=268ef53218cbae7310b18a90e760334f"},"modified":"2021-05-04T13:55:33","modified_gmt":"2021-05-04T13:55:33","slug":"microsoft-launches-open-source-tool-counterfeit-to-prevent-ai-hacking","status":"publish","type":"post","link":"https:\/\/icloud.pe\/blog\/microsoft-launches-open-source-tool-counterfeit-to-prevent-ai-hacking\/","title":{"rendered":"Microsoft launches open source tool Counterfeit to prevent AI hacking"},"content":{"rendered":"


\n Keumars Afifi-Sabet<\/a><\/span>
\n <\/span><\/p>\n

\n
\n
4 May, 2021<\/span><\/div>\n<\/p><\/div>\n<\/div>\n

\n<\/a><\/p>\n

\n

Microsoft has launched an open source<\/a> tool to help\u00a0developers assess the security of their machine learning systems.<\/p>\n

The Counterfit project, now available on GitHub<\/a>, comprises a command-line tool and generic automation layer to allow developers to simulate cyber attacks against AI systems<\/a>.<\/p>\n

Microsoft\u2019s red team have used Counterfit to test its own AI models, while the wider company is also exploring using the tool in AI development.<\/p>\n

Anyone can download the tool and deploy it through Azure Shell, to run in-browser, or locally in an Anaconda Python environment.<\/p>\n

It can assess AI models hosted in various cloud environments, on-premises, or in the edge<\/a>. Microsoft also promoted its flexibility by highlighting the fact\u00a0that it\u2019s agnostic to AI models and also supports\u00a0a variety of data types, including text, images, or generic input.<\/p>\n

\u201cOur tool makes published attack algorithms accessible to the security community and helps to provide an extensible interface from which to build, manage, and launch attacks on AI models,\u201d Microsoft said.<\/p>\n

\u201cThis tool is part of broader efforts at Microsoft to empower engineers to securely develop and deploy AI systems.\u201d<\/p>\n

The three key ways that security professionals can deploy Counterfit is by pen testing and red teaming AI systems, scanning AI systems for vulnerabilities, and logging attacks against AI models.<\/p>\n

The tool comes preloaded with attack algorithms<\/a>, while security professionals can also use the built-in cmd2 scripting engine to hook into Counterfit from existing offensive tools for testing purposes.<\/p>\n

Optionally, businesses can scan AI systems with relevant attacks any number of times to create baselines, with continuous runs as vulnerabilities are addressed, helping to measure ongoing progress.<\/p>\n

Microsoft developed the tool out of a need to assess its own systems for vulnerabilities. Counterfit began life as a handful of attack scripts written to target individual AI models, and gradually evolved into an automation tool to attack multiple systems at scale.<\/p>\n

The company claims it\u2019s engaged with a variety of its partners, customers, and government entities in testing the tool against machine learning models in their own environments. <\/p>\n<\/p><\/div>\n","protected":false},"excerpt":{"rendered":"

Keumars Afifi-Sabet<\/p>\n

4 May, 2021 <\/p>\n

Microsoft has launched an open source tool to help\u00a0developers assess the security of their machine learning systems.
\nThe Counterfit project, now available on GitHub, comprises a command-li…<\/p>\n","protected":false},"author":433,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[],"tags":[],"class_list":["post-42060","post","type-post","status-publish","format-standard","hentry"],"_links":{"self":[{"href":"https:\/\/icloud.pe\/blog\/wp-json\/wp\/v2\/posts\/42060","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/icloud.pe\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/icloud.pe\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/icloud.pe\/blog\/wp-json\/wp\/v2\/users\/433"}],"replies":[{"embeddable":true,"href":"https:\/\/icloud.pe\/blog\/wp-json\/wp\/v2\/comments?post=42060"}],"version-history":[{"count":1,"href":"https:\/\/icloud.pe\/blog\/wp-json\/wp\/v2\/posts\/42060\/revisions"}],"predecessor-version":[{"id":42061,"href":"https:\/\/icloud.pe\/blog\/wp-json\/wp\/v2\/posts\/42060\/revisions\/42061"}],"wp:attachment":[{"href":"https:\/\/icloud.pe\/blog\/wp-json\/wp\/v2\/media?parent=42060"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/icloud.pe\/blog\/wp-json\/wp\/v2\/categories?post=42060"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/icloud.pe\/blog\/wp-json\/wp\/v2\/tags?post=42060"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}