{"id":39123,"date":"2019-06-13T09:11:53","date_gmt":"2019-06-13T09:11:53","guid":{"rendered":"https:\/\/www.cloudcomputing-news.net\/news\/2019\/jun\/13\/six-pillars-cloud-cost-optimisation-and-how-get-them-work-you\/"},"modified":"2019-06-13T09:11:53","modified_gmt":"2019-06-13T09:11:53","slug":"the-six-pillars-of-cloud-cost-optimisation-and-how-to-get-them-to-work-for-you","status":"publish","type":"post","link":"https:\/\/icloud.pe\/blog\/the-six-pillars-of-cloud-cost-optimisation-and-how-to-get-them-to-work-for-you\/","title":{"rendered":"The six pillars of cloud cost optimisation \u2013 and how to get them to work for you"},"content":{"rendered":"<p><img decoding=\"async\" src=\"http:\/\/www.cloudcomputing-news.net\/media\/img\/news\/decorative-detail-of-an-ancient-ionic-column-picture-id953909568.jpg\"><\/p>\n<div>\n<p style=\"margin-left:0cm; margin-right:0cm\"><span style=\"color:null\"><span style=\"background-color:white\">Let me start by painting the picture: You&rsquo;re the CFO, or manager of a department, group, or team, and you&rsquo;re ultimately responsible for any and all financial costs incurred by your team\/group\/department. Or maybe you&rsquo;re in IT and you&rsquo;ve been told to keep a handle on the costs generated by application use and code development resources. <\/span><\/span><\/p>\n<p style=\"margin-left:0cm; margin-right:0cm\"><span style=\"color:null\"><span style=\"background-color:white\">Your company has moved some or all of your projects and apps to the public cloud, and since things seem to be running pretty smoothly from a production standpoint, most of the company is feeling pretty good about the transition.<\/span><\/span><\/p>\n<p style=\"margin-left:0cm; margin-right:0cm\"><span style=\"color:null\"><span style=\"background-color:white\">Except you.<\/span><\/span><\/p>\n<p style=\"margin-left:0cm; margin-right:0cm\"><span style=\"color:null\"><span style=\"background-color:white\">The promise of moving to the cloud to cut costs hasn&rsquo;t matriculated and attempting to figure out the monthly bill from your cloud provider has you shaking your head.<\/span><\/span><\/p>\n<p style=\"margin-left:0cm; margin-right:0cm\"><span style=\"color:null\"><span style=\"background-color:white\">From reserved instances and on-demand costs, to the &ldquo;unblended&rdquo; and &ldquo;blended&rdquo; rates, attempting to even make sense of the bill has you no closer to understanding where you can optimise your spend.<\/span><\/span><\/p>\n<p style=\"margin-left:0cm; margin-right:0cm\"><span style=\"color:null\"><span style=\"background-color:white\">It&rsquo;s not even just the pricing structure that requires an entire department of accountants to make sense of, the breakdown of the services themselves is just as mind boggling. In fact, there are at least 500,000 SKUs and price combinations in AWS alone! In addition, your team likely has no limitation on who can spin up any specific resource at any time, intrinsically compounding the problem&mdash;especially when staff leave them running, the proverbial meter racking up the $$ in the background.<\/span><\/span><\/p>\n<p style=\"margin-left:0cm; margin-right:0cm\"><span style=\"color:null\"><span style=\"background-color:white\">Addressing this complex and ever-moving problem is not, in fact, a simple matter, and requires a comprehensive and intimate approach that starts with understanding the variety of opportunities available for cost and performance optimisation. This where our six pillars of cloud optimisation come in.<\/span><\/span><\/p>\n<\/div>\n<h3 style=\"margin-left:0cm; margin-right:0cm\"><span style=\"color:null\"><strong><span style=\"background-color:white\">Reserved instances (RIs)<\/span><\/strong><\/span><\/h3>\n<div>\n<p style=\"margin-left:0cm; margin-right:0cm\"><span style=\"color:null\"><span style=\"background-color:white\">AWS Reserved Instances, Azure Reserved VM Instances, and Google Cloud Committed Use Discounts take the ephemeral out of cloud resources, allowing you to estimate up front what you&rsquo;re going to use. This also entitles you to steep discounts for pre-planning, which ends up as a great financial incentive.<\/span><\/span><\/p>\n<p style=\"margin-left:0cm; margin-right:0cm\"><span style=\"color:null\"><span style=\"background-color:white\">Most cloud cost optimisations, erroneously, begin and end here&mdash;providing you and your organisation with a less than optimal solution. Resources to estimate RI purchases are available through cloud providers directly and through third party optimisation tools. For example, CloudHealth by VMware provides a clear picture into where to purchase RI&rsquo;s based on your current cloud use over a number of months and will help you manage your RI lifecycle over time.<\/span><\/span><\/p>\n<p style=\"margin-left:0cm; margin-right:0cm\"><span style=\"color:null\"><span style=\"background-color:white\">Two of the major factors to consider here are <em>Risk Tolerance<\/em> and <em>Centralised RI Management<\/em> portfolios.<\/span><\/span><\/p>\n<\/div>\n<ul>\n<li><span style=\"color:null\"><strong><span style=\"background-color:white\">Risk tolerance<\/span><\/strong><span style=\"background-color:white\"> refers to identifying how much you&rsquo;re willing to spend up front in order to increase the possibility of future gains or recovered profits. For example, can your organisation take a risk and cover 70% of your workloads with RIs? Or do you worry about consumption, and will therefore want to limit that to around 20-30%? Also, how long, in years, are you able to project ahead? One year is the least risky, sure, but three years, while also a larger financial commitment, comes with larger cost savings<\/span><\/span><br \/>\n\t&nbsp;<\/li>\n<li><span style=\"color:null\"><strong><span style=\"background-color:white\">Centralised RI management<\/span><\/strong><span style=\"background-color:white\"> portfolios allow for deeper RI coverage across organisational units, resulting in even greater savings opportunities. For instance, a single application team might have a limited pool of cash in which to purchase RIs. Alternatively, a centralised, whole organisation approach would cover all departments and teams for all workloads, based on corporate goals. This approach, of course, also requires ongoing communication with the separate groups to understand current and future resources needed to create and execute a successful RI management program<\/span><\/span><\/li>\n<\/ul>\n<div>\n<p style=\"margin-left:0cm; margin-right:0cm\"><span style=\"color:null\"><span style=\"background-color:white\">Once you identify your risk tolerance and centralise your approach to RI&rsquo;s you can take advantage of this optimisation option. Though, an RI-only optimisation strategy is short-sighted. It only allows you to take advantage of pricing options that your cloud vendor offers. It is important to overlay RI purchases with the five&nbsp;other optimisation pillars to achieve the most effective optimisation. <\/span><\/span><\/p>\n<\/div>\n<h3 style=\"margin-left:0cm; margin-right:0cm\"><span style=\"color:null\"><strong><span style=\"background-color:white\">Auto-parking<\/span><\/strong><\/span><\/h3>\n<div>\n<p style=\"margin-left:0cm; margin-right:0cm\"><span style=\"color:null\"><span style=\"background-color:white\">One of the benefits of the cloud is the ability to spin up (and down) resources as you need them. However, the downside of this instant technology is that there is very little incentive for individual team members to terminate these processes when they are finished with them. <em>Auto-Parking<\/em> refers to scheduling resources to shut down during the off hours&mdash;an especially useful tool for development and test environments. Identifying your idle resources via a robust tagging strategy is the first step; this allows you to pinpoint resources that can be parked more efficiently. The second step involves automating the spin-up\/spin-down process. Tools like <\/span><\/span><a href=\"https:\/\/www.parkmycloud.com\/\"><span style=\"color:null\"><span style=\"background-color:white\">ParkMyCloud<\/span><\/span><\/a><span style=\"color:null\"><span style=\"background-color:white\">, <\/span><\/span><a href=\"https:\/\/aws.amazon.com\/solutions\/instance-scheduler\/\"><span style=\"color:null\"><span style=\"background-color:white\">AWS Instance Scheduler<\/span><\/span><\/a><span style=\"color:null\"><span style=\"background-color:white\">, <\/span><\/span><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/automation\/automation-solution-vm-management\"><span style=\"color:null\"><span style=\"background-color:white\">Azure Automation<\/span><\/span><\/a><span style=\"color:null\"><span style=\"background-color:white\">, and <\/span><\/span><a href=\"https:\/\/cloud.google.com\/scheduler\/docs\/start-and-stop-compute-engine-instances-on-a-schedule\"><span style=\"color:null\"><span style=\"background-color:white\">Google Cloud Scheduler<\/span><\/span><\/a><span style=\"color:null\"><span style=\"background-color:white\"> can help you manage the entire auto-parking process.<\/span><\/span><\/p>\n<\/div>\n<h3 style=\"margin-left:0cm; margin-right:0cm\"><span style=\"color:null\"><strong><span style=\"background-color:white\">Right-sizing<\/span><\/strong><\/span><\/h3>\n<div>\n<p style=\"margin-left:0cm; margin-right:0cm\"><span style=\"color:null\"><span style=\"background-color:white\">Ah, <em>right-sizing<\/em>, the best way to ensure you&rsquo;re using exactly what you need and not too little or too much. It seems like a no-brainer to just &ldquo;enable right-sizing&rdquo; immediately when you start using a cloud environment. However, without the ability to analyse resource consumption or enable chargebacks, right-sizing becomes a meaningless concept. Performance and capacity requirements for cloud applications often change over time, and this inevitably results in underused and idle resources.<\/span><\/span><\/p>\n<p style=\"margin-left:0cm; margin-right:0cm\"><span style=\"color:null\"><span style=\"background-color:white\">Many cloud providers share <\/span><\/span><a href=\"https:\/\/docs.aws.amazon.com\/whitepapers\/latest\/cost-optimization-right-sizing\/right-sizing-ongoing-process.html\"><span style=\"color:null\"><span style=\"background-color:white\">best practices in right-sizing<\/span><\/span><\/a><span style=\"color:null\"><span style=\"background-color:white\">, though they spend more time explaining the right-sizing options that exist <\/span><\/span><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/migrate\/migrate-best-practices-costs\"><span style=\"color:null\"><em><span style=\"background-color:white\">prior to a cloud migration<\/span><\/em><\/span><\/a><span style=\"color:null\"><span style=\"background-color:white\">. This is unfortunate as right-sizing is an ongoing activity that requires implementing policies and guardrails to reduce overprovisioning, tagging resources to enable department level chargebacks, and properly monitoring CPU, Memory and I\/O, in order to be truly effective.<\/span><\/span><\/p>\n<p style=\"margin-left:0cm; margin-right:0cm\"><span style=\"color:null\"><span style=\"background-color:white\">Right-sizing must also take into account auto-parked resources and RIs available. Do you see a trend here with the optimisation pillars?<\/span><\/span><\/p>\n<div style=\"text-align:center\"><a href=\"https:\/\/www.cybersecuritycloudexpo.com\/\"><img decoding=\"async\" alt=\"\" src=\"https:\/\/www.cloudcomputing-news.net\/media\/uploads\/James\/2019\/03\/14\/imgpsh_fullsize_anim_C9Lchw3.jpg\" style=\"height:94px; width:404px\" \/><\/a><\/div>\n<h3 style=\"margin-left:0cm; margin-right:0cm\"><span style=\"color:null\"><strong><span style=\"background-color:white\">Family refresh<\/span><\/strong><\/span><\/h3>\n<div>\n<p style=\"margin-left:0cm; margin-right:0cm\"><a href=\"https:\/\/docs.aws.amazon.com\/AWSEC2\/latest\/UserGuide\/instance-types.html\"><span style=\"color:null\"><span style=\"background-color:white\">Instance types<\/span><\/span><\/a><span style=\"color:null\"><span style=\"background-color:white\">, <\/span><\/span><a href=\"https:\/\/azure.microsoft.com\/en-us\/pricing\/details\/virtual-machines\/series\/\"><span style=\"color:null\"><span style=\"background-color:white\">VM-series<\/span><\/span><\/a><span style=\"color:null\"><span style=\"background-color:white\"> and &ldquo;Instance Families&rdquo; all describe methods by which cloud providers package up their instances according to the hardware used. Each instance\/series\/family offers different varieties of compute, memory, and storage parameters. Instance types within their set groupings are often retired as a unit when the hardware required to keep them running is replaced by newer technology. Cloud pricing changes directly in relationship to this changing of the guard, as newer systems replace the old. This is called <em>Family Refresh<\/em>.<\/span><\/span><\/p>\n<p style=\"margin-left:0cm; margin-right:0cm\"><span style=\"color:null\"><span style=\"background-color:white\">Up-to-date knowledge of the instance types\/families being used within your organisation is a vital component to estimating when your costs will fluctuate. Truth be told, though, with over 500,000 SKU and price combinations for any single cloud provider, that task seems downright impossible.<\/span><\/span><\/p>\n<p style=\"margin-left:0cm; margin-right:0cm\"><span style=\"color:null\"><span style=\"background-color:white\">Some tools exist, however, that can help monitor\/estimate <em>Family Refresh<\/em>, though they often don&rsquo;t take into account the overlap that occurs with RIs&mdash;or upon application of any of the other pillars of optimisation. As a result, for many organisations, <em>Family Refresh<\/em> is the manual, laborious task it sounds like. Thankfully, we&rsquo;ve found ways to automate the suggestions through our <\/span><\/span><a href=\"https:\/\/www.2ndwatch.com\/wp-content\/uploads\/2018\/10\/Cloud-Cost-Optimization-Discovery-Session_Multi-Cloud.pdf\"><span style=\"color:null\"><span style=\"background-color:white\">optimisation service offering<\/span><\/span><\/a><span style=\"color:null\"><span style=\"background-color:white\">.<\/span><\/span><\/p>\n<\/div>\n<h3 style=\"margin-left:0cm; margin-right:0cm\"><span style=\"color:null\"><strong><span style=\"background-color:white\">Waste<\/span><\/strong><\/span><\/h3>\n<div>\n<p style=\"margin-left:0cm; margin-right:0cm\"><span style=\"color:null\"><span style=\"background-color:white\">Related to the issue of instances running long past their usefulness, waste is prevalent in cloud. Waste may seem like an abstract concept when it comes to virtual resources, but each wasted unit in this case = $$ spent for no purpose. And, when there is no limit to the amount of resources you can use, there is also no incentive to individuals using the resources to self-regulate their unused\/under-utilised instances. Some examples of waste in the cloud include:<\/span><\/span><\/p>\n<\/div>\n<ul>\n<li><span style=\"color:null\"><span style=\"background-color:white\">AWS RDSs or Azure SQL DBs without a connection<\/span><\/span><\/li>\n<li><span style=\"color:null\"><span style=\"background-color:white\">Unutilised AWS EC2s<\/span><\/span><\/li>\n<li><span style=\"color:null\"><span style=\"background-color:white\">Azure VMs that were spun up for training or testing<\/span><\/span><\/li>\n<li><span style=\"color:null\"><span style=\"background-color:white\">Dated snapshots that are holding storage space that will never be useful<\/span><\/span><\/li>\n<li><span style=\"color:null\"><span style=\"background-color:white\">Idle load balancers<\/span><\/span><\/li>\n<li><span style=\"color:null\"><span style=\"background-color:white\">Unattached volumes<\/span><\/span><\/li>\n<\/ul>\n<div>\n<p style=\"margin-left:0cm; margin-right:0cm\"><span style=\"color:null\"><span style=\"background-color:white\">Identifying waste takes time and accurate reporting. It is a great reason to invest the time and energy in developing a proper tagging strategy, however, since waste will be instantly traceable to the organisational unit that incurred it, and therefore, easily marked for review and\/or removal. We&rsquo;ve often seen companies buy RIs before they eliminate waste, which, without fail, causes them to overspend in cloud &ndash; for at least a year.<\/span><\/span><\/p>\n<\/div>\n<h3 style=\"margin-left:0cm; margin-right:0cm\"><span style=\"color:null\"><strong><span style=\"background-color:white\">Storage<\/span><\/strong><\/span><\/h3>\n<div>\n<p style=\"margin-left:0cm; margin-right:0cm\"><span style=\"color:null\"><span style=\"background-color:white\">Storage in the cloud is a great way to reduce on-premises hardware spend. That said, though, because it is so effortless to use, cloud storage can, in a very short matter of time, expand exponentially, making it nearly impossible to predict accurate cloud spend. Cloud storage is usually charged by four characteristics:<\/span><\/span><\/p>\n<\/div>\n<ul>\n<li><span style=\"color:null\"><span style=\"background-color:white\">Size &ndash; how much storage do you need?<\/span><\/span><\/li>\n<li><span style=\"color:null\"><span style=\"background-color:white\">Data transfer (bandwidth) &ndash; how often does your data need to move from one location to another?<\/span><\/span><\/li>\n<li><span style=\"color:null\"><span style=\"background-color:white\">Retrieval time &ndash; how quickly do you need to access your data?<\/span><\/span><\/li>\n<li><span style=\"color:null\"><span style=\"background-color:white\">Retrieval requests &ndash; how often do you need to access your data?<\/span><\/span><\/li>\n<\/ul>\n<div>\n<p style=\"margin-left:0cm; margin-right:0cm\"><span style=\"color:null\"><span style=\"background-color:white\">There are a variety of options for different use cases including using more file storage, databases, data backup and\/or data archives. Having a solid data lifecycle policy will help you estimate these numbers, and ensure you are both right-sizing and using your storage quantity and bandwidth to its greatest potential at all times.<\/span><\/span><\/p>\n<p style=\"margin-left:0cm; margin-right:0cm\"><span style=\"color:null\"><span style=\"background-color:white\">So, you see, each of these six pillars of optimisation houses many moving parts, and what with public cloud providers constantly modifying their service offerings and pricing, it seems wrangling in your wayward cloud is unlikely. Plus, optimising only one of the pillars without considering the others offers little to no improvement, and can, in fact, unintentionally cost you more money over time. An efficacious optimisation process <em>must take all pillars <\/em>and the way they overlap into account, institute the right policies and guardrails to ensure cloud sprawl doesn&rsquo;t continue, and implement the right tools to allow your team regularly to make informed decisions.<\/span><\/span><\/p>\n<p style=\"margin-left:0cm; margin-right:0cm\"><span style=\"color:null\"><span style=\"background-color:white\">The good news is that the future is bright. Once you have assessed your current environment, taken the pillars into account, made the changes required to optimise your cloud, and found a method by which to make this process continuous, you can investigate optimisation through application refactoring, ephemeral instances, spot instances and serverless architecture.<\/span><\/span><\/p>\n<p style=\"margin-left:0cm; margin-right:0cm\"><a href=\"https:\/\/www.cybersecuritycloudexpo.com\/\" style=\"color:#0563c1; text-decoration:underline\"><span style=\"color:blue\"><img decoding=\"async\" alt=\"https:\/\/www.cybersecuritycloudexpo.com\/wp-content\/uploads\/2018\/09\/cyber-security-world-series-1.png\" src=\"https:\/\/www.cybersecuritycloudexpo.com\/wp-content\/uploads\/2018\/09\/cyber-security-world-series-1.png\" style=\"height:59px; width:272px\" \/><\/span><\/a><strong>Interested in hearing industry leaders discuss subjects like this and sharing their experiences and use-cases<\/strong>? Attend the <a href=\"https:\/\/www.cybersecuritycloudexpo.com\/\" style=\"color:#0563c1; text-decoration:underline\">Cyber Security &amp; Cloud Expo World Series<\/a> with upcoming events in Silicon Valley, London and Amsterdam to learn more.<\/p>\n<\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>Let me start by painting the picture: You&rsquo;re the CFO, or manager of a department, group, or team, and you&rsquo;re ultimately responsible for any and all financial costs incurred by your team\/group\/department. Or maybe you&rsquo;re in IT and you&#8230;<\/p>\n","protected":false},"author":569,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[],"tags":[],"class_list":["post-39123","post","type-post","status-publish","format-standard","hentry"],"_links":{"self":[{"href":"https:\/\/icloud.pe\/blog\/wp-json\/wp\/v2\/posts\/39123","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/icloud.pe\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/icloud.pe\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/icloud.pe\/blog\/wp-json\/wp\/v2\/users\/569"}],"replies":[{"embeddable":true,"href":"https:\/\/icloud.pe\/blog\/wp-json\/wp\/v2\/comments?post=39123"}],"version-history":[{"count":1,"href":"https:\/\/icloud.pe\/blog\/wp-json\/wp\/v2\/posts\/39123\/revisions"}],"predecessor-version":[{"id":39124,"href":"https:\/\/icloud.pe\/blog\/wp-json\/wp\/v2\/posts\/39123\/revisions\/39124"}],"wp:attachment":[{"href":"https:\/\/icloud.pe\/blog\/wp-json\/wp\/v2\/media?parent=39123"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/icloud.pe\/blog\/wp-json\/wp\/v2\/categories?post=39123"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/icloud.pe\/blog\/wp-json\/wp\/v2\/tags?post=39123"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}