From research to reality: How the cloud is powering AI


Cloud Pro

18 Apr, 2019

Whether it’s pocket-sized mobile communicators, cars that can drive themselves or a global information-sharing network, scientists and researchers have a history of turning the marvels of technology dreamed up by science fiction writers into reality – and the composer of that endeavour is the creation of artificial intelligence.

Although we’re still some way from being served by self-aware robot butlers that can reliably pass the Turing test, AI technology has progressed immeasurably in the last decade alone. AI has moved from being the sole province of research projects working with giant supercomputers to something that all of us carry around in our pockets, and cloud computing has been a huge part of that move from research to reality.

The most foundational change came when public cloud offerings like Amazon Web Services and Google Cloud Platform became widely available. The development of AI using methods such as, deep-learning and neural networks requires a considerable amount of compute power. Once it became possible to rent as many servers as you needed from a cloud provider, tasks that were once only possible by universities and science labs suddenly became accessible to everyone.

Moreover, these servers take advantage of best-in-class hardware from Intel, featuring technical developments specifically designed to enable AI. For example, high-performance Xeon Scalable chips and low-latency Optane Memory. On top of this, many cloud platform providers have, in recent years, started to specifically cater to machine learning and AI development, offering servers and services tailored to make training deep-learning models quicker and easier than ever.

As these barriers to entry come down, companies and hobbyists around the world have started experimenting with machine learning and AI, exploring the possibilities and pushing the boundaries of what it can do. Much of this research has been shared with the wider community under open source licenses. A key example of is TensorFlow™, a machine learning library developed internally by Google and shared freely with the rest of the world.

Alongside the compute power to train deep-learning models, the cloud has also provided the datasets on which to train them. The development of AI has gone hand in hand with the big data boom, as companies start gathering and storing exponentially more data for analytical purposes. A side effect of this is that there are now huge corpuses of data that can be fed into machine learning models in order to train them in tasks like pattern recognition, clustering and regression.

All of this makes it much easier to improve and develop AI technology, but there’s one key reason that it’s now a legitimate business tool rather than simply a technical endeavour, and that’s the ease of consumption that cloud models offer. It’s so much easier for customers and end-users to consume AI tools running in the cloud as part of a SaaS application compared to traditional on-premise software.

None of the processing is done locally, so there’s no hardware requirements, and because the vendor is responsible for maintaining the AI on a day-to-day basis, there’s no need to hire machine learning or AI specialists. With no extra effort or investment required, companies are becoming more and more comfortable with the idea of integrating AI processes into their day-to-day workflows.

The general public has also grown increasingly familiar with AI technology thanks to the growing prevalence of AI-powered digital assistants like Siri, Alexa and Cortana. These services have helped acclimatise people to working with AI, as well as opening their eyes to the benefits offered by the technology.

These factors have made developing commercial AI more viable, resulting in an explosion of AI-enabled tools and services, many of which have been snapped up by cloud giants like Google and Salesforce and integrated into their product portfolios. Most cloud storage companies, for instance, augment their search capabilities by using machine vision algorithms to accurately identify objects in photographs or text in documents.

AI is also increasingly being used by companies as an initial point of contact for customer service, with chatbots handling Tier One support queries and sales inquiries. A far cry from the long-established automated telephone menus, these programs are intelligent and responsive, and are becoming increasingly common.

It’s not just public clouds that have spurred AI advancements; private and hybrid cloud deployments have also seen a great deal of change. Banking is one area where AI can have a huge impact in terms of analysing huge quantities of data very quickly, but for regulatory reasons, financial firms often can’t – or won’t – use public cloud providers. Instead, these institutions use private clouds to run custom-built or specially-adapted machine learning algorithms to sort through their data.

Intel’s advancements in processor technology have brought cloud-scale computing power within the reach of companies operating their own private cloud, meaning that you no longer need a sizeable data centre to run machine learning applications. Instead, you can run AI tasks on as little as one rack, depending on the size of the deployment. This enables you to keep total control of your data and infrastructure, whilst still taking advantage of cloud-style consumption and delivery models.

In the comparatively short timeframe that cloud computing has been a mainstream phenomenon, AI has gone from being the preserve of academics to a day-to-day reality for businesses around the world; used to perform all kinds of diverse tasks from data analysis to customer service. Machine learning applications are now being developed, deployed and delivered via cloud platforms, empowered and enabled by Intel’s next generation data centre technologies. Whether you’re looking to run your AI applications on a public, private, virtual private or hybrid cloud, Intel is making your AI smarter, stronger and faster than ever before.

Discover more about cloud innovations at Intel.co.uk

The evolution of the data centre


Cloud Pro

18 Apr, 2019

Whether it’s making a credit card purchase, messaging your friends or even simply ordering a pizza, virtually all of the things we do on a daily basis are powered and supported by data centres.

But the data centres we rely on today are a far cry from the technology of the past; they’ve changed almost immeasurably since digital computing took its first early steps in the 1950s and ‘60s. Processing power and capacity have increased exponentially over the years and the infrastructure needed to support modern applications has grown ever more complex.

These advances have been driven by the growing demands of both businesses and consumers. First, the birth of the internet led to an explosion in the amount of people consuming online services, which necessitated vast increases in the amount of processing power and capacity that data centres had to offer.

Before long, the need for server capacity spawned the creation of third-party providers, who would host companies’ servers in their own facility, thus removing the initial expense and ongoing overheads of setting up an on-premise data centre for companies. Eventually, as network technology and connectivity improved, this gave way to the cloud computing model where companies rent space not in a data centre, but on the server itself.

Cloud computing has been a major catalyst for change in the data centre; not only have many operating models fundamentally shifted as a result as a result of its rise, but it’s also driven technological advancements like multi-tenant systems, lightning-fast storage and AI applications.

Processing

One of the most foundational changes in data centre technology was the advent of multi-core processors around the turn of the millennium. By fitting two or more processing cores onto a single die, chip manufacturers could radically boost the total performance of data centre hardware, allowing the same workloads to be run with fewer machines.

Multi-core processing also brought huge advantages to virtualisation, which has been a linchpin of the data centre’s growth. Because each processing core runs in parallel with the others, multi-core systems can run huge amounts of virtual machines simultaneously with minimal drops in performance, vastly increasing the amount of applications that can be run at once.

Containerisation has had a similar impact; each VM can host multiple containers within it, each of which can host its own application. This allows data centres to exponentially multiply their capacity for applications. As well as spearheading the continued advancement of multi-core processing, Intel has also been a leader in developing virtualisation and container technology, working with engineering partners to make containers and VMs lighter, faster and more resilient.

Cooling

Data centre equipment is highly powerful, but all that power generates large amounts of heat. Unfortunately, server processors are highly sensitive, and need to be kept below a certain temperature in order to ensure optimal performance. In order to maintain this, data centres have to be very carefully climate-controlled, relying on complex and expensive cooling systems that are often the second-largest consumers of power.

While these cooling systems are still very necessary, Intel’s continued advancement in processor technology has made server processors more thermally efficient, generating less heat and therefore requiring less cooling. On top of that, the company also introduced sensors to its server chips in 2011 which allow data centre administrators to measure the temperature and airflow within a data centre. This enables them to better identify hot and cold spots, modelling the placement of new racks and equipment according to temperature conditions.

Along with preventing costly outages, increasing thermal efficiency throughout the data centre also prolongs the lifespan of the servers themselves and reduces the amount of overall cooling necessary, thereby saving administrators money in terms of the substantial operational costs incurred by cooling efforts.

Power

Intel has also steadily improved the power efficiency of its data centre products. Newer chips like its Xeon Scalable range offer greater performance than previous generations, while consuming less electricity. As with improved cooling performance, this saves data centre operators money in operational costs, but it also allows more chips to be packed into the same physical space.

This means that companies can eke more computational power out of the same resources, without needing to invest in more cabinets, increased power consumption or more cooling. Space efficiency is a key concern, too; floor space within a data centre is often in high demand, so the more physical components that can be packed into a single rack, the better.

Storage

The move from traditional spinning-platter HDDs to SSDs was a huge leap forward in this regard, as it meant that storage drives could take up much less space inside a server, albeit at a higher cost. SSDs were also much faster than HDDs at accessing the data stored on them, greatly speeding up overall server operations and enabling much faster performance for tasks like data analytics.

Intel has been instrumental in advancing storage technology through its partnership with Micron, which involved introducing data striping for increased performance and pioneering high-reliability enterprise drives. It also led the workgroup that developed NVMe technology and, more recently, co-developed 3D Xpoint memory technology, which offers unparalleled speeds for low-latency workloads. You may be familiar with Intel’s Optane range of memory and storage products, all of which are powered by 3D Xpoint.

The end result of all of these numerous changes, developments and advancements has been modern data centres, which are capable of supporting complex, cloud-native workloads. Gone are the days of monolithic mainframes supporting single applications; now, data centres play host to hundreds upon hundreds of sophisticated, multi-core, multi-processor servers, each making use of advanced software-defined networking and low-latency solid state storage drives to power millions of simultaneous applications and processes.

Intel has been at the heart of this change for decades, drawing on its engineering heritage and world-class research expertise to push the boundaries of what data centres are capable of. Whether it’s Optane storage technology, high-performance Xeon Platinum processors or the intelligent software supporting virtualised and containerised applications, Intel remains at the bleeding edge of enterprise processing technology.

Discover more about data storage innovations at Intel.co.uk

Salesforce boosts Einstein portfolio to add more AI into the cloud


Clare Hopping

18 Apr, 2019

Salesforce has unveiled a suite of new Einstein features that will enable developers to custom build AI integrations and machine learning into their apps without labouring over code.

The Einstein Platform Services platform has been enhanced to offer developers more advanced tools, including the drag and drop Einstein Translation feature that can translate any object or field seamlessly.

For example, if a business is dealing with a customer whose native language doesn’t match the operator’s language set, they can be re-routed automatically to a staff member that can communicate in the caller’s native tongue.

Einstein Optical Character Recognition reads documents and autonomously updates the records in Salesforce, saving vital resources that are sometimes wasted on such time-consuming tasks, while Einstein Prediction Builder makes use of Einstein’s powerful prediction capabilities, helping admins build AI models on Salesforce fields or objects.

With Einstein Predictions Service, admins are also able to embed these predictions into third-party systems, whether ERP apps, HR apps or other platforms that need a predictive analytics boost. For example, if Einstein predicts that employees are feeling dissatisfied in the workplace, these predictions can be absorbed into a business’s talent management platform to help advise a future retention strategy.

“The promise of AI is no longer reserved for data scientists. With Einstein, we are empowering developers and admins — the lifeblood of every Salesforce deployment — to make customizable AI a reality for their business,” said John Ball, EVP and general manager at Salesforce Einstein.

“But our mission goes beyond just making the technology more accessible, we are committed to democratizing AI that people can trust and use appropriately.”

Insights 2019: Epicor extends Microsoft Azure partnership to power fresh ERP enhancements


Keumars Afifi-Sabet

17 Apr, 2019

Epicor has built on its partnership with Microsoft Azure to roll out major artificial intelligence (AI) and Internet of Things (IoT) enhancements to its suite of enterprise resource planning (ERP) tools.

Manufacturers and distributors will benefit from upgrades to the company’s Epicor ERP and Prophet 21 platforms respectively, powered by closer integration with Microsoft’s Azure cloud platform almost a year after this partnership was first announced.

Details of both releases were outlined by Epicor’s chief product and technology officer Himanshu Palsule at the company’s annual Insights customer conference, hosted this year at Mandalay Bay, Las Vegas.

In particular, this Azure base layer will power the company’s digital assistant Epicor Virtual Agent (EVA), as well as render better connectivity between people and smart machines in the firm’s Epicor ERP platform for manufacturers.

«We’ve made great progress in moving many of you onto the Azure platform,» Palsule said during his keynote address. «And as you saw with EVA and the connected enterprise, we have now started using the platform elements of Azure.

«We’ve started using the service levels, service fabric and the IoT Hub and other parts of that. And that’s always been our strategy.»

Improvements to the manufacturer-centric Epicor ERP platform sees a host of tools such as AI and analytics integrate with the system to enhance the company’s vision for a ‘connected enterprise’.

The Epicor IoT module, in particular, will connect smart machines across the manufacturing floor to Microsoft’s Azure IoT Hub, with data pulled directly from sensors and visualised on the ERP home page.

Meanwhile, the Prophet 21 web-based app, targeted at distributors, is encouraging its customers to embrace the public cloud to transform their business processes.

This app was recently ported onto the public cloud in its entirety, with software engineers telling Cloud Pro the most exciting part of the shift is customers’ newfound ability to use the product on any device, from tablets to iMacs.

The latest releases of Epicor’s ERP tools for manufacturers and distributors make steps towards realising ambitions set out last year, when the strategic partnership was first outlined last year.

As to where the company aims to take this in the future, Palsule told the press at a Q&A following the keynote that customers whose own platforms are tied to Azure will in future be able to draw additional benefits.

He also outlined how the partnership would work in practice, and address concerns around security, saying the firm resisted any temptation of trying to solve it themselves.

«The way it works is you get the machines communicate with the IoT Hub, the IoT Hub has a certain restriction on security protocols. Then that data then goes into ERP and communicates back,» said Palsule.

«Everything that we’re doing follows the standard Microsoft protocols so we are relying heavily on this partnership to give us security.»

Meanwhile, for Microsoft, the company sees this partnership as the perfect marriage between the underlying cloud infrastructure and the niche expertise that a partner in the mould of Epicor can offer.

«We got our engineering teams together we sat down, and ultimately worked out all the architectural designs,» Microsoft’s partner director for global ISV alliances and business development Don Woods told Cloud Pro.

«We put the ERP into Azure, and then started going to customers and said ‘look, you want to get into the cloud? Epicor’s moving into the cloud. It’s going to SaaS. You want to benefit from all this? Join us in that movement’.

«And Epicor wanted to make sure that the customers had that capability, because that’s where it’s going.»

VMware’s blockchain now integrates with DAML smart contract language

VMware’s move into the blockchain space represents the latest cloud vendor getting involved with the technology – and it has been enhanced with the announcement of an integration with Digital Asset.

Digital Asset, which operates DAML, an open source language for constructing smart contracts, is integrating the latter with the VMware Blockchain platform. The move to open source DAML was relatively recent, and the company noted this importance when combining with an enterprise-flavoured blockchain offering.

“DAML has been proven to be one of the few smart contract languages capable of modelling truly complex workflows at scale. VMware is delighted to be working together on customer deployments to layer VMware Blockchain alongside DAML,” said Michael DiPetrillo, senior director of blockchain at VMware. “Customers demand choice of language execution environments from their blockchain and DAML adds a truly robust and enterprise-focused language set to a blockchain platform with multi-language support.”

The timeline of the biggest cloud players and their interest in blockchain technologies is an interesting one. Microsoft’s initiatives have been long-standing, as have IBM’s, while Amazon Web Services (AWS) went back on its word to launch a blockchain service last year. VMware launched its own project, Project Concord, at VMworld in Las Vegas last year but followed this up with VMware Blockchain in beta in November.

Despite the interest around blockchain as a whole, energy consumption has been a target for VMware CEO Pat Gelsinger, who at a press conference in November described the technology’s computational complexity as ‘almost criminal.’

VMware was named by Forbes earlier this week in its inaugural Blockchain 50. The report – which carries similarities to its annual Cloud 100 rankings – aimed to provide analysis on those with the most exciting initiatives based in the US and who had a minimum valuation of sales of $1 billion.

https://www.cybersecuritycloudexpo.com/wp-content/uploads/2018/09/cyber-security-world-series-1.pngInterested in hearing industry leaders discuss subjects like this and sharing their experiences and use-cases? Attend the Cyber Security & Cloud Expo World Series with upcoming events in Silicon Valley, London and Amsterdam to learn more.

The state of cloud business intelligence 2019: Digging down on Dresner’s analysis

  • An all-time high 48% of organisations say cloud BI is either “critical” or “very important” to their operations in 2019
  • Marketing and sales place the greatest importance on cloud BI in 2019
  • Small organisations of 100 employees or fewer are the most enthusiastic, perennial adopters and supporters of cloud BI
  • The most preferred cloud BI providers are Amazon Web Services and Microsoft Azure.

These and other insights are from Dresner Advisory Services’ 2019 Cloud Computing and Business Intelligence Market Study. The 8th annual report focuses on end-user deployment trends and attitudes toward cloud computing and business intelligence (BI), defined as the technologies, tools, and solutions that rely on one or more cloud deployment models. What makes the study noteworthy is the depth of focus around the perceived benefits and barriers for cloud BI, the importance of cloud BI, and current and planned usage.

“We began tracking and analysing the cloud BI market dynamic in 2012 when adoption was nascent. Since that time, deployments of public cloud BI applications are increasing, with organisations citing substantial benefits versus traditional on-premises implementations,” said Howard Dresner, founder, and chief research officer at Dresner Advisory Services. Please see page 10 of the study for specifics on the methodology.

Key insights gained from the report include the following:

An all-time high 48% of organisations say cloud BI is either “critical” or “very important” to their operations in 2019

Organisations have more confidence in cloud BI than ever before, according to the study’s results. 2019 is seeing a sharp upturn in cloud BI’s importance, driven by the trust and credibility organisations have for accessing, analysing and storing sensitive company data on cloud platforms running BI applications.

Marketing and sales place the greatest importance on cloud BI in 2019

Business intelligence competency centres (BICC) and IT departments have an above-average interest in cloud BI as well, with their combined critical and very important scores being over 50%.

Dresner’s research team found that operations had the greatest duality of scores, with critical and not important being reported at comparable levels for this functional area. Dresner’s analysis indicates operations departments often rely on cloud BI to benchmark and improve existing processes while re-engineering legacy process areas.

Small organisations – of 100 employees or fewer – are the most enthusiastic, perennial adopters and supporters of cloud BI

As has been the case in previous years’ studies, small organisations are leading all others in adopting cloud BI systems and platforms.  Perceived importance declines only slightly in mid-sized organisations (101-1,000 employees) and some large organisations (1,001-5,000 employees), where minimum scores of important offset declines in critical.

The retail/wholesale industry considers cloud BI the most important, followed by technology and advertising industries

Organisations competing in the retail/wholesale industry see the greatest value in adopting cloud BI to gain insights into improving their customer experiences and streamlining supply chains. Technology and advertising industries are industries that also see cloud BI as very important to their operations. Just over 30% of respondents in the education industry see cloud BI as very important.

R&D departments are the most prolific users of cloud BI systems today, followed by marketing and sales

The study highlights that R&D leading all other departments in existing cloud BI use reflects broader potential use cases being evaluated in 2019. Marketing & Sales is the next most prolific department using cloud BI systems.

Finance leads all others in their adoption of private cloud BI platforms, rivaling IT in their lack of adoption for public clouds

R&D departments are the next most likely to be relying on private clouds currently. Marketing and sales are the most likely to take a balanced approach to private and public cloud adoption, equally adopting private and public cloud BI.

Advanced visualisation, support for ad-hoc queries, personalised dashboards, and data integration/data quality tools/ETL tools are the four most popular cloud BI requirements in 2019

Dresner’s research team found the lowest-ranked cloud BI feature priorities in 2019 are social media analysis, complex event processing, big data, text analytics, and natural language analytics. This years’ analysis of most and least popular cloud BI requirements closely mirror traditional BI feature requirements.

Marketing and sales have the greatest interest in several of the most-required features including personalised dashboards, data discovery, data catalog, collaborative support, and natural language analytics

Marketing and sales also have the highest level of interest in the ability to write to transactional applications. R&D leads interest in ad-hoc query, big data, text analytics, and social media analytics.

The retail/wholesale industry leads interest in several features including ad-hoc query, dashboards, data integration, data discovery, production reporting, search interface, data catalog, and ability to write to transactional systems

Technology organisations give the highest score to advanced visualisation and end-user self-service. Healthcare respondents prioritise data mining, end-user data blending, and location analytics, the latter likely for asset tracking purposes. In-memory support scores highest with Financial Services respondent organisations.

Marketing and sales rely on a broader base of third party data connectors to get greater value from their cloud BI systems than their peers

The greater the scale, scope and depth of third-party connectors and integrations, the more valuable marketing and sales data becomes. Relying on connectors for greater insights into sales productivity & performance, social media, online marketing, online data storage, and simple productivity improvements are common in marketing and sales. Finance requiring integration to Salesforce reflects the CRM applications’ success transcending customer relationships into advanced accounting and financial reporting.

Subscription models are now the most preferred licensing strategy for cloud BI and have progressed over the last several years due to lower risk, lower entry costs, and lower carrying costs

Dresner’s research team found that subscription license and free trial (including trial and buy, which may also lead to subscription) are the two most preferred licensing strategies by cloud BI customers in 2019. Dresner Advisory Services predicts new engagements will be earned using subscription models, which is now seen as, at a minimum, important to approximately 90% of the base of respondents.

60% of organisations adopting cloud BI rank Amazon Web Services first, and 85% rank AWS first or second

43% choose Microsoft Azure first and 69% pick Azure first or second. Google Cloud closely trails Azure as the first choice among users but trails more widely after that. IBM Bluemix is the first choice of 12% of organisations responding in 2019.

https://www.cybersecuritycloudexpo.com/wp-content/uploads/2018/09/cyber-security-world-series-1.pngInterested in hearing industry leaders discuss subjects like this and sharing their experiences and use-cases? Attend the Cyber Security & Cloud Expo World Series with upcoming events in Silicon Valley, London and Amsterdam to learn more.

Microsoft doubles internal carbon tax to drive green data centres


Clare Hopping

17 Apr, 2019

Microsoft has vowed to “do more” to cut down the company’s carbon footprint and its latest initiative is to double its internal carbon fee to $15 per metric ton on all carbon emissions, making its departments accountable for cutting emissions.

It means that each departments’ emissions will be continuously scrutinised and budget must be set aside for the tax. The money raised from this penalty will be re-injected into the company’s carbon neutrality efforts and fund new tech initiatives to boost sustainability.

Some of these funded projects include the development of sustainable campuses and data centres, including its HQs in Washington and Redmond.

“In practice, this means we’ll continue to keep our house in order and improve it, while increasingly addressing sustainability challenges around the globe by engaging our strongest assets as a company – our employees and our technologies,” said Microsoft president Brad Smith.

Microsoft will invest in sustainability data research, analysing information to advise scientists about the state of the planet via schemes such as the AI For Earth Programme.

The Redmond company said it’s going to help its customers build more sustainable futures too, helping them identify how they can be more conscious of the environment and helping them build and reach their own carbon footprint targets.

Finally, the company will push for change. Microsoft announced it’s joined the Climate Leadership Council to help identify and drive forward worldwide initiatives to save our planet.

“Addressing these global environmental challenges is a big task,” Smith added. “Meeting this raised ambition will take the work of everyone across Microsoft, as well as partnerships with our customers, policymakers and organizations around the world. This road map is far from complete, but it’s a first step in our renewed commitment to sustainability.”

The unforgiving cycle of cloud infrastructure costs – and the CAP theorem which drives it

Long read Modern enterprises that need to ship software are constantly caught in a race for optimisation, whether in terms of speed (time to ship/deploy), ease of use or, inevitably, cost. What makes this a never-ending cycle is that these goals are often at odds with each other.

The choices that organisations make usually inform what they’re optimising for. At a fundamental level, these are the factors that drive, for example, whether enterprises use on-premises infrastructure or public clouds, open source or closed source software, or even certain technologies – such as containers versus virtual machines.

With this in mind, it is prudent to take a deeper look into the factors that drive this cyclical nature of cloud infrastructure optimisations, and how enterprises move through the various stages of their optimisation journey.

Stage #1: Legacy on-premises infrastructure

Large premises often operate their own data centres. They’ve already optimised their way here by getting rid of large houses of racks and virtualising a lot – if not all – of their workloads. The consolidation and virtualisation resulted in great unit economics. This is where we start our journey.

At a particular point, the linear cost of paying per VM becomes more expensive than creating and managing an efficient data centre – 451 Research put it as roughly 400 VMs managed per engineer

Unfortunately, their development processes are now starting to get clunky: code is built using some combination of build automation tools, and home-grown utilities, and usually involves IT teams to requisition virtual machines to deploy.

In a world where public clouds offer developers the ability to get all the way from code to deploy and operate within minutes, this legacy process is too cumbersome, even though this infrastructure is presented to the developers as a ‘private cloud’ of sorts. The fact that the process takes so long has a direct impact on business outcomes because it greatly delays cycle times, response times, the ability to release code updates more frequently and – ultimately – time to market.

As a result, enterprises look to optimise for the next challenge: time to value.

Public clouds are evidently a great solution here, because there is no delay associated with getting the infrastructure up and running. No requisition process is needed, and the entire pipeline from code to deploy can be fully automated.

Stage #2: Public cloud consumption

At this point, an enterprise has started using public clouds – typically, and importantly, a single public cloud – to take advantage of the time-to-value benefit that they offer. As this use starts expanding over time, more and more dependencies are introduced on other services that the public cloud offers.

For example, once you start using EC2 instances on AWS, pretty quickly your cloud-native application also starts relying on EBS for block storage, RDS for database instances, Elastic IPs, Route53, and many others. You also double down further by relying on tools like CloudWatch for monitoring and visibility.

In the early stages of public cloud use, the ease of use when going with a single public cloud provider can trump any other consideration an enterprise may have, especially at reasonably manageable scale. But as costs continue to grow with increased usage at scale, cost control becomes almost as important. You then start to look at other cloud cost management tools to keep these skyrocketing costs in check – ironically from either the cloud provider itself (AWS Budgets, Cost Explorer) or from independent vendors (Cloudability, RightScale and many others). This is a never-ending cycle until, at some point, the public cloud infrastructure flips from being a competitive enabler to a commodity cost centre.

At a particular tipping point, the linear cost of paying per VM becomes more expensive than creating and managing an efficient data centre with all its incumbent costs. A study by 451 Research pegged this tipping point to be at roughly 400 VMs managed per engineer, assuming an internal, private IaaS cloud.

Thus there is a tension between the ease of using as many services as you can from a one-stop-shop and the cost of being locked into a single vendor. The cost associated with this is two-fold:

  • Being at the mercy of a single vendor, and subject to any cost/pricing changes made here. Being dependent on a single vendor means that your leverage is reduced in price negotiations, not to mention being subjected to further cross- and up-sells to other related offerings that further perpetuates the lock-in. This is an even larger problem with the public cloud model because of the ease with which multiple services can proliferate
  • Switching costs. Moving away from the vendor incurs a substantial switching cost that keeps consumers locked in to this model. It also inhibits consumers’ ability to choose the right solution for their problem

In addition to vendor lock-in, another concern with the use of public clouds is the data security and privacy issues associated with off-premises computing that may, in itself, prove to be a bridge too far for some enterprises.

One of the recent trends in the software industry in general, and cloud infrastructure solutions in particular, is the rise of open source technology solutions that help address this primary concern of enabling ease of use alongside cost efficiency, and lock-in avoidance. Open source software gives users the flexibility to pay vendors for support – either initially, or for as long as it is cost-effective – and switch to other vendors or to internal teams when it is beneficial (or required, for various business reasons).

Note that there are pitfalls here too – it is sometimes just as easy to get locked in to a single open source software vendor as it is with closed source software. A potential mitigation is to follow best practices for open source infrastructure consumption, and avoid vendor-specific dependencies – or forking, in the case of open source – as much as possible.

Stage #3: Open source hell

You’ve learned that managing your data centre with your own homegrown solutions kills your time-to-value, so you tried public clouds that gave you exactly the time-to-value benefit you were looking for. Things went great for a while, but then the scale costs hit you hard, made worse by vendor lock-in, and you decided to bring computing back in-house. Except this time you were armed with the best open source tools and stacks available that promised to truly transform your data centre into a real private cloud (unlike in the past), while affording your developers that same time-to-value benefit they sought from public clouds.

If you belong to the forward-looking enterprises that are ready to take advantage of open source solutions as a strategic choice, then this should be the cost panacea you’re looking for. Right?

Wrong. Unfortunately, most open source frameworks that would be sufficient to support your needs are extremely complex to not only set up, but manage at reasonable scale.

This results in another source of hidden operational costs (OPEX) – management overhead, employee cost, learning curve and ongoing admin – which all translate to a lot of time spent, not only on getting the infrastructure to a consumable state for the development teams, but also keeping it in that state. This time lost due to implementation delays, and associated ongoing maintenance delays, is also costly; it means you cannot ship software at a rate that you need to stay competitive in your industry.

Large enterprises usually have their own data centres, and administration and operations teams, and will build out a private cloud using open source stacks that are appropriately customised for their use. There are many factors that go into setting this up effectively, including typical data centre metrics like energy efficiency, utilisation, and redundancy. The cost efficiency of going down this path is directly dependent on optimising these metrics. More importantly, however, this re-introduces our earliest cost factor: the bottom line impact of slow time-to-value and the many cycles and investment spent not just on simply getting your private cloud off the ground, but having it consumable by development teams, and in an efficient manner.

You have now come, full circle, back to the original problem you were trying to optimise for.

The reason we’re back here is that the three sources of cost we’ve covered in this post – lock-in, time-to-value and infrastructure efficiency – seemingly form the cloud infrastructure equivalent of the famous CAP theorem in computer science theory. You can usually have one, or two, but not all three simultaneously. In order to complete the picture, let’s introduce solutions that solve for some of these costs together.

Approach #1: Enabling time-to-value and lock-in avoidance (in theory)

This is where an almost seminal opportunity in terms of cloud infrastructure standardisation comes in: open source container orchestration technologies, especially Kubernetes.

Kubernetes offers not only an open source solution that circumvents the dreaded vendor lock-in, but also provides another layer of optimisation beyond virtualisation, in terms of resource utilisation. The massive momentum behind this technology, along with the community behind it, has resulted in all major cloud vendors having to agree on this as a common abstraction for the first time. Ever. As a result, AWS, Azure and Google Cloud all offer managed Kubernetes solutions as an integral part of their existing managed infrastructure offerings.

While Kubernetes can be used locally as well, it is notoriously difficult to deploy and even more complex to operate at scale, on-premises. This means that, just like with the IaaS solutions of the public clouds, to get the fastest time-to-value out of the open source Kubernetes, many are choosing to use one of the Kubernetes as a service (KaaS) services offered by the public clouds. This hence achieves time-to-value and possible lock-in avoidance, since presumably you’d be able to port your application at any point to a different provider.

Only, the chances are you never will. In reality, you’re risking being dependent, once more, on the rest of the cloud services offered by the public cloud. The dependency is not just in the infrastructure choice, but is felt more in the application itself and all the integrated services. It goes without saying too that if you go with a Kubernetes service offered by the public clouds, then these solutions have the same problem that IaaS solutions do at scale in the public cloud – around rising costs – along with the same privacy and data security concerns.

In practice, the time-to-value here is essentially tied to Kubernetes familiarity, assuming you’re going with the public cloud offering, or advanced operational expertise, assuming you’re attempting to run Kubernetes at scale, on-prem.

From the perspective of day one operations (bootstrapping), if your team is already familiar with, and committed to, going with Kubernetes as their application deployment platform, then they can get up and running quickly. There is a big caveat here – this assumes your application is ready to be containerised and can be deployed within an opinionated framework like Kubernetes. If this isn’t the case there is another source of hidden costs that will add up in regards to re-architecture or redesigning the application to be more container-friendly. On a side note, there are enabling technologies out there that aim to reduce this ramp-up time to productivity or redesign, such as serverless or FaaS technologies.

Most hybrid cloud implementations end up being independent silos of point solutions that can only optimise against one or two of the CAP theorem axes

The complexities of day two operations with Kubernetes for large scale, mission critical applications that span on-premises or hybrid environments are enormous, and a topic for another time. But suffice it to say that if you’re able to deploy your first cluster quickly with any open source tool – for example, the likes of Rancher or Kops among others – to achieve fast time-to-value for day one, you’re still nowhere close to achieving time-to-value as far as day two operations are concerned.

Operations around etcd, networking, logging, monitoring, access control, and all the many management burdens of Kubernetes for enterprise workloads have made it almost impossible to go on-prem without planning for an army of engineers to support your environments, and a long learning curve and skills gap to overcome.

Approach #2: Enabling time-to-value and infrastructure efficiency

This is where hyperconverged infrastructure solutions come in. These solutions offer the promise of better time-to-value outcomes because of their turnkey nature, but the consumer pays for this by, once again, being locked in to a single vendor and their entire ecosystem of products – which makes these solutions more expensive. For example, Nutanix offers not only their core turnkey hyperconverged offering, but also a number of ‘essentials’ and ‘enterprise’ services around this.

Approach #3: Enabling infrastructure efficiency and lock-in avoidance (in theory)

We can take an open source approach to hyperconverged infrastructure as well, via solutions like Red Hat HCI for instance. These provide the efficiency promise of hyperconverged, while also offering an open source alternative to single-vendor lock-in. Like any other complex open source infrastructure solutions, though, they suffer from a poor time-to-value for consumers.

This then is the backdrop against which most ‘hybrid cloud’ efforts are framed – how to increase time-to-value and enable portability between environments, while improving unit efficiency and data centre costs. Most hybrid cloud implementations end up being independent silos of point solutions that, once more, can only optimise against one or two of the CAP theorem axes. These silos of infrastructure and operations have further impact on overhead, and hence the cost, of management.

Breaking this cloud infrastructure-oriented CAP theorem would require a fundamentally different approach to delivering such systems. ‘Cloud-managed infrastructure’ helps deliver the time-to-value, user experience and operational model of the public cloud, as well as on hybrid data centres too. Utilising open infrastructure to ensure portability and future-proofing systems and applications can help remediate costs as well.

https://www.cybersecuritycloudexpo.com/wp-content/uploads/2018/09/cyber-security-world-series-1.pngInterested in hearing industry leaders discuss subjects like this and sharing their experiences and use-cases? Attend the Cyber Security & Cloud Expo World Series with upcoming events in Silicon Valley, London and Amsterdam to learn more.

Altaro VM Backup 8.3 review: Drag and drop, straight to the top


Dave Mitchell

16 Apr, 2019

Protecting your virtual machines doesn’t get easier than this

Price 
£445 exc VAT

There may be a wealth of backup solutions aimed at securing virtualized environments but many offer this as an additional feature, so SMEs may find themselves paying through the nose for excess baggage. Not so with Altaro VM Backup: this software product is designed from the ground up to protect VMware and Hyper-V VMs (virtual machines).

Another bonus is its pricing structure, because unlike many products that use the number of sockets or CPUs, Altaro bases costs purely on the number of hosts. The Standard edition starts at a mere £445 per host and this allows you to schedule backups for up to five VMs per host.

The Unlimited edition begins at £545 and, unsurprisingly, supports unlimited VMs per host but also enables high-efficiency inline deduplication, cluster support, GFS (grandfather, father, son) archiving and Exchange item-level restore. Moving up to a still very affordable £685 per host, the Unlimited Plus edition brings Altaro’s cloud management console into play and adds WAN-optimised replication, CDP (continuous data protection) and support for offsite backups to Microsoft Azure.

Altaro VM Backup 8.3 review: Deployment

Altaro claims it’ll take you 15 minutes to install the software and get your first backup running and it’s not wrong. It took us 5 minutes to install it on a Windows Server 2016 host after which we declared our first Hyper-V host, added a Qnap NAS appliance network share as our primary backup location, picked a VM from the list presented and manually ran the job.

The console is very easy to use and we also declared the lab’s VMware ESXi host and another Hyper-V host running our Exchange 2013 and SQL Server 2014 services. Along with NAS appliance shares, Altaro supports a good choice of destinations including local storage, iSCSI targets, USB and eSATA external devices, UNC share paths and RDX cartridges.

For secondary off-site locations, you can copy data to Altaro’s free Offsite Server (AOS) app which supports Windows Server 2012 upwards. The OS and AOS app can also be hosted in the cloud using a range of providers including Microsoft Azure.

Altaro VM Backup 8.3 review: User interface

Creating VM backup strategies doesn’t get any easier as most operations are drag and drop. We viewed all VMs presented by our Hyper-V and VMware hosts and simply dragged them across and dropped them on our primary backup location.

At this stage, you can run them manually with a single click, but applying a schedule is just another drag and drop procedure. Altaro provides two predefined schedules and we could create our own with custom start times plus weekly and monthly recurrences.

A set of default data retention policies are provided and you can easily create new ones for on-site and off-site backup locations. Choose how many versions you want to keep, decide whether older ones are deleted or archived and then just drop VMs onto them to apply the policy.

You can add off-site copies to a schedule at any time by – you’ve guessed it – dragging and dropping VMs onto the secondary backup location icon. CDP can be enabled on selected VMs and scheduled to run as often as every 5 minutes, while application consistent backups can be applied to VMs running VSS-aware apps such as Exchange and SQL Server.

Altaro VM Backup 8.3 review: Replication and restoration

Selected VMs can be replicated to the remote AOS host where CDP defaults to updating them every 5 minutes, or less frequently if you want. Depending on which type of VMs are being replicated, AOS requires access to local Hyper-V and VMware hosts, where it manages VM creation and handles all power up and shutdown commands.

Both the Altaro primary and AOS hosts must be running identical OSes and for the latter, we defined iSCSI storage for off-site copies and declared local Hyper-V and VMware hosts to provide VM replication. Initial off-site copies can be sped up as Altaro provides an option to copy the data to a removable device for seeding the remote vault.

General recovery features are excellent: you can restore a virtual hard disk, clone a VM or boot one straight from a backup to its original host or to another one. We tested the Boot from Backup feature and Altaro provisioned a SQL Server 2014 VM from its latest backup on a new Hyper-V host and had it running and waiting at the Windows login screen in one minute.

Altaro’s Sandbox feature takes the worry out of recovery by verifying the integrity of selected backups. Along with checking the data stored in backups, it clones VM backups to the same host to make sure they will boot when needed – and it does this all in the background.

GRT (granular recovery technology) restores are provided for recovering files, folders and Exchange items. Exchange GRT is undemanding; we selected this for our Exchange 2013 VM, chose a backup and its virtual hard disk, browsed for the EDB file and viewed our users and mailboxes plus items such as individual emails, contacts and calendars. The console creates a PST file containing the recovered items and we used the Exchange Admin Center web app to grab the file and import its contents into the relevant user’s mailbox.

Altaro VM Backup 8.3 review: Verdict

During testing, we were very impressed with Altaro VM Backup’s fast deployment and extreme ease of use. The clever console design makes it easy to create backup strategies for VMs plus it offers a wealth of valuable recovery and replication features. Protecting your Hyper-V and VMware virtualized environments really doesn’t get any easier or more affordable, making Altaro VM Backup a top choice for SMEs.

Jamf unveils Apple management cloud platform in UK


Clare Hopping

16 Apr, 2019

Jamf has brought its Jamf Premium Cloud service for Apple management to UK servers, meaning customers using the service in the region will be able to continue using it without a hitch following the UK’s split from the EU.

Bringing the Jamf Premium Cloud product to a UK server means businesses in highly regulated industries such as finance and education will be able to ensure their data is stored securely and firmly within the region.

It allows businesses to manage and grant access to IP and network addresses and allow certain users to log into the server without interruption.

Jamf’s premium cloud product allows businesses to white label their own server address too, not only making sure it fits online with company branding but also offering peace of mind to users that it’s the right server.

Previously, the firm’s closest data centre to the UK was in Germany (its only European facility), with additional servers in the US, Japan and Australia. This latest move means Jamf can better tailor its products and services to a UK-focused audience.

“We are excited to bring Jamf Premium Cloud to the U.K. as it will bring flexibility to our customers here,” said Mark Ollila, director, cloud operations at Jamf.

“Jamf users will be able to reap the benefits of the cloud securely, as well as experience additional layers of security and customised branding. As the U.K. prepares to part ways with the EU, the cloud will be an essential tool for British businesses to compete globally, which is why we have launched Jamf Premium Cloud tailored for those in the U.K.”