Amazon Web Services (AWS) has announced the general availability of Amazon Detective, a new offering which aims to help customers remediate security issues across their AWS workloads more easily.

Amazon Detective, which was launched in preview at re:Invent last year, automatically collects log data from a customer's resources and uses machine learning and statistical analysis to build interactive visualisations which customers can use to deduce security anomalies.

Sebastien Stormacq, Amazon senior developer advocate, noted in a blog post how customer demands had changed from five years ago, when AWS released a solution which automatically analysed AWS CloudTrail data to generate alerts around sensitive API usage.

"Today, when a security issue is detected, such as compromised credentials or unauthorised access to a resource, security analysts cross-analyse several data logs to understand the root cause of the issue and its impact on the environment," wrote Stormacq. "In-depth analysis often requires scripting and ETL to connect the dots between data generated by multiple siloed systems.

"To further complicate matters, new AWS accounts, and new applications are constantly introduced, forcing analysts to constantly reestablish baselines of normal behaviour, and to understand new patterns of activities every time they evaluate a new security issue," added Stormacq.

Among the customers rolling out with Detective are T-Systems and Warner Media, with the product available in 14 AWS regions upon launch. There are no additional charges or upfront commitments to customers, the company added.

This can be seen as another step in the largest cloud vendors giving customers a helping hand around the ever-thorny issue of security. Yet the element of give-and-take has to remain. Take the launch of Amazon S3 Block Public Access in late 2018, which enabled extra controls to ensure S3 buckets did not become misconfigured. The year before, the company updated its dashboard so public buckets were signified with bright orange indicators. As cloud workloads become more complex, security needs to adapt with it – which is what AWS is aiming for here.

You can read the full blog post here.

Photo by Agence Olloweb on Unsplash

Interested in hearing industry leaders discuss subjects like this and sharing their experiences and use-cases? Attend the Cyber Security & Cloud Expo World Series with upcoming events in Silicon Valley, London and Amsterdam to learn more.

Bobby Hellard

Cloud Pro

Welcome to the third issue of IT Pro 20/20, our brand-new digital magazine that brings all of the month’s most important tech issues into clear view.

Each month, we will shine a spotlight on the content that we feel every IT professional should be aware of, only in a condensed version that can be read on the go, at a time that suits you.

This month we’re taking a look at how cloud innovation is helping to support the technology industry and wider society through a global pandemic. Now that most of us are working remotely, it’s important you have the best tools in place to keep employees secure and productive, and so we’ve highlighted a number of areas where the cloud is helping to drive this effort. From free software and remote working tips, to industry leadership and changing technology paradigms, the cloud is behind it all.

We also take a look at the growing trend of screenless content and provide some tips for helping your organisation develop a much-needed audio strategy, as well as the growth of AI as a service, both of which are exclusive to this month’s issue.

As ever, you’ll also find a roundup of the four biggest stories of the month that are likely to reverberate throughout 2020.

DOWNLOAD THE MARCH ISSUE OF IT PRO 20/20 HERE

We hope you enjoy reading this month’s issue. If you would like to receive each issue in your inbox as they release, you can subscribe to our mailing list here.

The next IT Pro 20/20 will be available on 30 April. Previous issues can be found here.

Bobby Hellard

The human tragedy the COVID-19 pandemic has inflicted on the world is incalculable and continues to grow. Every human life is priceless and deserves the care needed to sustain it. COVID-19 is also impacting entire industries, causing them to randomly move in unpredictable ways, directly impacting IT and tech spending.

COVID-19’s impact on industries

Computer Economics in collaboration with their parent company Avasant published their Coronavirus Impact Index by Industry that looks at how COVID-19 is affecting 11 major industry sectors in four dimensions: personnel, operations, supply chain, and revenue. Please see the Coronavirus Impact Index by Industry by Tom Dunlap, Dave Wagner, and Frank Scavo of Computer Economics for additional information and analysis.  The resulting index is an overall rating of the impact of the pandemic on each industry and is shown below:

Computer Economics and Avasant predict major disruption to High Tech & Telecommunications based on the industry’s heavy reliance on Chinese supply chains, which were severely impacted by COVID-19.

Based on conversations with U.S.-based high tech manufacturers, I’ve learned that a few are struggling to make deliveries to leading department stores and discount chains due to parts shortages and allocations from their Chinese suppliers. North American electronics suppliers aren’t an option due to their prices being higher than their Chinese competitors. Leading department stores and discount chains openly encourage high tech device manufacturers to compete with each other on supplier availability and delivery date performance.

In contrast to the parts shortage and unpredictability of supply chains dragging down the industry, software is a growth catalyst. The study notes that Zoom, Slack, GoToMyPC, Zoho Remotely, Microsoft Office365, Atlassian, and others are already seeing increased demand as companies increase their remote-working capabilities.

COVID-19’s impact on IT spending  

Further supporting the Coronavirus Impact Index by Industry analysis, Andrew Bartels, VP & Principal Analyst at Forrester, published his latest forecast of tech growth today in the post, The Odds of a Tech Market Decline In 2020 Have Just Gone Up To 50%.

Mr. Bartels is referencing the market forecasts shown in the following forecast published last month, New Forrester Forecast Shows That Global Tech Market Growth Will Slip To 3% In 2020 And 2021 and shown below:

Key insights from Forrester’s latest IT spending forecast and predictions are shown below:

• Forrester is revising its tech forecast downward, predicting the US and global tech market growth slowing to around 2% in 2020. Bartels mentions that this assumes the US and other major economies have declined in the first half of 2020 but manage to recover in the second half
• If a full-fledged recession hits, there is a 50% probability that US and global tech markets will decline by 2% or more in 2020
• In either a second-half 2020 recovery or recession, Forrester predicts computer and communications equipment spending will be weakest, with potential declines of 5% to 10%
• Tech consulting and systems integration services spending will be flat in a temporary slowdown and could be down by up to 5% if firms cut back on new tech projects
• Software spending growth will slow to the 2% to 4% range in the best case and will post no growth in the worst case of a recession
• The only positive signs from the latest Forrester IT spending forecast is the continued growth in demand for cloud infrastructure services and potential increases in spending on specialised software. Forrester also predicts communications equipment, and telecom services for remote work and education as organisations encourage workers to work from home and schools move to online courses

Conclusion

Every industry is economically hurting already from the COVID-19 pandemic. Now is the time for enterprise software providers to go the extra mile for their customers across all industries and help them recover and grow again. Strengthening customers in their time of need by freely providing remote collaboration tools, secure endpoint solutions, cloud-based storage, and CRM systems is an investment in the community that every software company needs to make it through this pandemic too.

Photo by Micheile Henderson on Unsplash

Interested in hearing industry leaders discuss subjects like this and sharing their experiences and use-cases? Attend the Cyber Security & Cloud Expo World Series with upcoming events in Silicon Valley, London and Amsterdam to learn more.

Bobby Hellard

Microsoft has announced it is to acquire Affirmed Networks, a provider of network functions virtualisation (NFV) software – as the telecoms space heats up for the biggest cloud players. 

As 5G is becoming more of a reality, cloud vendors see their role as enabling telecom operators to deploy and maintain next-generation networks more efficiently.  

“At Microsoft, we intend to empower the telecommunications industry as it continues its move to 5G and support both network equipment manufacturers and operators in their efforts to find solutions that are faster, easier and cost effective,” wrote Yousef Khalidi, corporate vice president for Azure networking in a blog post. “This acquisition will allow us to evolve our work with the telecommunications industry, building on our secure and trusted cloud platform for operators. 

“With Affirmed Networks, we will be able to offer new and innovative solutions tailored to the unique needs of operators, including managing their network workloads in the cloud,” Khalidi added. 

Anand Krishnamurthy, president and CEO of Affirmed Networks – who only became CEO earlier this month – said the company had delivered on its vision. “Working together, we have created a model for mobile networks of the future that is open, cloud-native and capable of being web-scale, all at 70% of the cost of traditional networks,” wrote Krishnamurthy. “We have been their partner of choice as they prepare for fifth generation (5G) networks and infrastructure.  

“Now, the combined technologies of Microsoft and Affirmed will further accelerate this momentous shift.” 

This move makes for an interesting comparison with what Amazon Web Services (AWS) is doing with its Wavelength project. The initiative is an edge play which embeds AWS’ compute and storage services on the edge of operators’ 5G networks, enabling the delivery of ultra-low latency applications. 

At re:Invent back in December, in what was seen as the biggest item of the main keynotes – or in other words, the last item – Verizon CEO Hans Vestberg joined AWS chief Andy Jassy on stage to discuss the collaboration between the two companies. Jassy noted the most exciting applications to be ushered in, such as autonomous industrial equipment, or applications for smart cities, can’t wait that long.  

“If you want to have the types of applications that have that last mile connectivity, but actually do something meaningful, those applications need a certain amount of compute and a certain amount of storage,” he said. “What [developers] really want is AWS to be embedded somehow in these 5G edge locations.” 

For Microsoft’s part, the company said it was looking at extending ‘deep, strong partnerships’ and ensuring interoperability to ensure cloud-based software-defined networking (SDN) fits into the 5G landscape. The company’s partnership with AT&T, beefed up in November, is seen by many in the industry to be a particularly interesting one in the space. 

Financial terms of the deal were not disclosed. You can read the full announcement of the acquisition here. 

Interested in hearing industry leaders discuss subjects like this and sharing their experiences and use-cases? Attend the Cyber Security & Cloud Expo World Series with upcoming events in Silicon Valley, London and Amsterdam to learn more.

For a significant number of companies, beginning their cloud migration journey is hard. In spite of the greater scalability, flexibility, optimisation, and lower costs for big data in the cloud, organisations struggle to mobilise their teams to begin their cloud journey. Once they have successfully migrated their workloads to the cloud, however, a lot of organisations think the journey is finished.

Unfortunately, there are a number of operational and visibility challenges that exist on-premises which don’t disappear once workloads have been migrated. While the benefits of cloud migration are clear, it is frequently oversimplified and considerations such as application dependencies and system version mapping are not given due thought. As a result, costs begin to overrun through over-provisioning or production is delayed through provisioning gaps.

Even post-migration, issues can persist. Modern businesses are powered by data applications that rely on a myriad of platforms which frequently creates issues in understanding, planning, optimising, and automating the performance of their data apps and infrastructure. These difficulties are compounded by the use of disparate technologies and siloed approaches to managing data applications and data infrastructure. With the majority of monitoring solutions frequently lacking end-to-end support for big data environments, full-stack compatibility, or requiring complex instrumentation, data teams require deep subject matter expertise to configure changes to applications or components. As a result, organisations can struggle to find teams skilled enough to deliver strong application performance, often resulting in poor user experience, inefficiencies and mounting costs as organisations buy more and more tools to resolve problems.

Quantifiably, organisations see a high Mean Time to Identify (MTTI) and Mean Time to Resolve (MTTR) issues due to difficulties in understanding dependencies and retaining focus in root cause analysis. Data collection and correlation can be time-consuming when trying to collect granular cluster and application-specific runtime information, as well as metrics on infrastructure across platforms, application and system log data, configuration parameters, and other relevant data.

Moreover, resources using native Hadoop APIs will only send data while an application is executing creating yet further complications. The lack of granularity and end to end visibility makes it impossible to remedy all of these problems, leaving businesses with little visibility of their data applications. Even once all this data has been collated, further difficulties arise in evaluating and interpreting it. Minor human errors such as a missed configuration parameter, incorrectly sized container, or a rogue stage of your Spark application, which can completely cripple a data cluster, may be entirely missed.

For enterprises that have only recently migrated, these myriad issues can leave cause for doubt in their choice. However, it should be noted that cloud adoption is not a finite process with a clear start and end date — it’s an ongoing lifecycle with four broad phases (planning, migration, operation, and optimisation). To ensure a painless and efficient cloud migration, each of these four phases needs to be given proportionate attention.

Broadly, In the planning phase, decisions need to be made surrounding which applications are most suited for the cloud, what resources do they require, which data sets need to be migrated and whether permanent, transient, autoscaling, or spot instances should be used. During the migration and operation stage, there is a need for continuous monitoring of performance and costs, and assessment of the critical dependencies and service mapping. Finally, once these workloads are in production on the cloud, it is time for data teams to begin considering how they optimise their applications and performance in order to guarantee SLAs.

A comprehensive approach to operational planning goes a long way in resolving the various challenges of managing big data technologies (both on-premise and in the cloud). With enough time and focus spent on each stage of the cloud adoption lifecycle, and adhering to best practice, the benefits of cloud migration can be realised faster. The main thing to remember for data-teams, is not to take the foot off the gas and keep momentum up once they’ve moved to the cloud.

Photo by Shannon Lam on Unsplash

Interested in hearing industry leaders discuss subjects like this and sharing their experiences and use-cases? Attend the Cyber Security & Cloud Expo World Series with upcoming events in Silicon Valley, London and Amsterdam to learn more.

Bobby Hellard

In the land of the hyperscale cloud operators, all remains relatively rosy in the garden. New data from Synergy Research shows that hyperscale operator capex set a new record in the most recent quarter.

In total, more than $32 billion was laid down in the fourth quarter of 2019, beating the previous record set by Q418. Synergy noted that a lot of spend – and strategy – was going into data centres. Capex specifically targeted at data centres grew 11% in 2019 in a move which ‘reflected ongoing strength in their core business operations’, as the analyst firm put it.

The top five spenders, far ahead of the rest of the hyperscalers, are Amazon, Google, Microsoft, Facebook, and Apple – although the latter dropped off sharply in 2019 to the detriment of overall figures. To the old adage that attack is the best form of defence, the top 20 companies analysed – including Alibaba, IBM, Oracle and Tencent in the challengers section – generated $1.4 trillion between them in revenues for 2019, up 13% from 2018.

Yet the inevitable question around what will happen amid the ongoing Covid-19 pandemic is not too far away. John Dinsdale, a chief analyst at Synergy Research, said that while nothing was certain, hyperscale cloud players were on a surer footing than most.

“While there are many unknowns, what is clear is that the hyperscale operators generate well over 80% of their revenues from cloud, digital services and online activities,” said Dinsdale. “The radical shifts we are seeing in social and business behaviour will actually provide some substantive tailwinds for many of these businesses.

“These hyperscale firms are much better insulated against the current crisis than most others and we expect to see ongoing robust levels of capex,” added Dinsdale.

Many of the leading cloud players are in a position to funnel some of their resources into combating Covid-19, as well as provide free services to those researching and working in healthcare. Amazon Web Services is committing $20 million to customers working on diagnostics solutions, while Microsoft, Google, Alibaba and others have offered free products to healthcare professionals.

Interested in hearing industry leaders discuss subjects like this and sharing their experiences and use-cases? Attend the Cyber Security & Cloud Expo World Series with upcoming events in Silicon Valley, London and Amsterdam to learn more.