Scale up or scale out: Why this remains a key problem for data centres

(c)iStock.com/4x-image

Servers have always powered businesses and also formed the backbone behind how they run and operate. There has been a marked increase in reliance on servers, which are now being used to do things they never used to do before.

Looking at an industry where servers play an integral role, data centre administrators can be said to be the most advanced and complex folks in the IT world. Workloads on servers, and the servers themselves are getting more complex now especially post-virtualisation. As a result, data centre administrators are faced with the constant challenge of fitting the load to the infrastructure. Is it an intensive task which needs high performance compute-style servers or a financial transaction which needs speedy processing and a low-latency network connection?

Exponential demand means that increased performance is key and these data centre professionals face the constant challenge of getting new levels of performance out of servers that have existed for years in their data centres. The key question here for data centre professionals is how do you scale your data centre’s performance?

Scale up – vertical

This process involves installing more high performance components in your existing servers, usually in the order of processors, memory, and storage (by using SSDs to replace hard drives). Sometimes the order flips and we might lead with memory rather than processors; it all depends on the configuration of existing servers and what we’re working with.

If what we’re trying to improve is an older DDR3 server, the first thing to tackle would likely be the CPUs if the server was using Newhalem or Westmere processors. There’s a lot that goes into this though, and we might start with memory if the DRAM was sparsely populated. It all depends. Key questions to ask would be, what’s your workload? And which components are going to have the biggest impact on what you do?

Scale out – horizontal

This can be seen as a stair step process. Typically when scaling out or up, the first step is getting as much as possible out of existing servers. Once this is done, the only way is to go is horizontally, adding more servers. Scaling out is definitely more expensive, as it involves more physical servers – and thus more software licenses. Since software licenses usually cost far more than server hardware and hit your budget every single year, they’re one of the most important cost factors when considering whether to scale out.

Additional factors such as higher power and cooling costs all add up when you’re working with a greater number of servers, and these are just a few of the costs associated when scaling out, on top of the issue of having physical space in your data centre.

The decision making process

Determining which approach to use is all about knowing exactly where your organisation is in the expansion process and which scaling decision would be the best fit for where you’re at – and how you see your workload growing.

IT decision makers who need to take this first step in deciding between scaling up and upgrading servers – or scaling out and adding more servers – need to bear all these considerations in mind. Both routes have their advantages. It goes without saying that typically it’s more efficient to first maximise the performance potential of your existing infrastructure and servers by scaling up. Once a performance ceiling is reached then it’s time to scale out to further meet demand.

The challenge for IT decision makers is in identifying exactly where their organisation sits in that process, and therefore which route is the most effective way to go.

Read more: When to scale up – or scale out – your data centre

Microsoft Improves Cloud Security

Microsoft has recently announced its huge developments in the cloud security sector that will allegedly improve the security of online companies. Microsoft plans to unveil more at the RSA Conference, taking place from February 29th to March 4th in San Francisco. These new developments include Customer Lockbox, Microsoft Cloud App Security, Azure Active Directory Identity Protection, and Microsoft Operations Management Suite.

Customer Lockbox: Lockbox helps Microsoft engineers achieve more transparency when they require access to Office 365 accounts to aid in troubleshooting. Lockbox aims to make the customer approval process more efficient. Lockbox is already available to those using Exchange Online.

Microsoft Cloud App Security: This application provides both security and control over data stored in app clouds, including SalesForce and Office 365. This application comes after the addition of security broker Adallom to the cloud giant. Office 365 was also upgraded in conjunction with Microsoft Cloud App Security: users will be made aware of suspicious activity. Uses will also have the choice of approving third party services.

Azure Active Directory Identity Protection: Microsoft has yet to unveil much about thus application, but it is expected that it will provide threat detection. It will utilize Microsoft’s data to investigate threats such as authentications from unfamiliar locations.

Azure

Microsoft Operations Management Suite: Some improvements were made to the Microsoft Operations Management Suite; users will receive information pertaining to malware detections, network activity, and system updates.

 

Comments:

Bret Arsenault, Microsoft’s chief information security officer: “Keeping our network safe, while protecting our data and our customers’ data, is paramount. As Chief Information Security Officer at Microsoft, I am constantly looking for ways to improve our security posture, through new technologies that accelerate our ability to protect, detect and respond to cyber incidents… After years of examining crash dumps that our customers opted to send to Microsoft from more than a billion PCs worldwide, Microsoft has developed the capability to analyze this data to effectively detect compromised systems because crashes are often the result of failed exploitation attempts and brittle malware.”

 

Sarah Fender, principal program manager of Microsoft Azure Cybersecurity: “After years of examining crash dumps that customers sent to Microsoft from more than 1 billion PCs worldwide, we are able to analyze these events to detect when a crash is the result of a failed exploitation attempt or brittle malware. Azure Security Center automatically collects crash events from Azure virtual machines, analyzes the data, and alerts you when a VM is likely compromised…Starting next week, in addition to configuring a Security Policy at the subscription level, you can also configure a Security Policy for a Resource Group—enabling you to tailor the policy based on the security needs of a specific workload. Azure Security Center continually monitors your resources according to the policy you set, and alerts you if a configuration drifts or appropriate controls are not in place.”

The post Microsoft Improves Cloud Security appeared first on Cloud News Daily.

Taking Back IT – DevOps | @DevOpsSummit #DevOps #APM #Microservices

I am an ops guy. I have been in Ops since I started my career a long time ago. I still remember the glorious days of being the new guy on the Ops team and getting stuck with changing backup tapes. I remember moving servers in the wee small hours of the morning, upgrades that went horribly wrong with no prayer of reverting, and the joys and pains that went with being in operations, and really what we would call «Legacy IT» in general. It’s like the opposite of «Cheers», because you want to be where NO ONE knows your name; if people know who you were in those days of IT, you were having a bad day.

read more

WebRTC, IoT and API Gateways | @ThingsExpo #IoT #M2M #RTC #WebRTC

The evolution of JavaScript and HTML 5 to support a genuine component based framework (Web Components) with the necessary tools to deliver something close to a native experience including genuine realtime networking (UDP using WebRTC). HTML5 is evolving to offer built in templating support, the ability to watch objects (which will speed up Angular) and Web Components (which offer Angular Directives). The native level support will offer a massive performance boost to frameworks having to fake all these features like Polymer and Angular. It will also encourage people who are not familiar with these next generational frameworks to get in on the action. As I am from a gaming background then I always complain that TCP (Web Sockets) is not genuinely real-time, so I look forward to seeing UDP (WebRTC) solutions being delivered like Desktop Sharing in Chrome 34.

read more

IoT Open Frameworks By @AllSeenAlliance | @ThingsExpo #IoT #M2M #InternetOfThings

In his session at @ThingsExpo, Noah Harlan, Founder of Two Bulls and President of AllSeen Alliance, will discuss why open source frameworks are vital for the future of IoT.
Noah Harlan is President of AllSeen Alliance and a Founder of Two Bulls, a leading mobile software development company with offices in New York, Berlin, and Melbourne. He is also Managing Director of Digital Strategy for Sullivan NYC, a brand engagement firm based in New York. He has served as an advisor for the White House Office of Science & Technology Policy on gaming and the outdoors, has appeared as a commentator on Bloomberg TV discussing mobile technology, and has an Emmy Award for Advanced Media Interactivity.

read more

Smart Monitoring, Automation, and Open Source at Yahoo By @madgreek65 | @CloudExpo #Cloud

Our guest on the podcast this week is Preeti Somal, VP of Engineering at Yahoo. We discuss the cloud challenges that come with supporting over a billion consumers per day at Yahoo. One way the Yahoo team simplifies this is through automation and smarter monitoring. Yahoo also leverages open source projects such as Hadoop and OpenStack, which helps onboard employees through their many mergers and acquisitions.

read more

The 1-2 Punch of Big Data Processing in the Cloud By @madgreek65 | @CloudExpo #Cloud #BigData

Our guest on the podcast this week is Jason Parsons, Senior Architect and Big Data expert at Cloud Technology Partners. We discuss the benefits of real-time, big data processing in the cloud and why some companies are hesitant to migrate from their traditional data centers. Jason explains why planning is key when moving from on-premise centers and why all companies should begin their cloud initiatives with a minimum viable product before going into full production.

read more

Mindshift Change – Seven Ways to Think Different in the Cloud By @madgreek65 | @CloudExpo #Cloud

Success in the public cloud requires a complete mind shift change. Are you thinking about cloud the right way?
Most large enterprises have spent millions of dollars on their public cloud initiatives over the past few years but have made little progress towards achieving their goals of increased agility and reduced operating costs. The main reason is simple: they approached cloud as if it were a datacenter. In order to achieve their lofty goals, enterprises need a complete mind shift change.

read more

EMC claims it can make data centres All Flash and no downtime

EMC quantum leapAs EMC prepares for its takeover by Dell it claims it has made ‘significant changes’ to its storage portfolio, converting its primary offering to All Flash, modernising array pricings and introducing a new category of flash storage, DSSD D5 at its Quantum Leap event.

EMC’s flagship VMAX All Flash enterprise data services platform and its new DSSD D5 rack-scale flash system are part of a new drive to persuade data centres to use flash technology as their primary storage medium. The vendor claims that by 2020 all storage used for production applications will be flash-based with traditional disk relegated to the roll of bulk storage and archiving.

The new all-flash portfolio will be used by databases, analytics, server virtual machines and virtual desktop infrastructures, says EMC, which predicts that the need for predictable performance with sub-millisecond latencies will persuade data centres to make the extra investment. ENC’s new XtremIO is designed for high-end enterprise workloads, while VMAX All Flash will consolidate mixed block and file workloads that require up to 99.9999% availability, as well as rich data services, IBM mainframe and iSeries support and scalable storage growth up to four petabytes (PB) of capacity.

The DSSD D5 Rack-Scale Flash, meanwhile, is for the most performance-intensive, traditional and next-generation use cases, such as getting microsecond response times on Oracle and Hadoop based analytics jobs. Meanwhile, the new VNX Series arrays represent an entry level all-flash offering which starts at $25,000.

EMC announced that the VMAX array has been re-engineered to offer two new all-flash models: the EMC VMAX 450 and EMC VMAX 850. Both are designed to capitalise on the performance of flash and the economics of today’s latest large-capacity SSDs.

Finally, EMC also announced the DSSD D5 which, it claimed, will be a quantum leap in storage technology, with its new Rack-Scale Flash. TEMC said the new invention will be used in high production applications such as genetic sequencing calculations, fraud detection, credit card authorisation and advanced analytics.

EMC claims it will create a ten fold surge in performance levels. The storage hardware is capable latency of 100 microseconds, throughput at 100 GB/s and IOPS of up to 10 million in a 5U system. EMC DSSD D5 will be generally available in March 2016.

EC clears acquisition of EMC by Dell – won’t distort competition

Dell office logoThe European Commission has approved the acquisition of storage and software giant EMC by PC and server maker Dell.

In a statement Commissioner Margrethe Vestager declared that the deal meets the criteria of the EU’s Merger Regulation. The strategic importance of the data storage sector meant that the EC was able to approve Dell’s multi-billion dollar takeover of EMC within a short space of time, according to Vestager, who thanked the Federal Trade Commission for close cooperation.

The Commission assessed the effects of the transaction on the market for external enterprise storage systems. The Commission also investigated the risk that the merged entity could attempt to restrict access to VMware’s software for competing hardware vendors. The Commission is convinced there will be no adverse effects on customers, according to Vestager.

The Commission found that the merged entity has a moderate market share in the market for external enterprise storage systems and the increment brought about by the merger is small. The new Dell/EMC entity will continue to face strong competition from established players, such as Hitachi, HP, IBM and NetApp, as well as from new entrants, it said.

Despite VMware’s ‘strong market position’ in server virtualization software, the available evidence led the EC investigators to conclude that the merged entity would have neither the ability nor the incentive to shut out competitors. The likes of Citrix, Microsoft and Red Hat can give it plenty of competition in the server virtualisation market, the EC has judged, and it predicted that the EMC/Dell hybrid won’t have things its own way in new technology markets.

Since customers typically multi-source from more than one server virtualization software provider and VMware’s approach has traditionally been hardware and software-neutral, it offers work opportunities to a large number of vendors. Equally, in the server market, Dell has strong competitors that will continue to operate either in partnership with VMware or with third party virtualisation software providers.

The combination of Dell’s and EMC’s external enterprise storage systems products won’t have an impact on competition given the number of alternatives to VMware’s software.

The Commission also asked whether the merged entity could shut competitors out from the virtualization software used for converged and hyper-converged infrastructure systems. Here it also found there were no concerns raised. The merger, when first reported in BCN in October 2015, was valued at $60 billion.

The cloud news categorized.