How to reduce write amplification on NAND chips in a cloud storage system

(c)iStock.com/BsWei

Solid-state disk (SSD) technology using integrated circuit assemblies is considered to be a readily available, drop-in replacement for discrete hard disks and is used to increase throughput in large cloud storage networks. But unfortunately, these devices introduce the problem of write amplification (WA) into a cloud storage system.

Reducing this occurrence is of paramount concern to most system administrators who use NAND chips in these situations because it reduces the lifespan of these chips and harms the throughput rate of a cloud storage and retrieval paradigm.

Calculating write amplification values

All forms of NAND memory chips used in SSD construction have to be erased before they can be written to again. This means that moving, rewriting and storing data to pages on SSDs will cause used portions of the chips to go through the process more than once for each file system operation. Consider a drive that has several logical blocks filled with data and several other continuous blocks that are empty. An operator using a Web-interface document manager adds data to a spreadsheet, and then saves it from his/her client machine. This necessitates the logical block that holds it to be erased and then rewritten.

If the file now takes up more space than a single block provides, other used blocks will have to be erased and rewritten until the file system achieves stability. Added to this wear and tear is the leveling and garbage collection necessary on NAND devices. Write amplification can be seriously problematic. Fortunately, there is a way to calculate the amount of WA that will be necessary to store data from cloud clients: total wear amplification = (amount of data written to NAND chips / data the host writes)

Overprovisioning and logical capacity

The difference between the actual physical capacity of an SSD and the logical capacity that an operating system sees is referred to as “over-provisioning” (OP). Additional space provided by an OP design helps the controller chip handle wear-leveling and garbage collection tasks, and provide additional blocks after some go bad

The most obvious and superfluous source of this comes from system software that uses a binary Gigabyte (1,024 MB = 1 GB), while hardware manufacturers utilise the metric Gigabyte (1,000 MB = 1 GB). This figure usually isn’t relevant when considering the problem of write amplification, but a second OP source comes from hardware vendors that purposefully add unused NAND chips somewhere in an SSD. If these values are known, OP values can be calculated easily: OP = (true capacity – visible capacity) / total user capacity

Cooperative data management policies

Several different new cooperative data management policies can be installed across a cloud storage network to cut down on WA cycles. Eliminating redundant cloud storage system caches is the first step. Currently, file systems often keep additional caches with the hopes of speeding the system up, but this only increases speed when working with mechanical drives. Ultimately, this increases granularity by orders of magnitude on SSD devices.

These policies also create victim blocks, which aren’t written to and are instead skipped, because they’re marked as “in use” in the cache. Utilising file systems designed to work with NAND chips changes these policies, which also help to reuse these victim blocks. Most importantly, the cache system should be flushed out, ensuring that extra data isn’t written to the drive.

Leveraging page metadata to reduce file system overhead

Traditional file systems that rely on an allocation table, journal or master record protect all file metadata to ensure durability (even in the event of system failures). This requires numerous writes to these tables, and while it provides an extra layer of safety, new file systems designed to work with solid-state memory are starting to replace these models.

Metadata can be leveraged to guarantee that indices can be restored if anything unusual happens, as opposed to ensuring that the metadata is always durable. By using a consistent approach instead of looking at durability to solve the problem, far less metadata has to be written to the drive to begin with. This dramatically reduces the influence of WA cycles.

Write amplification must be reduced

System administrators need to reduce write amplification, as it adds overhead and reduces the life of chips. As new file systems designed with NAND technology mature, compliance from the industry is likely to rise as the advantages become clearer.

Synchronoss Impresses Investors

Synchronoss Technologies Inc, a global leader in managed mobility solutions, continued its upward trend that was evident in its third-quarter results. A company release showed that the adjusted revenue climbed to $181 million, while net income rose to $32.5 million. Both these numbers are 20 percent higher than the same quarter last year. As a result, the company’s adjusted earnings was $0.68 per share. These numbers are sure to make investors happy as the expected revenue was almost three million more than what they expected, and the adjusted earnings was also $0.01 more. Due to such impressive numbers and happy investors, the shares of Synchronoss rose by 13.7 percent during trading on Tuesday.

A closer look at these numbers show that revenue from its cloud business grew by 40 percent year over year, and accounts for almost 60 percent of the company’s total sales. This growth was fueled by the rising demand from customers who wanted to make the most of cloud power. Specifically, successful cloud migrations to companies like Softbank and British Telecom helped it to gain international recognition. Also, this company’s enterprise security mobility platform brought in new clients from healthcare, legal, and financial industries. More importantly, Synchross’ partnership with Verizon UID gave it access to almost one-third of the US consumer market, besides the enterprise market. All these developments and strategies have helped Synchronoss to make such impressive strides over the last year.

Despite these numbers, there are some things that investors should watch out for. An important aspect is stock-based compensation expense, that was almost $9 million in this quarter, while the acquisition expenses amounted to $7.3 million. There is a big difference between both these expenses – the first one is something that investors will see every quarter, but the second one is more of a rarity, so it’s impact will also be for a short term only. In other words, investors should watch out for this stock-based compensation, and should ensure that it does not go too high.

Currently, this company boasts of more than 130 patents, and three billion plus mobile subscribers from around the world. Many of its customers include leading companies such as Verizon, AT&T, Charter Communications, Vodafone, Comcast, and Time Warner Cable in the communications sector, Goldman Sachs and Softbank in the financial sector, and OEM companies like Microsoft, Apple, and Samsung. Other than these big names, Synchronoss caters to almost 300 of the Fortune 500 companies.

Going forward, this client-base is only going to increase. In fact, Synchronoss is likely to be a good bet for investors, as it is focusing more on its cloud business, and through it, plans to increase its sales and revenue multi-fold. It is also planning to come up with more cloud-based solutions, and expand the features on its existing products, to meet the growing demands of its customers.

This company has three broad lines of business – universal ID, secure mobility, and personal cloud. It  is headquartered in Bridgewater, New Jersey, and trades under the stock symbol SNCR on the New York Stock Exchange.

The post Synchronoss Impresses Investors appeared first on Cloud News Daily.

Mobility, IoT and SDN helping in network refreshes – but security may be an afterthought

(c)iStock.com/plusphoto

Good news and bad news, according to the latest research from Dimension Data; enterprise networks are being refreshed more frequently, but it’s coming at a cost on the security side.

The classic image of the enterprise network sagging under a series of legacy technologies is becoming a thing of the past, the company argues in its latest Network Barometer Report due to the pressure from technologies such as mobility, software defined networking (SDN) and the Internet of Things (IoT). Yet when it comes to security, companies neglecting to patch their networks remains a concern.

In terms of geographical splits, the Americas saw a particularly fast growth, with the number of ageing and obsolete devices spotted dropping from 60% in 2015 to 29% this year, while Europe, Asia Pacific and Australia saw growth at a more regular pace. According to the company, this explanation can be put down to American enterprises refreshing their networks due to the new generation of programmable infrastructure, compared to other regions who refresh as part of data centre network redesigns.

Despite some of the issues with older networks – such as not being able to handle the traffic for cloud-based collaboration, or IoT or SDN, Dimension Data argues it needs to be handled with care.

“Ageing networks are not necessarily a bad thing: companies just need to understand the implications,” said Andre van Schalkwyk, network consulting senior practice manager at Dimension Data in a statement. “They require a different support construct, with gradually increasing support costs. On the other hand, this also means that organisations can delay refresh costs.”

One aspect of the research was much bleaker than the rest; the number of devices inspected which had at least one known security vulnerability – in other words, made public by their manufacturer – had risen from 60% last year to 76% in 2016. 97,000 network devices were assessed in total.

Oracle completes $9.3bn NetSuite deal after bump in road

©iStock.com/maybefalse

Oracle has announced the completion of cloud ERP software provider NetSuite for $9.3 billion after shareholders approved the transaction.

In a short note issued earlier this week, the company confirmed that the acquisition would be completed by November 7, after a small majority – 53% – of NetSuite shares had been tendered in favour of the agreement. The original tender date expired on November 4, while the Department of Justice approved the deal in September.

The deal has not been without its hiccups, however. T. Rowe Price, a NetSuite shareholder, warned Oracle to up its offer from $109 per share cash to $133 per share. A month ago, Oracle showed its hand and announced a final extension of its tender offer, noting: “In the event that a majority of NetSuite’s unaffiliated shareholders do not tender sufficient shares to reach the minimum tender condition, Oracle will respect the will of NetSuite’s unaffiliated shareholders and terminate its proposed acquisition.”

Speaking to this publication when the deal was originally announced in July, John Dinsdale, chief analyst and managing director of Synergy Research, explained how the acquisition would strengthen Oracle’s cloud story. “It will push Oracle a couple of places higher in the enterprise SaaS market share rankings and will strengthen its position as one of the two leading ERP SaaS vendors, alongside SAP,” he said.

In an FAQ feature when the deal was announced, the two companies elaborated on the benefits of the partnership and that it would remain business as usual for both parties. “Oracle and NetSuite cloud applications are complementary and will co-exist in the marketplace forever,” it read. “Oracle intends to invest heavily in both products – engineering and distribution.”

Get productivity gains with a mobile workforce solution

The mobile revolution along with cloud technology has changed the definition of an office, transforming it from a location-based entity into a virtual office with mobile workforce. According to IDC, the US mobile workforce population amounted to 96.2 million in 2015. It is expected to touch 105.4 million by 2020. Strategy Analytics firm reports that […]

The post Get productivity gains with a mobile workforce solution appeared first on Parallels Blog.

Optimizing VMware Environments for Peak SQL Server Performance | @CloudExpo #Cloud #Analytics #MachineLearning

VMware configurations designed to provide high availability often make it difficult to achieve satisfactory performance required by mission-critical SQL Server applications. But what if it were possible to have both high availability and high performance without the high cost and complexity normally required?
This article explores two requirements for getting both for SQL applications, while reducing capital and operational expenditures. The first is to implement a storage architecture within VMware environments designed for both high availability and high performance; the second involves tuning the high availability (HA) and high performance (HP) HA/HP architecture for peak performance.

read more

How to find your Parallels Desktop for Mac license key

Parallels Support team guest author: Dineshraj Yuvaraj You are using Parallels Desktop and planning to upgrade to the latest version? Or do you want to install Parallels Desktop from scratch? Either way, you will need your Parallels Desktop for Mac license key to do that. Let me walk you through some simple steps on how to […]

The post How to find your Parallels Desktop for Mac license key appeared first on Parallels Blog.

For the Next Storage Solution, Look to the (Literal) Clouds | @CloudExpo #Cloud #Storage #DataCenter

The seemingly miraculous hand-held devices we use today are a far cry from the computers of old. Capabilities, speed, affordability and storage have increased dramatically, transforming every aspect of our lives. As a point of reference, the first data centers were rooms that housed huge, individual mainframe computers. These machines cost millions of dollars each, and time on them had to be rented by several organizations because no one except governments and higher educational institutions could afford to build them.

read more

“Rigid, confused and complex” infrastructure leads to employee collaboration issues

(c)iStock.com/triloks

Even though the majority of respondents in a survey released by Oracle say collaboration between business and IT is key for an enterprise cloud model to succeed, a plethora of barriers remain.

The research, which polled 1,200 technology decision makers in midsize and large companies across three continents, found more than a quarter (27%) of respondents said managing shadow IT is a ‘significant’ barrier to adopting an integrated approach to the cloud, while almost half (43%) say business departments lack understanding when it comes to the need for integrated cloud resources.

Other barriers for adopting an integrated cloud approach, and thus precluding collaboration, were proving return on investment, cited by 36% of respondents, discord between infrastructures (36%), increased cost (31%) and increased security risk (29%).

Naturally, the takeaway from the research is that by using infrastructure as a service – a service which Oracle is more than happy to provide – organisations can collaborate more freely and the divisions between line of business and IT will become more harmonious.

“These issues can be blamed in part on infrastructure that has become too rigid, confused and complex,” said Pascal Giraud, senior director IaaS foundation and cloud platform Oracle EMEA in a statement. “This has led to an unresponsive, disjointed organisation where opportunity and innovation fall down the cracks between lines of business and badly integrated systems.”

Elsewhere, research from Databarracks has found that nearly two thirds (61%) of IT decision makers polled believe their employees regularly sidestep their employer’s security policies. Issues which may go against corporate policy include taking company data off-site, keeping written records of passwords, and fabricating or omitting information on sign-in sheets.

The company added that, despite the rise in ransomware attacks, there remains a “blind ignorance” to enterprise security. 

Powering Cloud with Renewable Energy

A common criticism of cloud technology is its energy consumption. The many data centers that make cloud storage seamless and convenient, is also a major consumer of power. According to the Natural Resource Defense Council, US data centers consumed a whopping 91 billion kilowatts of electricity in 2013, and this is roughly equal to the output of 34 mega coal power plants. At this rate of consumption, it is estimated that data centers will need 140 billion kilowatts of electricity by 2020.

Sounds unsustainable? You’re absolutely right!

The amount of coal that’ll be needed to power these plants coupled with the high rates of emission is sure to add more damage to climate change and environmental degradation.

To lower pollution levels, many top cloud providers are beginning to look at the possible use of renewable energy to power their data centers. Wind and solar are expected to the biggest sources of renewable power for cloud technology within the next few years.

Recently, Amazon Web Services (AWS) announced that it would build a 189-megawatt wind farm in Hardin County, Ohio. This wind farm alone is expected to generate 530,000 megawatts a year, beginning from the end of December, 2017. In fact, this wind farm will be AWS’ fifth renewable energy farm, with already three being operational, and the fourth one expected to come online in May 2017. The existing three wind farms are located in North Carolina, Virginia, and Indiana respectively. With these farms, already 40 percent of AWS’ operations are powered by renewable energy, and the company plans to increase it to 50 percent by the end of 2017. Eventually, AWS plans to source 100 percent of its energy consumption from renewable energy.

Besides AWS, other top cloud providers are also taking the renewable route, though their plans are not as ambitious as that of the market leader. Microsoft uses wind, solar, and hydro power plants to power its data centers, and estimates show that about 44 percent of its energy consumption comes from these sources. The company aims to reach the half-way mark by 2018, and keep improving from there on. In addition, Microsoft has been carbon neutral since 2012.

Google, another major player in the cloud market, has a different approach to tackling the problem of power consumption. This company believes it’s not practical to build large renewable energy farms in places where its data centers are located, rather it believes these farms should be located in places that are most conducive to it. For example, solar farms should be in sunny states like Arizona and California, and not in Minnesota and Wisconsin, even if this is where the data centers are located.

This company thinks a more pragmatic approach would be to buy renewable energy to power its data centers, instead of harnessing it directly from farms. This way, the company may have more flexibility in terms of the provider.

Regardless of the approach, it’s heartening to see these top companies lead the way in making this planet a more sustainable and livable place for future generations.

The post Powering Cloud with Renewable Energy appeared first on Cloud News Daily.

The cloud news categorized.