Category Archives: Storage

DropBox, Fail, File Sharing, Outage Alert, Storage

Dropbox Outage Postmortem: Not Hacked, Just Another Maintenance Fiasco

 

From Dropbox:

…On Friday at 5:30 PM PT, we had a planned maintenance scheduled to upgrade the OS on some of our machines.

…In this case, a bug in the script caused the upgrade to run on a handful of machines serving production traffic.

…some master-slave pairs were impacted which resulted in the site going down.

…We were able to restore most functionality within 3 hours, but the large size of some of our databases slowed recovery, and it took until 4:40 PM PT today for core service to fully return.

Deeper details

Disaster Recover, DRaaS, Featured, Storage, Storage and Information Management, Virtualization

10 Storage Predictions for 2014

By Randy Weis, Consulting Architect, LogicsOne

As we wrap up 2013 and head into the New Year, I wanted to give 10 predictions I have for the storage market for 2014.

  1. DRaaS will be the hottest sector of cloud-based services: Deconstructing cloud means breaking out specific services that fit a definition of a cloud type service such as Disaster Recovery as a Service (DRaaS) and other specialized and targeted usages of shared multi-tenant computing and storage services. Capital expenditures, time to market, and staff training are all issues that prevent companies from developing a disaster recovery strategy and actually implementing it. I predict that DRaaS will be the hottest sector of cloud based services for small to medium businesses and commercial companies. This will impact secondary storage purchases.
  2. Integration of flash storage technology will explode: The market for flash storage is maturing and consolidating. EMC has finally entered into the market. Cisco has purchased Whiptail to integrate it into unified computing systems. PCI flash, server flash drives at different tiers of performance and endurance, hybrid flash arrays, and all flash arrays will all continue to drive the adoption of solid state storage in mainstream computing.
  3. Storage virtualization – software defined storage on the rise: VMware is going to make their virtual VSAN technology generally available at the beginning of Q2 in 2014. This promises to create a brand new tier of storage in datacenters for virtual desktop solutions, disaster recover, and other specific use cases. EMC is their first release of a software defined storage product called ViPR. It has a ways to go before it really begins to address software defined storage requirements, but it is a huge play in the sense that it validates a segment of the market that has long had a miniscule share. DataCore has been the only major player in this space for 15 years. They see EMC’s announcement as a validation of their approach to decoupling storage management and software from the commodity hard drives and proprietary array controllers.
  4. Network Attached Storage (NAS) Revolution: We’re undergoing a revolution with the integration and introduction of scale out NAS technologies. One of the most notable examples is Isilon being purchased by EMC and starting to appear as a more fully integrated and fully available solution with a wide variety of applications. Meanwhile NetApp continues to innovate in the traditional scale up NAS market with increasing adoption of ONTAP 8.x. New NAS systems feature support of the most recent releases SMB 3.0, Microsoft’s significant overhaul of Windows-based file sharing protocol (also known as CIFS). This has a significant impact on design Hyper V Storage and Windows file sharing in general. Client and server side failover are now possible with SMB 3.0, which enables the kind of high availability and resiliency for Hyper V that VMware has enjoyed as a competitive advantage.
  5. Mobile Cloud Storage – File Sharing Will Never Be the Same: Dropbox, Box, Google Drive, Huddle and other smartphone-based methods to access data anywhere are revolutionizing the way individual consumers access their data. This creates security headaches for IT admins, but the vendors are responding with better and better security built into their products. At the enterprise level, Syncplicity, Panzura, Citrix ShareFile, Nasuni and other cloud storage and shared storage technologies are providing deep integration into Active Directory and enabling transfer of large files across long distances quickly and securely. These technologies integrate with on premise NAS systems and cloud storage. Plain and simple, file sharing will never be the same again.
  6. Hyper Converged Infrastructure Will Be a Significant Trend: The market share dominance of Nutanix, Simplivity (based in Westborough, MA) and VMware’s VSAN technology will all change the way shared storage is viewed in datacenters of every size. These products will not replace the use of shared storage arrays but, instead, provide an integrated, flexible and modular way to scale virtualized application deployments, such as VDI and virtual servers. These technologies all integrate compute & storage, networking (at different levels) and even data protection technology, to eliminate multiple expenditures and multiple points of management. Most importantly, Hyper-converged Infrastructure will allow new deployments to begin small and then scale out without large up-front purchases. This will not work for every tier of application or every company, but it will be a significant trend in 2014.
  7. Big Data Will Spread Throughout Industries: Big Data has become as much a buzzword as cloud. The actual use of the technologies that we call big data is growing rapidly. This adoption is not only in internet giants like Google and companies that track online behavior, but also in industries such as insurance, life sciences, and retailers. Integration of big data technologies (i.e. Hadoop, MapReduce) with more traditional SQL database technology allows service providers of any type to extract data from traditional databases and begin processing it on a huge scale more efficiently and more quickly, while still gaining the advantage of more structured databases. This trend will continue to spread throughout many industries that need to manage large amount of structured and unstructured data.
  8. Object based storage will grow: Cloud storage will be big news for 2014 for two major reasons. The first reason stems from shock waves of Nirvanix going out of business. Corporate consumers of cloud storage will be much more cautious and demand better SLAs in order to hold cloud storage providers accountable. The second reason has to do with adoption of giant, geographically dispersed data sets. Object based storage has been a little known, but important, development in storage technology that allows data sets on scale of petabytes to be stored and retrieved by people who generate data and those who consume it. However, these monstrous data sets can’t be protected by traditional RAID technologies. Providers such as Cleversafe have developed a means to spread data across multiple locations, preserving its integrity and improving resiliency while continuing to scale to massive amounts.
  9. More Data Growth: This may seem redundant, but it is predicted that business data will double every two years. While this may seem like great news for traditional storage vendors, it is even better news for people who provide data storage on a massive scale, and for those technology firms that enable mobile access to that data anywhere while integrating well with existing storage systems. This exponential data growth will lead to advances in file system technologies, object storage integration, deduplication, high capacity drives and storage resource/lifecycle management tool advances.
  10. Backup and Data Protection Evolution + Tape Will Not Die: The data protection market continues to change rapidly as more servers and applications are virtualized or converted to SaaS. Innovations in backup technology include the rapid rise of Veeam as a dominant backup and replication technology – not only for businesses but also for service providers. The Backup as a Service market seems to have stalled out because feature sets are limited; however the appliance model for backups and backup services continue to show high demand. The traditional market leaders face very strong competition from the new players and longtime competitor CommVault. CommVault has evolved to become a true storage resources management play and is rapidly gaining market share as an enterprise solution. Data deduplication has evolved from appliances such as Data Domain into a software feature set that’s included in almost every backup software out there. CommVault, Veeam, Backup Exec, and others all have either server side deduplication or client side deduplication (or both). The appliance model for disk-spaced backups continues to be popular with Data Domain, ExaGrid, and Avamar as leading examples. EMC dominates this market share – the competition is still trying to capture market share. Symantec has even entered the game with its own backup appliances, which are essentially servers preconfigured with their popular software and internal storage. Tape will not die. Long term, long capacity archives still require use of tapes, primarily for economic reasons. The current generation of tape technology, such as LTO6, can contain up to 6 TB of data on a single tape. Tape drives are routinely made with built-in encryption to avoid data breaches that were more common in the past with unencrypted tape.

 

So there you have it, my 2014 storage predictions. What do you think? Which do you agree with/disagree with? Did I leave anything off that you think will have a major impact next year? As always, reach out if you have any questions!

 

Featured, IaaS, Miscellaneous IT, Networking, Saas, SDDC, Storage, Virtualization

The 2013 Tech Industry – A Year in Review

By Chris Ward, CTO, LogicsOne

As 2013 comes to a close and we begin to look forward to what 2014 will bring, I wanted to take a few minutes to reflect back on the past year.  We’ve been talking a lot about that evil word ‘cloud’ for the past 3 to 4 years, but this year put a couple of other terms up in lights including Software Defined X (Datacenter, Networking, Storage, etc.) and Big Data.  Like ‘cloud,’ these two newer terms can easily mean different things to different people, but put in simple terms, in my opinion, there are some generic definitions which apply in almost all cases.  Software Defined X is essentially the concept of taking any ties to specific vendor hardware out of the equation and providing a central point for configuration, again vendor agnostic, except of course for the vendor providing the Software Defined solution :) .  I define Big Data simply as the ability to find a very specific and small needle of data in an incredibly large haystack within a reasonably short amount of time. I see both of these technologies becoming more widely adopted in short order with Big Data technologies already well on the way. 

As for our friend ‘the cloud,’ 2013 did see a good amount of growth in consumption of cloud services, specifically in the areas of Software as a Service (SaaS) and Infrastructure as a Service (IaaS).  IT has adopted a ‘virtualization first’ strategy over the past 3 to 4 years when it comes to bringing any new workloads into the datacenter.  I anticipate we’ll begin to see a ‘SaaS first’ approach being adopted in short order if it is not out there already.  However, I can’t necessarily say the same on the IaaS side so far as ‘IaaS first’ goes.  While IaaS is a great solution for elastic computing, I still see most usage confined to the application development or super large scale out application (Netflix) type use cases.  The mass adoption of IaaS for simply forklifting existing workloads out of the private datacenter and into the public cloud simply hasn’t happened.  Why?? My opinion is for traditional applications neither the cost nor operational model make sense, yet. 

In relation to ‘cloud,’ I did see a lot of adoption of advanced automation, orchestration, and management tools and thus an uptick in ‘private clouds.’  There are some fantastic tools now available both commercially and open source, and I absolutely expect to see this adoption trend to continue, especially in the Enterprise space.  Datacenters, which have a vast amount of change occurring whether in production or test/dev, can greatly benefit from these solutions. However, this comes with a word of caution – just because you can doesn’t mean you should.  I say this because I have seen several instances where customers have wanted to automate literally everything in their environments. While that may sound good on the surface, I don’t believe it’s always the right thing to do.  There are times still where a human touch remains the best way to go. 

As always, there were some big time announcements from major players in the industry. Here are some posts we did with news and updates summaries from VMworld, VMware Partner Exchange, EMC World, Cisco Live and Citrix Synergy. Here’s an additional video from September where Lou Rossi, our VP, Technical Services, explains some new Cisco product announcements. We also hosted a webinar (which you can download here) about VMware’s Horizon Suite as well as a webinar on our own Cloud Management as a Service Offering

The past few years have seen various predictions relating to the unsustainability of Moore’s Law which states that processors will double in computing power every 18-24 months and 2013 was no exception.  The latest prediction is that by 2020 we’ll reach the 7nm mark and Moore’s Law will no longer be a logarithmic function.  The interesting part is that this prediction is not based on technical limitations but rather economic ones in that getting below that 7nm mark will be extremely expensive from a manufacturing perspective and, hey, 64k of RAM is all anyone will ever need right?  :)

Probably the biggest news of 2013 was the revelation that the National Security Agency (NSA) had undertaken a massive program and seemed to be capturing every packet of data coming in or out of the US across the Internet.   I won’t get into any political discussion here, but suffice it to say this is probably the largest example of ‘big data’ that exists currently.  This also has large potential ramifications for public cloud adoption as security and data integrity have been 2 of the major roadblocks to adoption so it certainly doesn’t help that customers may now be concerned about the NSA eavesdropping on everything going on within the public datacenters.  It is estimated that public cloud providers may lose as much as $22-35B over the next 3 years as a result of customers slowing adoption due to this.  The only good news in this, at least for now, is it’s very doubtful that the NSA or anyone else on the planet has the means to actual mine anywhere close to 100% of the data they are capturing.  However, like anything else, it’s probably only a matter of time.

What do you think the biggest news/advancements of 2013 were?  I would be interested in your thoughts as well.

Register for our upcoming webinar on December 19th to learn how you can free up your IT team to be working on more strategic projects (while cutting costs!).

 

 

Amazon, Amazon AWS, Amazon Glacier, Amazon Web Service, AWS, Glacier, Storage

Cloud Mystery: What’s the Tech Secret Behind Amazon Glacier?

ITProPortal has a good writeup on Amazon Glacier technology: tape? cheap disks they power down? It’s more than just a post filled with wild speculation because it includes informed reasoning on the current state of the art for each of the candidate technologies behind Glacier:

…of all the services offered by AWS, none have fuelled the same level of speculation and interest as Amazon’s Glacier. Though the service is well-known and widely-used in enterprise, no one knows exactly what’s behind it.

Amazon has retained a thick veil of secrecy around its most mysterious web service. The Seattle-based company has always kept the processes behind its services fairly quiet, but the omerta surrounding Glacier has been especially strict, leaving experts in the tech community perplexed about what Amazon could be hiding.

TL;DR: It might be old-fashioned robot tape libraries; it might be cheap disks they fill up then turn off until they need them for retrieval; it might be some clever hybrid of the two.

Read the article.

Asigra, Asigra Cloud Backup, Asigra Cloud Backup Connector Appliance, Cloud Connector Backup Appliance, Data recovery, Disaster Recovery/Business Continuity, Hardware, Remote backup service, Storage

Asigra Cloud Backup Appliance Offers Distributed Enterprise Data Recovery

Asigra Inc. has announced volume shipping of the company’s Cloud Backup Connector Appliance. The Asigra Cloud Backup Connector Appliance leverages the Cisco ISR G2 router and UCS E-Series server blade and includes the latest version of Asigra Cloud Backup software. The appliance provides onsite backup data storage and the ability to replicate to external cloud service providers at the user’s discretion for both local and remote recovery.

For globally distributed mid-market and enterprise organizations with multiple branch offices, the Asigra Cloud Connector provides more efficient use of storage and networking resources. The appliance provides a new and innovative way to bring flexible end-to-end enterprise-class data recovery to organizations. The Cloud Backup Connector appliance ensures that branch-office users receive LAN-like performance from their cloud backup application and that data is highly available and handled in a secure manner. The improved linkage of the network with Asigra cloud-enabled services contributes to increased performance and enhanced end-user experience.

“Our network had become increasingly more complex, storage was growing and our previous backup solution was struggling to keep pace,” said Simon Johnson, Finance Director at Opus Trust. By implementing the Cloud Connector Backup Appliance powered by Asigra, we simplified the infrastructure and improved the levels of data protection and recovery across all of our network and applications. We now have local backup to disk, automated offsite backup and a complete IT DR plan through the OnDemand Recovery service, implemented by Project Vision.”

“Our switch to the Cloud Backup Connector Appliance helped the company to achieve several business benefits,” said David Van Eck, Head of IT at L.K. Bennett. “Through a centralized online monitoring portal made available by our service provider, Backup Technology Ltd., we receive guaranteed backup and recovery for all of our data systems as a professional and fully managed service. The backup forms the basis for our enterprise-wide data recovery solution, which is essential to L.K. Bennett.”

The Cloud Backup Connector Appliance features:

  • Asigra Cloud Backup v12.2 pre-installed for plug-and-play mass deployment and agentless protection of all computing environments
  • The ability to perform standalone local backup and/or connect to the service provider of choice for offsite recovery
  • End-to-end data protection of storage, servers, desktops, laptops and mobile devices (tablets and smartphones)
  • High-performance data recovery across physical, virtual and cloud operating environments
  • Autonomic healing to ensure data integrity/recoverability
  • Enterprise-class security for regulated industries such as healthcare, financial services and government with FIPS 140-2 certification
  • 2TB internal storage standard which scales to 10TB per appliance to store compressed, de-duplicated data for local recovery
  • Capability to leverage external cloud service providers for offsite data recovery
  • Connectivity: Three integrated 10/100/1000 Ethernet ports with 1 port capable of RJ-45 or SFP connectivity, one service module slot, three onboard digital signal processor slots and one internal service module for application services

Cloud Storage, Computer data storage, Hardware, Seagate, Seagate Technology, Storage

Seagate Kinetic Open Storage Platform: a Promising Distributed Hardware Infrastructure

Seagate Technology hopes to redefine cloud storage infrastructure with the unveiling of its internally developed Seagate Kinetic Open Storage platform. A potential leap forward in scale-out storage architectures, the innovative storage platform promises to simplify data management and improve performance and scalability while lowering total cost of ownership of typical cloud infrastructures.

“With the Seagate Kinetic Open Storage platform, our internal R&D teams have designed an unique, first-of-its-kind storage architecture to enable cheaper, more scalable object storage solutions that free up IT professionals from having to invest in hardware and software they don’t need—while empowering them with the most innovative storage technology available,” said Rocky Pimentel, Seagate executive vice president and chief sales and marketing officer. “This technology optimizes storage solutions for a new era of cloud storage systems, while drastically reducing overall costs.”

The platform leverages Seagate’s expertise in hardware and software storage systems to integrate a new key/value API – which will be open sourced – and Ethernet connected with Seagate hard drive technology. Designed for rapid implementation and deployment in any cloud storage software stack, this technology can be deployed across a portfolio of storage devices enabling system builders and software developers to design new solutions that will deliver against a full array of cloud data center use cases.

Redefining hardware and software capabilities, the platform enables cloud service providers and independent software vendors to optimize scale-out file and object-based storage—simply and effectively. With the Kinetic Open Storage platform, applications can now manage specific features and capabilities and rapidly implement and deploy in any cloud storage software stack. The technology also increases I/O efficiency by removing bottlenecks and optimizing cluster management, data replication, migration, and active archive performance.

Big Data, Data center, Facebook, Green, Hardware, Oregon, Prineville Oregon, Social, Storage

Take a Photo Tour of Facebook’s Amazing Cold Storage Datacenter

There’s a fascinating photo tour of Facebook’s Oregon data center on readwrite today.

Facebook (arguably) owns more data than God.

But how to store a cache of user data collected at the scale of omniscience? If you’re Facebook, just build another custom-crafted server storage locker roughly the size of the USS Abraham Lincoln on top of a breezy plateau in the Oregon high desert. The company’s new Prineville, Ore., data center employs an ultra-green ”cold storage” plan designed from the ground up to meet its unique—and uniquely huge—needs.

The piece also includes useful links on the tech behind the data center, shingled drive tech, and the Open Compute project that led to the innovations on display here.

Amazon AWS, Facebook, Google, Hardware, Magnetic storage, Open Compute Project, Opinion, Research, Seagate Technology, Storage, Tape library

Will Disks Using Shingled Magnetic Recording Kill Tape for Cold Storage?

We previously reported on the rumored Seagate/eVault “cold storage” tech initiative seeking to use disks to supplant tape libraries.

Now come this analysis from The Register.

We know Facebook’s Open Compute Project has a cold storage vault configuration using shingled magnetic recording drives. Both Google (mail backup and more) and Amazon (Glacier) have tape vaults in their storage estate. Shingled drives could change that equation because, probably, the cost/GB of a 6TB shingled drive is a lot less that that of a 4TB drive and, over, say, 500,000 drives, that saving turns into a big sum of dollars.

What are shingled drives, you ask? This video from Seagate explains:

Chapter 11 Title 11 United States Code, Nirvanix, Storage

Stormy Weather: Cloud Storage Vendor Nirvanix Files for Chapter 11

Nirvanix yesterday filed for Chapter 11 bankruptcy protection.

According to an announcement on their website:

“We have an agreement with IBM, and a team from IBM is ready to help you. In addition, we have established a higher speed connection with some companies to increase the rate of data transfer from Nirvanix to their servers.”

Customers have until October 15 to move their data elsewhere.

Read earlier posts on the Nirvanix shutdown: the what and the why.

 

Bitrix, Bitrix24, Collaboration, Content Management, Customer Relationship Management, Document Management, Messaging, Mobile, Social, Storage

Bitrix24 Collaboration for SMBs Update Supports Online Document Creation, Sharing

Bitrix has released a new version of Bitrix24, its free enterprise social network and collaboration suite for small businesses. The new release allows users to create, edit and collaborate on documents online, without having MS Office suite installed on their personal computers.

In addition to using Bitrix24 instant messenger for video and group chats, users now have access to video conferencing and screen sharing capabilities. Email connectors to MS Exchange, Outlook, Gmail, AOL, Yahoo!, iCloud and other popular e-mail services have been added to enable e-mail access from Bitrix24 accounts.

Activity Stream has been enhanced with real time updates, smart forwarding, notification options and company-wide announcements, while engagement analytics module (Company Pulse) has been added to provide real time indicators for enterprise social network adoption, identify roadblocks and slow adopters, and show which intranet tools are currently being (under)used by employees.

Bitrix24 has also released a fully functional mobile CRM, which allows creation or editing of CRM entries and invoices directly from the mobile device. The new mobile app also allows using multiple Bitrix24 accounts from a single smartphone or tablet.

“2013 has been a year of significant growth for us, – said Bitrix24 CEO Dmitry Valyanov, – we’ve signed up 90,000 companies, which is well over 500,000 users for the cloud and onsite versions of Bitrix24 intranet. Our workforce grew by 40% to over 130 employees and we opened three new sales and support offices. GooglePlay now lists Bitrix24 among the top 5 mobile intranet apps, along with or surpassing such established enterprise social brands as Jive Software, IBM Connection, VMWare SocialCast and TIBCO Tibbr. We hope to have a million users by the end of the year.”

Bitrix24 is 100% free to any company or organization with up to 12 employees. Bitrix24 paid cloud plans are priced at $99/mo (50 GB) and $199/mo (100 GB), and both come with unlimited users.