Category Archives: Open Source

Intel, Jason Waxman, Jonathan Bryce, NASA, News & Analysis, Open Source, OpenStack, Rackspace, Scott Crenshaw

Rackspace, Intel to coordinate ‘world’s largest OpenStack dev team’

Intel and Rackspace claim the centre will house the world's largest OpenStack development team

Intel and Rackspace claim the centre will house the world’s largest OpenStack development team

Rackspace and Intel are teaming up to launch an OpenStack Innovation Centre aimed at bolstering upstream development of the cloud platform.

The centre, housed at Rackspace’s corporate HQ in San Antonio, Texas, will bring together technical specialists from Rackspace and Intel to co-develop new features and functions for OpenStack and fix bugs in the code base, with the fruits of their efforts being contributed back upstream.

The companies will also offer OpenStack training to engineers and developers; they claim the centre will house the world’s largest dedicated OpenStack development team.

“We are excited to collaborate with Intel and look forward to working with the OpenStack community to make the world’s leading open-source cloud operating system even stronger,” said Scott Crenshaw, senior vice president of product and strategy at Rackspace.

“We don’t create proprietary OpenStack distributions.  Rackspace delivers its customers four-nines availability using entirely upstream trunk code. All of the Innovation Centre’s contributions will be made available freely, to everyone,” Crenshaw said.

Jason Waxman, vice president of the Cloud Platforms Group at Intel said: “This announcement demonstrates our continued support and commitment to open source projects. Our ongoing collaboration with Rackspace and the OpenStack community represents an ideal opportunity to accelerate the enterprise appeal of OpenStack.”

OpenStack, which this week celebrated its fifth anniversary, was founded by a few engineers from Rackspace and NASA but has since swelled to more than 520 member companies and 27,000 individual contributors globally. While the open source cloud platform is young, it has matured significantly during its brief existence and has become a defacto cloud standard embraced by many if not most of the big IT incumbents.

“The community’s goal is to foster collaboration and spur innovation that drives broad adoption,” said Jonathan Bryce, executive director of the OpenStack Foundation. “The depth of experience and community engagement that Rackspace and Intel offer makes this an exciting project, as the code contributions and large-scale testing will benefit everyone who uses OpenStack.”

AT&T, Box, Cisco, Cloud Foundry Foundation, CoreOS, Cycle Computing, Docker, eBay, Goldman Sachs, Google, Huawei, IBM, Intel, Joyent, Kismatic, Linux containers, Mesosphere, News & Analysis, Open Source, Red Hat, Switch Supernap, Twitter, Univa, VMware

Box, Docker, eBay, Google among newly formed Cloud Native Computing Foundation

The Cloud Native Computing Foundation is putting Linux containers at the core of its definition of 'cloud-native' apps

The Cloud Native Computing Foundation is putting Linux containers at the core of its definition of ‘cloud-native’ apps

The Linux Foundation along with a number of enterprises, cloud service providers , telcos and vendors have banded together to form the Cloud Native Computing Foundation in a bid to standardise and advance Linux containerisation for cloud.

The newly formed open source foundation, a Linux Foundation collaborative project, plans to create and drive adoption of common container technologies at the orchestration level, and integrate hosts and services by defining common APIs and standards.

The organisation also plans to assemble specifications to address a “comprehensive set of container application infrastructure needs.”

The members at launch include AT&T, Box, Cisco, Cloud Foundry Foundation, CoreOS, Cycle Computing, Docker, eBay, Goldman Sachs, Google, Huawei, IBM, Intel, Joyent, Kismatic, Mesosphere, Red Hat, Switch Supernap, Twitter, Univa, VMware and Weaveworks.

“The Cloud Native Computing Foundation will help facilitate collaboration among developers and operators on common technologies for deploying cloud native applications and services,” said Jim Zemlin, executive director at The Linux Foundation.

“By bringing together the open source community’s very best talent and code in a neutral and collaborative forum, the Cloud Native Computing Foundation aims to advance the state-of-the-art of application development at Internet scale,” Zemlin said.

The central goal of the foundation will be to harmonise container standards and techniques. A big challenge with containers today is there are many, many ways to implement them, with a range of ‘open ecosystems’ and vendor-specific approaches, all creating one heterogeneous, messy pool of technologies that don’t always play well together.

That said, the foundation expects to build on other existing open source container initiatives including Docker’s recently announced Open Container Initiative (OCI), with which it will work on building its container image spec into the standards it develops. Google also announced that the foundation would henceforth govern development of Kubernetes, which reached v.1 this week, over to the foundation.

“Google is committed to advancing the state of computing, and to helping businesses everywhere benefit from the patterns that have proven so effective to us in operating at Internet scale,” said Craig McLuckie, product manager at Google. “We believe that this foundation will help harmonize the broader ecosystem, and are pleased to contribute Kubernetes, the open source cluster scheduler, to the foundation as a seed technology.”

Ben Golub, chief executive of Docker said while the OCI offers a solid foundation for container-based computing many standards and fine details have yet to be agreed.

“At the orchestration layer of the stack, there are many competing solutions and the standard has yet to be defined. Through our participation in the Cloud Native Computing Foundation, we are pleased to be part of a collaborative effort that will establish interoperable reference stacks for container orchestration, enabling greater innovation and flexibility among developers. This is in line with the Docker Swarm integration with Mesos,” Golub said.

centurylink, Chef, Docker, Jared Wray, News & Analysis, Open Source, VMware, vSphere

CenturyLink open sources more cloud tech

CenturyLink has open sourced a batch of cloud tools

CenturyLink has open sourced a batch of cloud tools

CenturyLink has open sourced a number of tools aimed at improving provisioning for Chef on VMware infrastructure as well as Docker deployment, orchestration and monitoring.

Among the projects open sourced by the company include a Chef provisioning driver for vSphere, Lorry.io – a tool for creating, composing and validating Docker images, and imagelayers.io – a tool that helps improve Docker image visualisation in order to help give developers more visibility into their workloads.

“The embrace of open-source technologies within the enterprise continues to rise, and we are proud to be huge open-source advocates and contributors at CenturyLink,” said Jared Wray, senior vice president of platforms at CenturyLink.

“We believe it’s critical to be active in the open-source community, building flexible and feature-rich tools that enable new possibilities for developers.”

While CenturyLink’s cloud platform is proprietary and developed in house Wray has repeatedly said open source technologies form an essential part of the cloud ecosystem – Wray himself was a big contributor to Cloud Foundry, the open source PaaS tool, when developing Iron Foundry.

The company has also previously open sourced other tools, too. Last summer it punted a Docker management platform it calls Panamax into the open source world, a platform is designed to ease the development and deployment of any application sitting within a Docker environment. It has also open sourced a number of tools designed to help developers assess the total cost of ownership of multiple cloud platforms.

Craig McLuckie, Google, Kubernetes, Laurent Lachal, Mark Collier, News & Analysis, Open Source, OpenStack, ovum

Google joins OpenStack to build bridges between public and private clouds

Google has joined the OpenStack Foundation, a big sign of support for the open source software organisation

Google has joined the OpenStack Foundation, a big sign of support for the open source software organisation

Google has officially signed up to sponsor the OpenStack Foundation, the first of the big three – Google, Microsoft and AWS – to formally throw its weight behind the open source cloud orchestration software. Analysts believe the move will improve support for Linux containers across public and private cloud environments.

Google has already set to work integrating Kubernetes with OpenStack with pure-play OpenStack software vendor Mirantis, a move the company said would help bolster its hybrid cloud capabilities.

While the company has had some engineers partnering with the Foundation on Magnum and Murano, container-focused toolsets baked into the open source platform, Google said it plans to significantly bolster the engineering resource it devotes to getting Linux containers – and particularly its open source scheduling and deployment platform Kubernetes – integrated with OpenStack.

The formal sign of support from such a big incumbent in the cloud space is a big win for OpenStack.

“We are excited about becoming active participants in the OpenStack community,” said Craig McLuckie, product manager at Google. “We look forward to sharing what we’ve learned and hearing how OpenStack users are thinking about containers and other technologies to support cloud-native apps.”

Mark Collier, chief operating officer of the OpenStack Foundation said: “OpenStack is a platform that frees users to run proven technologies like VMs as well as new technologies like containers. With Google committing unequaled container and container management engineering expertise to our community, the deployment of containers via proven orchestration engines like Kubernetes will accelerate rapidly.”

Although Google has a long history of open sourcing some of the tools it uses to stand up its own cloud and digital services like search it hasn’t always participated with many open source forums per se.

In a sense Kubernetes marked a departure from its previous trajectory, and as Ovum’s lead software analyst Laurent Lachal explained to BCN, it seems to be focusing on containers as a means of building a bridge between private and public clouds.

“Google knows that it needs to play nice with cloud platforms like OpenStack and VMware, two platforms that are primarily private cloud-centric, if it wants to get workloads onto its public cloud,” he explained.

“Joining OpenStack is exactly that – a means to building a bridge between private and public clouds, and supporting containers within the context of OpenStack may be both a means of doing that and generating consensus around how best to support containers in OpenStack, something that could also work in its favour.”

“There’s also a big need for that kind of consensus. Currently, everyone wants to join the containers initiatives in the open source project but there isn’t much backing for one particular way of delivering the container-related features users need,” he added.

Asia Pacific, CSA, New Zealand, News & Analysis, Open Source, STRATUS

CSA lends prototype compliance tool to six-year cloud security project

The CSA is part of the STRATUS project, a six-year cybersecurity project

The CSA is part of the STRATUS project, a six-year cybersecurity project

The Cloud Security Alliance (CSA) said this week that it is lending a prototype data auditing and compliance regulation tool to the STRATUS initiative, a six-year multi-million dollar cybersecurity project funded by New Zealand’s Ministry of Business, Innovation, and Employment.

STRATUS, which stands for Security Technologies Returning Accountability, Transparency and User-centric Services in the Cloud, is a project being led by the University of Waikato intends to develop a series of security tools, techniques and capabilities to help give cloud users more control over how they secure the cloud services they use.

As part of the project the CSA showed how cloud data governance could be automated by applying auditing guidelines (CSA Cloud Control Matrix, ISO standards, etc.) and compliance regulations using a recently developed online tool.

The organisation, which is leading the data governance and accountability subproject within STRATUS, said it would also help support STRATUS’ commercialisation efforts.

“STRATUS’ approach to research commercialisation is different from typical scientific research grants,” said Dr. Ryan Ko, principal investigator of STRATUS, and CSA APAC research advisor.

“STRATUS understands that for cloud security innovation to reach a global audience, it will require a platform which will allow these cutting-edge cloud services to quickly align to global best practices and requirements – a core CSA strength given its strong research outputs such as the Cloud Controls Matrix and the Cloud Data Governance Working Group,” Ko said.

Aloysius Cheang, managing director for CSA APAC: “We have developed a prototype tool based on our work so far, that has received positive reviews. In addition, we are working to connect STRATUS and New Zealand to the CSA eco-system through our local chapter. More importantly, we are beginning to see some preliminary results of the efforts to connect to dots to commercialisation efforts as well as standardization efforts.”

The organisation reckons it should be able to show off the “fruit of these efforts” in November this year.

News & Analysis, Open Source, OpenPower, OpenStack, SuperVessel, Terri Virnig, Tsinghua University, Vendor, Wei Xu

IBM releases tool to advance cloud app development on OpenPower, OpenStack

IBM has announced a service to help other develop and test OpenPower-based apps

IBM has announced a service to help other develop and test OpenPower-based apps

IBM announced the launch of SuperVessel, an open access cloud service developed by the company’s China-based research outfit and designed for developing and testing cloud services based on the OpenPower architecture.

The service, developed by Beijing’s IBM Research and IBM Systems Labs, is open to business partners, application developers and university students for testing and piloting emerging applications that use deep analytics, machine learning and the Internet of Things.

The cloud service is based on the latest Power8 processors (with FPGAs and GPU-based acceleration) and uses OpenStack to orchestrate the underlying cloud resources. The SuperVessel service is sliced up into various “labs”, each focusing on a specific area, and is initially launching with four: Big Data, Internet of Things, Acceleration and Virtualization.

“With the SuperVessel open computing platform, students can experience cutting-edge technologies and turn their fancy ideas into reality. It also helps make our teaching content closer to real life,” said Tsinghua University faculty member Wei Xu. “We want to make better use of SuperVessel in many areas, such as on-line education.”

Terri Virnig, IBM Vice President of Power Ecosystem and Strategy said: “SuperVessel is a significant contribution by IBM Research and Development to OpenPower. Combining advanced technologies from IBM R&D labs and business partners, SuperVessel is becoming the industry’s leading OpenPower research and development environment. It is a way IBM commits to and supports OpenPower ecosystem development, talent growth and research innovation.”

The move is part of a broader effort to cultivate mindshare around IBM’s Power architecture, which it opensourced two years ago; it’s positioning the architecture as an ideal platform for cloud and big data services. Since the launch of the OpenPower Foundation, the group tasked with coordinating development with Power, it has also been actively working with vendors and cloud service provider to mashup a range of open source technologies – for instance, getting OpenStack to work on OpenPower and Open Compute-based hardware.

Docker, Infrastructure as a Service, Kubernetes, Linux containers, Mesos, News & Analysis, Open Source

Containers ready for the primetime, Rackspace CTO says

John Engates was in London for the Rackspace Solve conference

John Engates was in London for the Rackspace Solve conference

Linux containers have been around for some time but only now is the technology reaching a level of maturity enterprise cloud developers are comfortable with, explained John Engates, Rackspace’s chief technology officer.

Linux containers have been all the rage the past year, and Engates told BCN the volume of the discussion is only likely to increase as the technology matures. But the technology is still young.

“We tried to bring support for containers to OpenStack around three or four years back,” Engates said. “But I think that containers are finally ready for cloud.”

One of the projects Engates cited to illustrate this is Project Magnum, a young sub-project within OpenStack building on Heat to produce Nova instances on which to run application containers, and it basically creates native capabilities (like support for different scheduling techniques); it effectively enables users and service providers to offer containers-as-a-service, and improves portability of containers between different cloud platforms.

“While containers have been around for a while they’ve only recently become the darling of the enterprise cloud developers, and part of that is because there’s a growing ecosystem out there working to build the tools needed to support them,” he said.

A range of use cases around Linux containers have emerged over the years – as a transport method, as a way of quickly deploying and porting apps between different sets of infrastructure, as a way of standing up a cloud service that offers greater billing granularity (more accurate / efficient usage) – the technology is still maturing and has suffered from a lack of tooling. Doing anything like complex service chaining is still challenging with existing tools, but that’s improving.

Beyond LXC, one of the earliest Linux container projects, there’s now CoreOS, Docker, Mesos, Kubernetes, and a whole host of container-like technologies that bring the microservices / OS ‘light’ architecture as well as deployment scheduling and cluster management tools to market.

“We’re certainly hearing more about how we can help support containers, so we see it as a pretty important from a service perspective moving forward,” he added.

Blue Box, Cisco, Hilton Romansky, IBM, Jim Comfort, News & Analysis, Open Source, Piston

Cisco, IBM spend big in OpenStack-focused land grab

Cisco and IBM have both acquired OpenStack vendors this week

Cisco and IBM have both acquired OpenStack vendors this week

Cisco and IBM have both signed deals to acquire OpenStack vendors this week, with Cisco acquiring Piston Cloud Computing, a firm specialising in OpenStack-based private cloud software and IBM buying up managed private cloud provider Blue Box.

Piston offers what it calls Piston CloudOS, a supped up version of OpenStack for private clouds alongside custom cluster management and monitoring software and APIs. Underneath that sits a custom Linux micro-OS that contains all of the necessary code to run CloudOS; the company said it can be characterized as a “bare-metal operating system that is tailor-made for pools of hyper-converged, commodity resources.”

Cisco said Piston will help it deliver on its Intercloud vision, which sees a Cisco-based set of cloud services that can federate with one another; OpenStack seems increasingly to be at the heart of that effort.

“Paired with our recent acquisition of Metacloud, Piston’s distributed systems engineering and OpenStack talent will further enhance our capabilities around cloud automation, availability, and scale. The acquisition of Piston will complement our Intercloud strategy by bringing additional operational experience on the underlying infrastructure that powers Cisco OpenStack Private Cloud,” said Hilton Romanski, corporate development lead at Cisco.

“Additionally, Piston’s deep knowledge of distributed systems and automated deployment will help further enhance our delivery capabilities for customers and partners,” he added.

The move will also give Cisco some strong in-house OpenStack expertise. One of Piston’s co-founders, Chris MacGown, was among the originating members of OpenStack’s Nova-core (compute) development team.

This is the second big OpenStack-focused acquisition Cisco has made in recent months. In September last year Cisco acquired Metacloud, a provider of commercially supported OpenStack. Metacloud also had IP in the networking technology it has integrated into its OpenStack distribution, which gave Cisco’s OpenStack play an SDN boost.

IBM, meanwhile has acquired managed private cloud provider Blue Box, which the company said would help bolster its hybrid cloud and OpenStack strategy.

The company said the move would enable it to provide a public cloud-like experience within its customers’ datacentres by allowing it to offer a remotely managed OpenStack offering, which it hadn’t previously.

“IBM is dedicated to helping our clients migrate to the cloud in an open, secure, data rich environment that meet their current and future business needs,” said IBM general manager of cloud services Jim Comfort. “The acquisition of Blue Box accelerates IBM’s open cloud strategy making it easier for our clients to move to data and applications across clouds and adopt hybrid cloud environments.”

IBM said it will continue to support Blue Box customers and use the company as a channel to sell its own cloud services.

Both acquisitions are a sign the old-hat vendors are putting their money where their mouths are when it comes to OpenStack – particularly when some of them, like HP and Red Hat, are digging their heels in and aggressively pushing their OpenStack wares.

blade server, Datacentre, Marc Rouanne, Networking, News & Analysis, NFV, Open Source, OpenStack, Phil Twist, Vendor

Nokia eyes the cloud infrastructure market with OpenStack, VMware-based servers

Nokia is offering up its own blade servers to the telco world

Nokia is offering up its own blade servers to the telco world

Nokia Networks revealed its AirFrame datacentre solutions this week, high-density blade servers running a combination of OpenStack and VMware software and designed to support Nokia’s virtualised network services for telcos.

“We are taking on the IT-telco convergence with a new solution to challenge the traditional IT approach of the datacentre,” said Marc Rouanne, executive vice president, Mobile Broadband at Nokia Networks.

“This newest solution brings telcos carrier-grade high availability, security-focused reliability as well as low latency, while leveraging the company’s deep networks expertise and strong business with operators to address an increasingly cloud-focused market valued in the tens of billions of euros.”

The servers, which come pre-integrated with Nokia’s own switches, are based on Intel’s x86 chips and run OpenStack as well as VMware, and can be managed using Nokia’s purpose-built cloud management solution. The platforms are ETSI NFV / OPNFV-certified, so they can run Nokia’s own VNFs as well as those developed by certified third parties.

The company’s orchestration software can also manage the split between both virtualised and network legacy functions in either centralised or distributed network architectures.

Phil Twist, vice president of Portfolio Marketing at Nokia Networks told BCN the company designed the servers specifically for the telco world, adding things like iNICs and accelerators to handle the security, encryption, virtual routing, digital signal processing (acceleration for radio) that otherwise would tie up processor capacity in a telco network.

But he also said the servers could be leveraged for standing up its own cloud services, or for the wider scale-out market.

“Our immediate ambition is clear: to offer a better alternative for the build-out of telco clouds optimized for that world.  But of course operators have other in-house IT requirements which could be hosted on this same cloud, and indeed they could then offer cloud services to their enterprise customers on this same cloud,” he explained.

“We could potentially build our own cloud to host SaaS propositions to our customers, or in theory potentially offer the servers for enterprise applications but that’s not our initial focus,” he added.

Though Twist didn’t confirm whether this was indeed Nokia’s first big move towards the broader IT infrastructure market outside networking, the announcement does mean the company will be brought into much closer competition with both familiar (Ericsson, Cisco) and less familiar (HP) incumbents offering their own OpenStack-integrated cloud kit.

CERN, Giri Fox, News & Analysis, Open Source, OpenStack, Rackspace, Tim Bell

CERN, Rackspace to harden federated cloud reference architecture

CERN and Rackspace want to create standard templates for an OpenStack cloud of clouds

CERN and Rackspace want to create standard templates for an OpenStack cloud of clouds

Rackspace and CERN openlab announced plans to redouble their efforts to create a reference architecture for a federated cloud service model.

The earliest implementations of Keystone – the mechanism in OpenStack for OpenStack-to-OpenStack identity authentication and cloud federation – came out of a collaboration between CERN and Rackspace, and now the two organisations plan to extend those efforts and create standardised templates for cloud orchestration.

“More companies are now looking to use multiple clouds to effectively serve the range of workloads they run – blending low-cost, high-performance, enhanced security and optimised environments,” says Giri Fox, Rackspace’s director of customer technology services. “But, we are still seeing the complexity businesses are facing to integrate just one cloud into their business. Federation is an opportunity to re-use that initial integration for future clouds you want to run your business on, making multi-cloud a business benefit choice rather than a business cost one.”

For those of you that aren’t familiar with CERN, the European Organization for Nuclear Research, it operates the Large Hadron Collider which during its tests (which take place intermittently) spits out over 30 petabytes of raw data per year, which then needs to be processed and made available in near real-time for physicists around the world.

But CERN is like many research organisations resource constrained, so relying on federated set of infrastructure to get all of that processing accomplished can help it overcome the capacity limitations of its own datacentres. The organisation relies on multiple OpenStack clouds based in Europe that need to be accessed by thousands of researcher, so it has a strong incentive to develop a robust open model for cloud federation.

“Our CERN openlab mission is to work with industry partners to develop open, standard solutions to the challenges faced by the worldwide LHC community. “These solutions also often play a key role in addressing tomorrow’s business challenges,” said Tim Bell, infrastructure manager in the IT department at CERN.

“After our work on identity federation with Rackspace, this is a very important step forward. For CERN, being able to move compute workloads around the world is essential for ongoing collaboration and discovery,” Bell said.