Cloud Expo Silicon Valley: Lessons from Managing 500+ AWS MySQL Instances

In his session at the 11th International Cloud Expo, Ronald Bradford, Founder & CEO of Effective MySQL, will discuss the issues of managing a large number of MySQL instances supporting one billion+ requests statements per day (and 50+ billion SQL statements). Topics include:
Monitoring and instrumentation are essential
How to automate installations, upgrades and deployments
MySQL replication issues with 300+ slaves per master
Traffic minimization techniques
Creating HA with regions and zones Real-time traffic stats (aggregated every 5 seconds)
AWS specific optimizations with EBS
Considerations with RDS

read more

How Viable Is Cloud Storage?

This week has seen announcements from two companies I’ve been interested in and following for some time.
Nasuni makes a storage appliance that stores all of a customer’s data in “the cloud”. It’s available either as a physical device (effectively a server running their software) or as a virtual machine. What makes their product interesting is that both the data and filer configuration reside on the cloud and can be reconstituted anywhere if for some reason the filer is lost (for example if the appliance is down or power was lost). The only piece of data the customer needs to retain are the encryption keys to re-enable a new image of the filer. A physical filer can even be reconstituted into a virtual one. There’s a lot more to the product than this and I have it on long term trial in the lab (so expect a fuller review soon), however this week’s announcement relates to enhancements that bring block (in the form of iSCSI) to their existing file offering. What this means is a branch office could host both file data and store data on (say) virtual machines sitting on a Nasuni iSCSI LUN datastore.

read more

Windows Azure and the Hybrid Cloud

One of the critical requirements for enterprises to adopt Cloud is the Hybrid capability. Since most of the mission critical applications live behind the firewall, they should be able to extend the functionality of these applications to the Cloud.
Since the initial announcement of Windows Azure, Microsoft has been constantly investing in hybrid features. I want to highlight some of the scenarios that are ideal candidates for the Windows Azure Hybrid Cloud.
Imagine a scenario where the e-Commerce storefront running on the public domain needs to check the customer data in an internal CRM to apply the right level of discount before each checkout. The CRM application is a homegrown line of business application developed in .NET. The business logic is already exposed through a set of service endpoints that is consumed by the frontend. Now, making these endpoints accessible to the storefront application running on the Cloud is a challenge. The IT team will not approve opening additional ports to enable communication over the public Internet. This is exactly where Windows Azure Service Bus will come to the rescue. The Service Bus relay features is designed for the use-case of taking existing Windows Communication Foundation (WCF) web services and making those services securely accessible to solutions that reside outside the corporate perimeter without requiring intrusive changes to the corporate network infrastructure. Such Service Bus relay services are still hosted inside their existing environment, but they delegate listening for incoming sessions and requests to the cloud-hosted Service Bus. By enumerating the CRM endpoints on the Service Bus, the storefront application will be able to invoke the business logic as if it is running natively on the Cloud. This feature makes it easy to extend the on-premise LOB application’s business logic to the Cloud.

read more

Data Clouds Part II: My Big Data Dashboard

In my previous blog, I wrote at length about the complexities of running a data cloud in production. This logical data set, spread across many nodes, requires a whole new set of tools and methodologies to run and maintain. Today we’ll look at one of the biggest challenges in managing a data cloud – monitoring.
Database monitoring used to be easy in the days before data clouds. Datasets were stored in a single large database, and there were hundreds of off-the-shelf products available to monitor the performance of that database. When problems occurred, one had simply to open up the monitoring tool and look at a set of graphs and metrics to diagnose the problem.
There are no off-the-shelf tools for monitoring a data cloud, however. There’s no easy way to get a comprehensive view of your entire data cloud, let alone diagnose problems and monitor performance. Database monitoring solutions simply don’t cut it in this kind of environment. So how do we monitor the performance of our data cloud? I’ll tell you what I did.

read more

Hybrid Elastic Computing for Digital Commerce at Cloud Expo Silicon Valley

Building e-commerce solutions for retail and preparing for transactions spikes on big shopping days was never easy. Preparing for the frequent and sporadic transaction spikes – launching a new game, e-book, or an online video release – in the digital world is even more difficult.
There are great benefits to an “Own the Core” strategy to maintain control and efficiencies since commerce systems are so central and connect with so many internal systems.
In his session at the 11th International Cloud Expo, Sal Visca, Elastic Path’s Chief Technology Officer, will discuss how – to remain cost-effective and not have to build out all the capacity for peak loads – an associated “Rent the Spikes” strategy allows controlled dynamic expansion out into the cloud.

read more

CIOs Warming (and Moving) to Cloud Technology

Research from Host Analytics and Dimensional Research reveal IT is spending significantly for cloud services. And CIOs are practicing what they preach, as IT departments outpace all other business units in cloud adoption, according to an article on CIO.com
Cloud technology surveys – which either impart widespread corporate cloud adoption or give warning to the over-exuberant – are relatively common in IT, frequently separated only by minor distinctions. What differentiates the various studies, however, is what motivated the research in the first place and what are the authors trying to confirm (or dispel), according to CIO.com.
Such is the case with a new body of research – underwritten by Host Analytics and mined this past May from Web-based interviews with 348 CIOs and IT professionals by Dimensional Research:
«The findings suggest a heightened optimism by CIOs concerning the value and benefits of cloud technology. Indeed, chief among Dimensional’s results is the assertion by 92 percent of CIOs and IT professionals participating in the survey that cloud technology is good for business, with 67 percent contending that it helps deliver better systems for less money. Such is CIOs’ rising enthusiasm for the cloud that it outstrips even that of their IT staff, as 81 percent of IT managers believe the cloud presents a business benefit.»

read more

ZapThink Named “Media Sponsor” of Cloud Expo Silicon Valley

SYS-CON Events announced today that ZapThink has been named “Media Sponsor” of SYS-CON’s 11th International Cloud Expo, which will take place on November 5–8, 2012, at the Santa Clara Convention Center in Santa Clara, CA.
ZapThink, A Dovèl Technologies Company, is an advisory and training firm and master of Service-Oriented Architecture (SOA), Enterprise Architecture, and architectural approaches to Cloud Computing.
For more information, visit http://www.zapthink.com.
Cloud Expo 2012 Silicon Valley, November 5–8, at the Santa Clara Convention Center in Santa Clara, CA, will feature technical sessions from a rock star conference faculty and the leading Cloud industry players in the world.

read more

Dropbox Supersizes

Dropbox has doubled the space in its existing $99-a-year Pro 50GB and $199-a-year 100GB cloud storage plans without raising prices and introduced a new $499-a-year 500GB plan.
It says it’s responding to user demand though it’s really more a matter of trying to keep up with the competition. Google Drive only costs $60 a year for 100GB and Microsoft’s SkyDrive is $50 a year for 107GB.
Current Dropbox Pro users have been automatically updated to the added space, and all new Pro users can sign up access the new 100GB, 200GB and 500GB plans.

read more

Cloud Expo Silicon Valley: The Wiring Behind the Cloud

APIs are no longer a technical nice-to-have. Now APIs are a necessary business tool for startups to scale, much as Twitter and Facebook used theirs to reach more users.
In his session at the 11th International Cloud Expo, Adam DuVander is Executive Editor of ProgrammableWeb, will show that this is doubly true in the cloud. APIs are the wiring that connects the cloud to apps on tablets, smartphones or TVs. APIs can also speed up business development, even between startups and larger companies. With an API, business relationships become easier, because there’s a defined process waiting for a connection.

read more