Clouds are on the horizon

From the cloud-themed t-shirts and signage of the event, to VMware’s vCloud initiative announcement, to sessions and BOFs on clouds. What’s interesting is that there is still a ton of debate and confusion around what a cloud actually is. See my previous post on the definition of cloud for my own thoughts. Regardless of the lack of definition, many people were nodding in agreement about cloud technology. The promise of provisioning on demand without waiting for weeks from your IT department had many people excited. There was much talk about virtualization and clouds introducing agility in provisioning that would rise to meet the agility software teams require to do their jobs.

Private enterprise clouds are coming

Out on the vendor floor, there were several companies working on enabling private enterprise clouds (by this, I mean virtualized data centers that behave in increasingly cloud-like ways, by offering dynamic provisioning, apis or scriptability, etc). Of these, the one that caught my eye was http://www.qlayer.com/, going so far as to offer their own python-like language for scripting datacenter automation. From what I understood they are also going to be supporting platforms other than VMware, which is important. This will be a company to keep your eye on.

Orchestration and Cloudbursting

We hung out with Enigmatec who work on automation and orchestration. They demoed cloudbursting capabilities (this is a term describing the ability to add cloud resources to a private datacenter during a traffic spike). Cloudbursting was handwave-demoed at VMware CEO Paul Maritz’s keynote, but it was a VMware center to a vCloud, proprietary and locked in. It was also unclear when such capabilities would be widely available. The Enigmatec guys are doing this today and are doing it in a cross-vendor capacity. So you can have your VMware datacenter adding resources from the Amazon EC2 cloud. This is very powerful. Our Elastic Server technology at CohesiveFT powered the servers in the demo. Our concept of build a recipe once and then output to multiple formats is the key to seamless cloudbursting. I really loved this quote by Duncan Johnston-Watt of Enigmatec: “Cloud cover is a great insurance policy.”

Virtual lab automation

I also met the Skytap team, a company doing some really interesting stuff with virtual lab automation, which was one of the topics incidentally covered in a session at the 451 ICE event (see http://twitter.com/elasticserver for coverage). Virtual test labs are an excellent way to increase testing agility while saving a ton of money. Since you may need a large amount of resources for load tests, but only for a brief amount of time, provisioning and tearing them down on demand during test cycles really works.

Virtual image cataloging and visualization

The vendor floor was also heavily populated by companies involved in virtual image cataloging and tracking, with some being VMware specific, while others worked cross platform. Nothing really caught my eye. When it comes to virtual datacenter visualization the key is a really great GUI and most of these companies understandably were made up of hardcore back end engineers who had no idea about UI design. It’s a shame.

One notable exception was bluebear, a small but talented team that built an Adobe AIR client called Kodiak that has a way to go, but looks promising from a GUI perspective. On the other hand, it seems they will need to find a way to integrate with existing management infrastructures to make any headway in customer adoption.

Microsoft guerilla marketing

Not to be outdone, Microsoft had a street team (in costume, no less) outside the Venetian handing out $1 chips and business-card sized anti-vmware propaganda. This really surprised me, because I would expect Microsoft to maybe try some large scale advertising, but this shows them getting more guerilla in their marketing, which a certain part of me really responds to. On the other hand, the wording on the card felt like a smear campaign rather than something touting the benefits of hyper-v. Check out a picture of the propaganda card. The title says “Looking or your best bet? You won’t find it with vmware”. The url given is http://vmwarecostswaytoomuch.com. Yikes.

What about application provisioning?

I did not see many companies working on the application provisioning side (something that we at CohesiveFT are enabling). Most of them assumed the virtual images would come from ‘somewhere’ and they would just manage them. I’m not sure if it’s because we’re in a transition phase from physical to virtual, and that most of current Enterprise usage is from virtualizing existing physical servers, but I see less and less by-hand provisioning in the future because it’s simply a huge pain and time cost for companies right now.

Lots of VI management companies seem to assume you have some static catalog of images. But if computing power continues to grow, and virtualization technology enables easy provisioning, we can expect the number of images to exponentially increase, and to be much more dynamic. During his keynote, Paul Maritz talked about the future being that of custom OS and application-stacks that are customer focused (meaning per-usecase). We’re already doing that today with our dynamic provisioning engine — letting a customer put together a stack just for their current purpose.

I see a lot more images being built, and having shorter lifecycles. Maybe there will be many throwaway images built just for testing and virtual labs. Maybe we will see much more enterprise experimentation because it will be so easy to build a stack and not have your operations guys supporting what’s inside. In fact during the 451 ICE conference, Jim Houghton (CTO, Adaptivity) mentioned that virtualization and rapid provisioning enabled bleeding edge technology experimentation at Wacovia. So I see application provisioning becoming much more consistent, reproducible, and trackable in the future and we’re working on the technology to enable you to go from your software to a provisioned server in the datacenter or cloud in just a couple minutes. I’m curious to see if we get more competitors in this space at the next VMworld event.

Till next year!

• Clouds are vast resource pools with on-demand resource allocation. The degree of on-demandness can vary from phone calls to web forms to actual APIs that directly requisition servers. I tend to consider slow forms of requisitioning to be more like traditional datacenters, and the quicker ones to be more cloudy. A public facing API is a must for true clouds.
• Clouds are virtualized. On demand requisitioning implies the ability to dynamically resize resource allocation or moving customers from one physical server to another transparently. This is all difficult or impossible without virtualization.
• Clouds tend to be priced like utilities (hourly, rather than per-resource), and I think we’ll see this model catching on more and more as computing resources become as cheap and ubiquitous as water, electricity, and gas (well, maybe not gas). However, I think this is a trend, not a requirement. You can certainly have clouds that are priced like pizza, per slice.

[shameless plug] check out Elastic Server On-Demand.

…you can attain true server agility because you are doing “Zero to Virtual”; building from component libraries straight to virtual servers in any VM format, with no initial physical footprint. The big win here is you are able to do “lean” provisioning. You use a small footprint OS (one you have configured, or Red Hat AOS, or Ubuntu JEOS, or one of the small footprint OS’s for use in virtualized servers) as the base of the server. This means smaller surface area of attack vulnerabilities, streamlined administration, no over-provisioning of then unused commercial licenses, and more virtual servers per physical hardware. A knock-on effect of these lean machines is greater mobility, more easily allowing leverage of utility or cloud infrastructures.

[Disclaimer: I work for CohesiveFT]

“We at CFT are proud to announce the latest refresh of our Elastic Server On-Demand service.

Elastic Servers(tm) are application stacks which can be dynamically constructed from component libraries and delivered in many virtualization-ready formats (VMware, Xen, Parallels). We call them “elastic” because it is just the amount of components you want for a task, no more no less. Fat stacks, skinny stacks, your call.”

via elastic server blog

This release brings a new UI, a Rails parts bin where you can build your own elastic Rails server, and EC2 support so you can launch it right in the cloud! It’s still in private beta, but contact me if you want to check it out!