Virtualization and Grid Computing

VWS RSS feed:

• http://workspace.globus.org/rss.xml

A lot of developments with the workspace service and science clouds recently!

The cluster technology lets you bootstrap generic images into new network and security contexts on the fly. We built a sample cluster on top of the technology that lets you create the cluster and be immediately ready to submit jobs to a Torque cluster fronted by GRAM and GridFTP that use a newly created self-signed certificate:

1. cloud-client.sh –run –hours 12 –cluster base-cluster.xml

2. Wait a few minutes, once launched note the head-node hostname

3. scp -r root@HOSTNAME:certs/*  lib/certs/

   (SSH was bootstrapped end to end already)

4. Make sure your grid tools trust this certificate and then submit work

This can be done with nearly anything that can run on a non-virtual cluster. Check out these links for more information:

• http://workspace.globus.org/clouds/clusters.html
• http://workspace.globus.org/vm/TP1.3.3/index.html

EUCALYPTUS - Elastic Utility Computing Architecture for Linking Your Programs To Useful Systems - is an open-source software infrastructure for implementing “cloud computing” on clusters. The current interface to EUCALYPTUS is compatible with Amazon’s EC2 interface, but the infrastructure is designed to support multiple client-side interfaces.

May 14th, 2008: EUCALYPTUS is publically demonstrated at the Open Source Grid and Cluster conference.

May 29th, 2008: Version 1.0 is released as a feature-limited binary-only beta.

http://eucalyptus.cs.ucsb.edu/

I am happy to announce the TP 1.3.2 release — the “cloudkit release” of the Workspace Service. You can download the new release from: http://workspace.globus.org/downloads/index.html

As many of you have probably noticed we have recently been sending announcements about the availability of compute clouds for scientific communities: http://workspace.globus.org/clouds/

In a nutshell, TP 1.3.2 allows you to build your own cloud. The main addition is a new “cloud client” for the workspace service which simplifies (and also hides) much of the workspace functionality to provide an EC2-like set of features. The new client also provides a limited form of “contextualization” (more coming in the next release!). We also provide a step-by-step “cloud guide” that allows you to configure your own cloud.

For a complete set of new features (many more but less significant) look to:
http://workspace.globus.org/vm/TP1.3.2/index.html#changelog

We look forward to hearing from you — and if you do decide to configure a cloud and would like help finding users, please do let us know.

Have fun!

The Workspace Team
–

Kate Keahey,
Mathematics & CS Division, Argonne National Laboratory
Computation Institute, University of Chicago

If you’re feeling adventurous, there’s a workspace service pre-release out (click on the pic):

From http://blog.xen.org/index.php/2008/04/28/xen-api-community-project/:

Several community members have contacted me recently about the Xen-API utilities. I looked into this and discovered a great opportunity for community members looking for a project to contribute to. So, I am announcing a new community effort to complete the development of the Xen-API utilities. If you are interested in working on the Xen-API project please email me at stephen.spector@xen.org and I will call a meeting in mid-May with all people interested to get the project underway.

I’m pleased to announce the availability of Xen versions 3.1.4 and 3.2.1 — bugfix releases in the Xen 3.1 and 3.2 series.

The source repositories are available using mercurial from:

• http://xenbits.xensource.com/xen-3.1-testing.hg (tag ‘RELEASE-3.1.4′)
• http://xenbits.xensource.com/xen-3.2-testing.hg (tag ‘RELEASE-3.2.1′)

Tarballs are available for download (and will soon be linked from the xen.org web pages):

• http://bits.xensource.com/oss-xen/release/3.1.4/xen-3.1.4.tar.gz
• http://bits.xensource.com/oss-xen/release/3.2.1/xen-3.2.1.tar.gz

Thanks to everyone who has contributed!

Regards,
Keir

Virtual Workspaces Tutorial at Open Source Grid Cluster (May 12-16, 2008)

There will be a Virtual Workspaces tutorial at the Open Source Grid Cluster conference in Oakland, CA. The conference is May 12-16, 2008. The Virtualization and Cloud Computing with Globus session is on Wednesday, May 14th, from 4:30-6:00 pm. We hope to see you there!

Quoting from the summary:

One of the primary obstacles users face in grid computing is that Grids provide access to many diverse resources, their applications often require a very specific, customized environment. This disconnect can lead to resource underutilization, user frustration, and much wasted effort spent on bridging the gap between applications and resources. Virtual Workspaces describe the environment required for the execution of an application that can be dynamically deployed across a variety of resources creating a working and consistent platform for grid applications.

This tutorial will introduce the Globus Toolkit workspace service that implements workspaces as Xen virtual machines and enables authorized grid clients to dynamically deploy them and manage their resources. Further, we will describe and demonstrate the workspace “cloudkit” that provides a user-friendly interface on top of the workspace service allowing authorized users to easily provision and run VMs on the available community clouds. Finally, we will describe how the process of contextualization can be used to provide on-demand functioning clusters and give examples of its use by applications.