Virtualization and Grid Computing

VWS RSS feed:

• http://workspace.globus.org/rss.xml

A lot of developments with the workspace service and science clouds recently!

The cluster technology lets you bootstrap generic images into new network and security contexts on the fly. We built a sample cluster on top of the technology that lets you create the cluster and be immediately ready to submit jobs to a Torque cluster fronted by GRAM and GridFTP that use a newly created self-signed certificate:

1. cloud-client.sh –run –hours 12 –cluster base-cluster.xml

2. Wait a few minutes, once launched note the head-node hostname

3. scp -r root@HOSTNAME:certs/*  lib/certs/

   (SSH was bootstrapped end to end already)

4. Make sure your grid tools trust this certificate and then submit work

This can be done with nearly anything that can run on a non-virtual cluster. Check out these links for more information:

• http://workspace.globus.org/clouds/clusters.html
• http://workspace.globus.org/vm/TP1.3.3/index.html

Congratulations everyone!

On behalf of the Globus Toolkit development team I am pleased to announce that a new stable release of the Globus Toolkit is now available. GT4.2.0 contains an upgrade to the web services specifications used by the toolkit as well as new features in all services. New users are encouraged to use the 4.2.0 release. Existing users may wish to evaluate the new software while maintaining their existing installations; due to the specification upgrade, the webservices are incompatible with the 4.0.x series. Details on the spec upgrade are available in the release notes.

Relevant 4.2.0 links:

• Release notes: http://www.globus.org/toolkit/docs/4.2/4.2.0/rn/release_notes.html
• Software: http://www.globus.org/toolkit/downloads/4.2.0/
• Documentation: http://www.globus.org/toolkit/docs/4.2/4.2.0/

Thanks for your support of Globus software!

Charles

New Features!

• Persistent HTTP/S connection support in Java WS Core
• Dynamic deployment support in Java WS Core
• JBOSS 4.0.x support in Java WS Core
• An implementation of WS-ServiceGroup added to C WS Core
• C command-line tools for WSRF operations
• Support for GetResourceProperties and QueryResourceProperties in the

Delegation Service

• Added support for the OGSA-AuthZ Authorization Service to CAS
• Server-side attribute-based authorization framework enhancements
• Support for a pluggable Policy Decision Point (PDP) designed to minimize

common authorization errors

• Enhanced security descriptor framework
• A Web service interface for the Replica Location Service (RLS)
• Improved support for multiple TriggerRules in the Trigger Service
• Improved configuration interface for the Trigger Service
• Java API to assist in creating resource properties from external

information sources

• A new resource manager (RM) adapter API in GRAM4

Cloud Computing and Its Applications

Also see Ian Foster’s blog entry

From http://www.gridtoday.com/grid/2370981.html

rPath Enables Cloud Computing for DoE, CERN

RALEIGH, N.C., June 4 — rPath, whose unique technology simplifies application distribution and management through virtual appliances, today announced that the U.S. Department of Energy (DOE) and the European Organization for Nuclear Research (CERN) have been using rBuilder to deliver virtual appliances to both scientists’ desktops and computational clouds. The use of rBuilder in these environments reduces the effort required to support users and allows researchers to take advantage of underutilized computational resources.

rBuilder is the first and only product that simplifies and automates the creation of virtual appliances. A virtual appliance is an application with a streamlined operating system, offered in a format that runs in virtualized environments.

CERN turned to virtual appliances to facilitate the analysis of data created by the Large Hadron Collider (LHC) experiments. The complete software environment needed by the LHC applications is assembled by rBuilder and distributed to run as a virtual machine on physicists’ desktops. Virtual appliances provide a consistent application environment for the LHC applications while, at the same time, allowing scientists to use their desktops for analysis, regardless of operating system.

“The coupling between the LHC applications and the operating system is very strong,” stated Predrag Buncic, virtualization R&D project leader. “By distributing these applications as virtual appliances, we are able to isolate the application from the underlying desktop or laptop operating system, allowing the researchers to run the applications on systems that normally would not be supported.”

The DOE is exploring the concept of using virtual appliances to provide customized environments for scientific applications. Scientific applications are turned into virtual appliances using rPath’s rBuilder. The “Science Clouds” project (http://workspace.globus.org/clouds) provides resources capable of hosting multiple scientific appliances using the Globus Virtual Workspaces software. Scientists submit their virtual appliances to any available resource, knowing that the application environment is controlled and isolated from the underlying system. By relying on portable appliances, the scientists can leverage the resources of science clouds, and seamlessly move to commercial providers, such as Amazon’s EC2, when additional resources are needed.

“For a proof-of-concept, anybody can just configure a virtual machine image by hand,” said Kate Keahey, a scientist at Argonne National Laboratory. “But providing appliance management and maintenance that will scale to many thousands of appliances and that will be truly interoperable between different resource providers requires a new approach.”

About rPath

For application providers that want to accelerate license growth, expand into new markets, and reduce support and development costs, rPath’s platform transforms applications into virtual appliances. A virtual appliance is an application combined with just enough operating system (JeOS) for it to run optimally in any virtualized environment. Virtual appliances eliminate the hassles of installing, configuring and maintaining complex application environments. Only rPath’s technology simplifies application distribution, lowers the customer service costs of maintenance and management, and produces multiple virtual machine formats. The company is headquartered in Raleigh, N.C. For more information, visit www.rpath.com.

—–

Source: rPath

I am happy to announce the TP 1.3.2 release — the “cloudkit release” of the Workspace Service. You can download the new release from: http://workspace.globus.org/downloads/index.html

As many of you have probably noticed we have recently been sending announcements about the availability of compute clouds for scientific communities: http://workspace.globus.org/clouds/

In a nutshell, TP 1.3.2 allows you to build your own cloud. The main addition is a new “cloud client” for the workspace service which simplifies (and also hides) much of the workspace functionality to provide an EC2-like set of features. The new client also provides a limited form of “contextualization” (more coming in the next release!). We also provide a step-by-step “cloud guide” that allows you to configure your own cloud.

For a complete set of new features (many more but less significant) look to:
http://workspace.globus.org/vm/TP1.3.2/index.html#changelog

We look forward to hearing from you — and if you do decide to configure a cloud and would like help finding users, please do let us know.

Have fun!

The Workspace Team
–

Kate Keahey,
Mathematics & CS Division, Argonne National Laboratory
Computation Institute, University of Chicago

From workspace-announce:

I am happy to announce the availability of a science cloud (codenamed “Stratus” ;-) at the University of Florida. This cloud introduces a new feature: the use of virtual networks with virtual machines for cloud computing.

The cloud is available for members of the scientific community: to obtain access you will need to provide a justification (a few sentences explaining your science project) to cloud administrators at UFL. To find out more go to:

http://workspace.globus.org/clouds/

The cloud is currently deployed on a modest allocation of resources as a beta project. We welcome comments, feedback, and bug reports.

If you’re feeling adventurous, there’s a workspace service pre-release out (click on the pic):