Publish/Subscribe Messaging as a Basis for TeraGrid Information Services

Project ID
FG-30
Project Categories
Technology Evaluation
NSF Grant Number
503697
Completed
Abstract
"This project will use FutureGrid to evaluate the possibility of using a messaging service as the basis for TeraGrid information services. The goal is to determine whether a publish/subscribe messaging approach is more effective than the approach currently used in TeraGrid to gather information from distributed TeraGrid resources and provide this information to TeraGrid users and services.The project will initially implement a proof of concept where the messaging service is installed in a virtual machine on FutureGrid and information from TeraGrid resources is published to that messaging service. The project will subsequently evaluate the latency, throughput, and scalability of different messaging service implementations and configurations. Messaging services that support the AMQP protocol will be evaluated. "
Use of FutureSystems
"This project will use FutureGrid to evaluate the possibility of using a messaging service as the basis for TeraGrid information services. The goal is to determine whether a publish/subscribe messaging approach is more effective than the approach currently used in TeraGrid to gather information from distributed TeraGrid resources and provide this information to TeraGrid users and services.The project will initially implement a proof of concept where the messaging service is installed in a virtual machine on FutureGrid and information from TeraGrid resources is published to that messaging service. The project will subsequently evaluate the latency, throughput, and scalability of different messaging service implementations and configurations. Messaging services that support the AMQP protocol will be evaluated. "
Scale of Use
"The initial phase of this project will only require a single VM to run the messaging service. This VM will be instantiated for 4-6 hours at a time while I perform experiments that have TeraGrid resources publishing information to it. I expect this phase to last for approximately 2 months and to instantiate this VM roughly 2 days a week.During performance evaluation, I expect to use 9-17 VMs for an hour or two at a time. One virtual machine will be running the messaging service and 8-16 virtual machines will be emulating TeraGrid resources publishing information and TeraGrid users/tools consuming information. I expect this phase to last for approximately 2 months and to instantiate VMs for 2-3 hours at a time 2 or 3 days a week."