Spring 2016 - Independent Study - Apache Storm,Apache Kafka,RabbitMQ performance bottle-necks in strongly scalable environment.

Project Details

Project Lead
Shameera Rathnayaka Yodage 
Project Manager
Shameera Rathnayaka Yodage 
Institution
Indiana University, Computer Science Department  
Discipline
Computer Science (401) 
Subdiscipline
11.07 Computer Science 

Abstract

Apache Storm is an open source framework to handle realtime streaming data processing.We use varies tools like Apache Kafka, RabbitMQ with Apache Storm to solve real world use cases. This project will do sort of performance tests which lead to identify which sub-tools are good with Apache Storm and where are the bottle necks happens. Also check performance issues with strong scalability environment. Further this project will try to compare Apache Storm with Apache Spark streaming to identify which frame work is best for which use cases.

Intellectual Merit

Apache Storm is an open source framework to handle realtime streaming data processing.We use varies tools like Apache Kafka, RabbitMQ with Apache Storm to solve real world use cases. This project will do sort of performance tests which lead to identify which sub-tools are good with Apache Storm and where are the bottle necks happens. Also check performance issues with strong scalability environment. Further this project will try to compare Apache Storm with Apache Spark streaming to identify which frame work is best for which use cases.

Broader Impacts

Apache Storm is an open source framework to handle realtime streaming data processing.We use varies tools like Apache Kafka, RabbitMQ with Apache Storm to solve real world use cases. This project will do sort of performance tests which lead to identify which sub-tools are good with Apache Storm and where are the bottle necks happens. Also check performance issues with strong scalability environment. Further this project will try to compare Apache Storm with Apache Spark streaming to identify which frame work is best for which use cases.

Scale of Use

set of VMs for run performance tests time to time.