Constructing Secure MapReduce Framework in Cloud-based Environment

Authors

Yongzhi Wang, School of Computing and Information SciencesFollow

Document Type

Dissertation

Degree

Doctor of Philosophy (PhD)

Major/Program

Computer Science

First Advisor's Name

Jinpeng Wei

First Advisor's Committee Title

Committee chair

Second Advisor's Name

Xudong He

Second Advisor's Committee Title

Committee member

Third Advisor's Name

Geoffrey Smith

Third Advisor's Committee Title

Committee member

Fourth Advisor's Name

Bogdan Carbunar

Fourth Advisor's Committee Title

Committee member

Fifth Advisor's Name

Gang Quan

Fifth Advisor's Committee Title

Committee member

Keywords

Security, MapReduce, Cloud Computing, Integrity, Confidentiality

Date of Defense

3-27-2015

Abstract

MapReduce, a parallel computing paradigm, has been gaining popularity in recent years as cloud vendors offer MapReduce computation services on their public clouds. However, companies are still reluctant to move their computations to the public cloud due to the following reason: In the current business model, the entire MapReduce cluster is deployed on the public cloud. If the public cloud is not properly protected, the integrity and the confidentiality of MapReduce applications can be compromised by attacks inside or outside of the public cloud. From the result integrity’s perspective, if any computation nodes on the public cloud are compromised,thosenodes can return incorrect task results and therefore render the final job result inaccurate. From the algorithmic confidentiality’s perspective, when more and more companies devise innovative algorithms and deploy them to the public cloud, malicious attackers can reverse engineer those programs to detect the algorithmic details and, therefore, compromise the intellectual property of those companies.

In this dissertation, we propose to use the hybrid cloud architecture to defeat the above two threats. Based on the hybrid cloud architecture, we propose separate solutions to address the result integrity and the algorithmic confidentiality problems. To address the result integrity problem, we propose the Integrity Assurance MapReduce (IAMR) framework. IAMR performs the result checking technique to guarantee high result accuracy of MapReduce jobs, even if the computation is executed on an untrusted public cloud. We implemented a prototype system for a real hybrid cloud environment and performed a series of experiments. Our theoretical simulations and experimental results show that IAMR can guarantee a very low job error rate, while maintaining a moderate performance overhead. To address the algorithmic confidentiality problem, we focus on the program control flow and propose the Confidentiality Assurance MapReduce (CAMR) framework. CAMR performs the Runtime Control Flow Obfuscation (RCFO) technique to protect the predicates of MapReduce jobs. We implemented a prototype system for a real hybrid cloud environment. The security analysis and experimental results show that CAMR defeats static analysis-based reverse engineering attacks, raises the bar for the dynamic analysis-based reverse engineering attacks, and incurs a modest performance overhead.

Identifier

FIDC000061

Recommended Citation

Wang, Yongzhi, "Constructing Secure MapReduce Framework in Cloud-based Environment" (2015). FIU Electronic Theses and Dissertations. 2238.
https://digitalcommons.fiu.edu/etd/2238