Comparing Remote Data Transfer Rates of Compact Muon Solenoid Jobs with Xrootd and Lustre

Authors

Gary H. Kaganas, Florida International UniversityFollow

Document Type

Thesis

Degree

Master of Arts (MA)

Major/Program

Physics

First Advisor's Name

Dr. Jorge L. Rodriguez

First Advisor's Committee Title

Assistant Professor

Second Advisor's Name

Dr. Dimitri Bourlikov

Second Advisor's Committee Title

CMS Researcher

Third Advisor's Name

Dr. Mengxing Chen

Third Advisor's Committee Title

CMS Researcher

Fourth Advisor's Name

Dr. Pete Markowitz

Fourth Advisor's Committee Title

Professor

Fifth Advisor's Name

Dr. Prem Chapagain

Fifth Advisor's Committee Title

Assistant Professor

Keywords

Lustre, xrootd, cms, high energy physics, distributed file systems, kerberos

Date of Defense

4-2014

Abstract

To explore the feasibility of processing Compact Muon Solenoid (CMS) analysis jobs across the wide area network, the FIU CMS Tier-3 center and the Florida CMS Tier-2 center designed a remote data access strategy. A Kerberized Lustre test bed was installed at the Tier-2 with the design to provide storage resources to private-facing worker nodes at the Tier-3. However, the Kerberos security layer is not capable of authenticating resources behind a private network. As a remedy, an xrootd server on a public-facing node at the Tier-3 was installed to export the file system to the private-facing worker nodes. We report the performance of CMS analysis jobs processed by the Tier-3 worker nodes accessing data from a Kerberized Lustre file. The processing performance of this configuration is benchmarked against a direct connection to the Lustre file system, and separately, where the xrootd server is near the Lustre file system.

Identifier

FI14071162

Recommended Citation

Kaganas, Gary H., "Comparing Remote Data Transfer Rates of Compact Muon Solenoid Jobs with Xrootd and Lustre" (2014). FIU Electronic Theses and Dissertations. 1534.
https://digitalcommons.fiu.edu/etd/1534