Distributed Log File Analysis

The Pegasus Computing Cluster at University of Miami's Center for Computational Science is a valuable resource for performing computationally intensive tasks. University of Miami's High Performance Computing (HPC) staff and administration would like to utilize statistical summaries of Pegasus log files in order to identify usage trends that will be used to make system optimizations. Parallel data processing and statistical computing are necessary due to the distributed nature of the raw log files.