Loading...
Please wait, while we are loading the content...
Similar Documents
jade: An End-To-End Data Transfer and Catalog Tool
| Content Provider | Scilit |
|---|---|
| Author | Meade, P. |
| Copyright Year | 2017 |
| Description | Journal: Journal of Physics: Conference Series The IceCube Neutrino Observatory is a cubic kilometer neutrino telescope located at the Geographic South Pole. IceCube collects 1 TB of data every day. An online filtering farm processes this data in real time and selects 10% to be sent via satellite to the main data center at the University of Wisconsin-Madison. IceCube has two year-round on-site operators. New operators are hired every year, due to the hard conditions of wintering at the South Pole. These operators are tasked with the daily operations of running a complex detector in serious isolation conditions. One of the systems they operate is the data archiving and transfer system. Due to these challenging operational conditions, the data archive and transfer system must above all be simple and robust. It must also share the limited resource of satellite bandwidth, and collect and preserve useful metadata. The original data archive and transfer software for IceCube was written in 2005. After running in production for several years, the decision was taken to fully rewrite it, in order to address a number of structural drawbacks. The new data archive and transfer software (JADE2) has been in production for several months providing improved performance and resiliency. One of the main goals for JADE2 is to provide a unified system that handles the IceCube data end-to-end: from collection at the South Pole, all the way to long-term archive and preservation in dedicated repositories at the North. In this contribution, we describe our experiences and lessons learned from developing and operating the data archive and transfer software for a particle physics experiment in extreme operational conditions like IceCube. |
| Related Links | http://iopscience.iop.org/article/10.1088/1742-6596/898/6/062050/pdf |
| ISSN | 17426588 |
| e-ISSN | 17426596 |
| DOI | 10.1088/1742-6596/898/6/062050 |
| Journal | Journal of Physics: Conference Series |
| Issue Number | 6 |
| Volume Number | 898 |
| Language | English |
| Publisher | IOP Publishing |
| Publisher Date | 2017-10-01 |
| Access Restriction | Open |
| Subject Keyword | Journal: Journal of Physics: Conference Series Nuclear Energy and Engineering South Pole End To End End Data Operational Conditions |
| Content Type | Text |
| Resource Type | Article |
| Subject | Physics and Astronomy |
