NDLI: Report on distributed computing and data handling at Belle II experiment

Content Provider	IEEE Xplore Digital Library
Author	Jung Hyun Kim
Copyright Year	2013
Abstract	We introduce the distributed computing and data handling systems at Belle II, a next-generation B factory experiment at KEK. The systems have to handle an amount of data eventually corresponding to 50 times the level of its predecessor experiment, Belle, by the end of 2022. The data size is comparable to the ones of LHC experiments. For the Belle II experiment we employed the distributed computing system based on DIRAC. DIRAC provides many features that we would have to develop and an interface with grid and cloud resources. Furthermore, we need a reliable and efficient metadata service that translates selection queries into a set of files. We design our metadata service based on AMGA. First, this year, the Belle II computing group realized a test bed based on DIRAC and entered a new phase of testing the feasibility of our system. Second, in order to identify the right files that should be used as input for a project, we set up an AMGA metadata server which allows getting a list of files, in the form of GUIDs. The metadata is extracted from the data files written to storage resources and used to fill the AMGA metadata catalog. Using the catalog a user query is translated into a file list and a list of sites retaining available data. This information is used to submit jobs that process the requested data. In conclusion, we have designed and constructed a Belle II distributed computing system and data handling system. It is essential for us to do practical tests for the operation of DIRAC, scalability of metadata service, scheme of job submission, and other involved components. The status of the Belle II computing system and Monte Carlo production campaign are presented.
Starting Page	1
Ending Page	4
File Size	1667154
Page Count	4
File Format	PDF
e-ISBN	9781479905348
DOI	10.1109/NSSMIC.2013.6829577
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2013-10-27
Publisher Place	South Korea
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Production Physics Data handling Servers Software Collaboration metadata HEP Belle II KEK B factory distributed computing data handling DIRAC AMGA CVMFS grid large scale data
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Design of the Advanced Metadata Service System with AMGA

Evaluation of AMGA as a Data-Handling tool for a new HEP experiment

Grid computing at the DØ experiment

The Embedment of a Metadata System at Grid Farms at the Belle II

Super KEKB and Belle II: Status of the KEK Super B Factory

The k /μ detector subsystem for the belle experiment at the kek b-factory (1999).

Design of the Advanced Metadata Service System with AMGA for the Belle II Experiment

Distributed Metadata with the AMGA Metadata Catalog (2006)

Towards belle monte carlo production on the apac national grid infrastructure (2005)

Report on distributed computing and data handling at Belle II experiment

Similar Documents

Design of the Advanced Metadata Service System with AMGA

Evaluation of AMGA as a Data-Handling tool for a new HEP experiment

Grid computing at the DØ experiment

The Embedment of a Metadata System at Grid Farms at the Belle II

Super KEKB and Belle II: Status of the KEK Super B Factory

The k /μ detector subsystem for the belle experiment at the kek b-factory (1999).

Design of the Advanced Metadata Service System with AMGA for the Belle II Experiment

Distributed Metadata with the AMGA Metadata Catalog (2006)

Towards belle monte carlo production on the apac national grid infrastructure (2005)

Report on distributed computing and data handling at Belle II experiment