NDLI: Astro-WISE: Tracing and Using Lineage for Scientific Data Processing

Content Provider	IEEE Xplore Digital Library
Author	Mwebaze, J. Boxhoorn, D. Valentijn, E.
Copyright Year	2009
Abstract	Most workflow systems that support data provenance primarily focus on tracing lineage of data. Data provenance by data lineage provides the derivation history of data including information about services and input data that contributed to the creation of a data product. We show that tracing lineage by means of full backward chaining not only enables users to share, discover and reuse the data, but also supports scientific data processing through storage, retrieval and (re)processing of digitized scientific data. In this paper, we present Astro-WISE, a distributed system for processing, analyzing and disseminating wide field imaging astronomical data. We show how Astro-WISE traces lineage of data and how it facilitates data processing, retrieval, storage, archiving. Particularly we show how it solves issues related to the changing data items typical for the scientific environment, such as physical changes in calibrations, our insight in these changes and improved methods for deriving results.
Starting Page	475
Ending Page	480
File Size	374143
Page Count	6
File Format	PDF
ISBN	9781424447466
DOI	10.1109/NBiS.2009.48
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2009-08-19
Publisher Place	USA
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Data analysis Provenance Target processing Relational databases Data lineage Data processing Information retrieval Calibration History Information systems Persistence Image analysis Collaboration Telephony Dependencies
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Tracing and using data lineage for pipeline processing in Astro-WISE

Tracing and using data lineage for pipeline processing in Astro-WISE

Tracing and using data lineage for pipeline processing in Astro-WISE

A data lineage model for distributed sub-image processing

PLUS: A provenance manager for integrated information

Indexing Byzantine Cypriot coinage, using image analysis

A storage, processing, and retrieval system for microtubule tracking data

Dynamic Pipeline Changes in Scientific Data Processing

Sub-image data processing in Astro-WISE

Astro-WISE: Tracing and Using Lineage for Scientific Data Processing

Similar Documents

Tracing and using data lineage for pipeline processing in Astro-WISE

Tracing and using data lineage for pipeline processing in Astro-WISE

Tracing and using data lineage for pipeline processing in Astro-WISE

A data lineage model for distributed sub-image processing

PLUS: A provenance manager for integrated information

Indexing Byzantine Cypriot coinage, using image analysis

A storage, processing, and retrieval system for microtubule tracking data

Dynamic Pipeline Changes in Scientific Data Processing

Sub-image data processing in Astro-WISE

Astro-WISE: Tracing and Using Lineage for Scientific Data Processing