NDLI: FlexQuery: An online query system for interactive remote visual data exploration at large scale

Content Provider	IEEE Xplore Digital Library
Author	Hongbo Zou Schwan, K. Slawinska, M. Wolf, M. Eisenhauer, G. Fang Zheng Dayal, J. Logan, J. Qing Liu Klasky, S. Bode, T. Clark, M. Kinsey, M.
Copyright Year	2013
Description	Author affiliation: Coll. of Comput., Georgia Inst. of Technol., Atlanta, GA, USA (Hongbo Zou; Schwan, K.; Slawinska, M.; Wolf, M.; Eisenhauer, G.; Fang Zheng; Dayal, J.) \|\| Center for Relativistic Astrophys., Georgia Inst. of Technol., Atlanta, GA, USA (Bode, T.; Clark, M.; Kinsey, M.) \|\| Sci. Data Group, Oak Ridge Nat. Lab., Oak Ridge, TN, USA (Logan, J.; Qing Liu; Klasky, S.)
Abstract	The remote visual exploration of live data generated by scientific simulations is useful for scientific discovery, performance monitoring, and online validation for the simulation results. Online visualization methods are challenged, however, by the continued growth in the volume of simulation output data that has to be transferred from its source - the simulation running on the high end machine - to where it is analyzed, visualized, and displayed. A specific challenge in this context is limits in the communication bandwidth between data source(s) and sinks. Previous work places queries `near' data sources, exploiting their data reduction capabilities, but such work does not address the common scenario in which scientists make multiple different queries on the data being produced. This paper considers the general case in which science users are interested in different (sub)sets of the data produced by a high end simulation. We offer the FlexQuery online data query system that can deploy and execute data queries `along' the I/O and analytics pipelines. FlexQuery carefully extends such analytics pipelines, using online performance monitoring and data location tracking, to realize data queries in ways that minimize additional data movement and offer low latency in data query execution. Using a real-world scientific application - the Maya astrophysics code and its analytics workflow - we demonstrate FlexQuery's ability to dynamically deploy queries for low-latency remote data visualization.
Sponsorship	IEEE Comput. Soc.
Starting Page	1
Ending Page	8
File Size	873993
Page Count	8
File Format	PDF
ISBN	9781479908981
DOI	10.1109/CLUSTER.2013.6702635
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2013-09-23
Publisher Place	USA
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Data visualization Data models Pipelines Engines Monitoring Contracts Bandwidth data reduction remote visualization online query
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

FlexQuery: An Online Query System for Interactive Remote Visual Data Exploration at Large Scale

End-to-End eScience: Integrating Workflow, Query, Visualization, and Provenance at an Ocean Observatory

Interactive Visual Retrieval System for Large Scale 3D Models Database

Comparison of Remote Visualization Strategies for Interactive Exploration of Large Data Sets (2001)

Integrated Parallelization of Computations and Visualization for Large-scale Applications

Interactive exploration of large remote micro-CT scans

Interactive large data exploration over the wide area

Interactive remote large-scale data visualization via prioritized multi-resolution streaming

Interactive Exploration of Large Remote Micro-CT Scans

FlexQuery: An online query system for interactive remote visual data exploration at large scale

Similar Documents

FlexQuery: An Online Query System for Interactive Remote Visual Data Exploration at Large Scale

End-to-End eScience: Integrating Workflow, Query, Visualization, and Provenance at an Ocean Observatory

Interactive Visual Retrieval System for Large Scale 3D Models Database

Comparison of Remote Visualization Strategies for Interactive Exploration of Large Data Sets (2001)

Integrated Parallelization of Computations and Visualization for Large-scale Applications

Interactive exploration of large remote micro-CT scans

Interactive large data exploration over the wide area

Interactive remote large-scale data visualization via prioritized multi-resolution streaming

Interactive Exploration of Large Remote Micro-CT Scans

FlexQuery: An online query system for interactive remote visual data exploration at large scale