NDLI: Real-time collaborative analysis with (almost) pure SQL: a case study in biogeochemical oceanography

Please wait, while we are loading the content...

Making sense of big data with the Berkeley data analytics stack

Education and career paths for data scientists

On the combination of relative clustering validity criteria

Providing multi-scale consistency for multi-scale geospatial data

Fast computation of approximate biased histograms on sliding windows over data streams

Search and result presentation in scientific workflow repositories

GPS: a graph processing system

Accelerating gene context analysis using bitmaps

Learning to explore scientific workflow repositories

A fast handshake join implementation on FPGA with adaptive merging network

Computational challenges in next-generation genomics

Parameter-free and domain-independent similarity search with diversity

Reasoning about RFID-tracked moving objects in symbolic indoor spaces

Multi-scale dissemination of time series data

Tuning large scale deduplication with reduced effort

RMiCS: a robust approach for mining coherent subgraphs in edge-labeled multi-layer graphs

The open connectome project data cluster: scalable analysis and vision for high-throughput neuroscience

Best of both worlds: relational databases and statistics

Adaptive exploration for large-scale protein analysis in the molecular dynamics database

A multidimensional data model with subcategories for flexibly capturing summarizability

Towards a universal tracking database

Multi-query scheduling for time-critical data stream applications

HmSearch: an efficient hamming distance query processing algorithm

SMIX: self-managing indexes for dynamic workloads

Real-time collaborative analysis with (almost) pure SQL: a case study in biogeochemical oceanography

Data management systems on GPUs: promises and challenges

Parallel online aggregation in action

Nearest group queries

GIPSY: joining spatial datasets with contrasting density

Learning uncertainty models from weather forecast performance databases using quantile regression

pcApriori: scalable apriori for multiprocessor systems

Inverted indices for particle tracking in petascale cosmological simulations

Optimizing fastquery performance on lustre file system

Nesting the earth mover's distance for effective cluster tracing

Astronomical data processing in EXTASCID

Publishing trajectories with differential privacy guarantees

Shortlisting top-K assignments

Graywulf: a platform for federated scientific databases and services

Semantic query reformulation: the NIF experience

Data vaults: a database welcome to scientific file repositories

Autonomous clustering for wireless sensor networks

Forecasting in hierarchical environments

Towards efficient discovery of coverage patterns in transactional databases

Bulk sorted access for efficient top-k retrieval

DoS: an efficient scheme for the diversification of multiple search results

Research lattices: towards a scientific hypothesis data model

Sharing confidential data for algorithm development by multiple imputation

Mining multidimensional contextual outliers from categorical relational data

Real-time collaborative analysis with (almost) pure SQL: a case study in biogeochemical oceanography

Content Provider	ACM Digital Library
Author	Ribalet, Francois Halperin, Daniel Weitz, Konstantin Saito, Mak A. Armbrust, E. Virginia Howe, Bill
Abstract	We consider a case study using SQL-as-a-Service to support "instant analysis" of weakly structured relational data at a multi-investigator science retreat. Here, "weakly structured" means tabular, rows-and-columns datasets that share some common context, but that have limited a priori agreement on file formats, relationships, types, schemas, metadata, or semantics. In this case study, the data were acquired from hundreds of distinct locations during a multi-day oceanographic cruise using a variety of physical, biological, and chemical sensors and assays. Months after the cruise when preliminary data processing was complete, 40+ researchers from a variety of disciplines participated in a two-day "data synthesis workshop." At this workshop, two computer scientists used a web-based query-as-a-service platform called SQLShare to perform "SQL stenography": capturing the scientific discussion in real time to integrate data, test hypotheses, and populate visualizations to then inform and enhance further discussion. In this "field test" of our technology and approach, we found that it was not only feasible to support interactive science Q&A with essentially pure SQL, but that we significantly increased the value of the "face time" at the meeting: researchers from different fields were able to validate assumptions and resolve ambiguity about each others' fields. As a result, new science emerged from a meeting that was originally just a planning meeting. In this paper, we describe the details of this experiment, discuss our major findings, and lay out a new research agenda for collaborative science database services.
Starting Page	1
Ending Page	12
Page Count	12
File Format	PDF
ISBN	9781450319218
DOI	10.1145/2484838.2484880
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2013-07-29
Publisher Place	New York
Access Restriction	Subscribed
Content Type	Text
Resource Type	Article

Central Library (ISO-9001:2015 Certified)
Indian Institute of Technology Kharagpur
Kharagpur, West Bengal, India | PIN - 721302

See location in the Map
03222 282435
Mail: support@ndl.gov.in

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in