NDLI: Jigsaw: multi-modal big data management in digital film production

Please wait, while we are loading the content...

Continuous circular scribble arts

Crowd-powered parameter analysis for computational design exploration

Encore: 3D printed augmentation of everyday objects with printed-over, affixed and interlocked attachments

Extraction of a smooth surface from voxels preserving sharp creases

Form-finding with polyhedral meshes made simple

FrameShift: shift your attention, shift the story

Hue extraction and tone match: generating a theme color to enhance the emotional quality of an image

Interactive tree illustration generation system

PaperPulse: an integrated approach for embedding electronics in paper designs

Patchy: an interactive patchwork design system

Sketch dance stage

The battle for hearts and minds: interrogation and torture in the age of war

$V^{3}:$ an interactive real-time visualization of vocal vibrations

Wobble strings: spatially divided stroboscopic effect for augmenting wobbly motion of stringed instruments

Z-drawing: a flying agent system for computer-assisted drawing

AffectiveWear: toward recognizing facial expression

Augmented reality for cryoablation procedures

CHILDHOOD: wearable suit for augmented child experience

Creating near-field VR using stop motion characters and a touch of light-field rendering

First-person view animation editing utilizing video see-through augmented reality

FlexAR: anatomy education through kinetic tangible augmented reality

Fracture in augmented reality

Hands-free gesture operation for maintenance work using finger-mounted acceleration sensor

Improving depth perception during surgical augmented reality

Mobile collaborative augmented reality with real-time AR/VR switching

Mouth gesture based emotion awareness and interaction in virtual reality

MR coral sea evolved: mixed reality aquarium with physical MR displays

RiSE: reflectance transformation imaging in spatial augmented reality for exhibition of cultural heritage

Shadow shooter: 360-degree all-around virtual 3d interactive content

Spherical light field environment capture for virtual reality using a motorized pan/tilt head and offset camera

Touch the virtual reality: using the leap motion controller for hand tracking and wearable tactile devices for immersive haptic rendering

WAOH: virtual automotive HMI evaluation tool

Decomposition of 32 bpp into 16 bpp textures with alpha

Dynamic fur on mobile using textured offset surfaces

G-spacing: a gyro sensor based relative 3D space positioning scheme

Half frame forwarding: frame-rate up conversion for tiled rendering GPU

Mobile haptic system design to evoke relaxation through paced breathing

Performance and precision: mobile solutions for high quality engineering drawings

The XML3D architecture

Twech: a mobile platform to search and share visuo-tactile experiences

A music video authoring system synchronizing climax of video clips and music via rearrangement of musical bars

Art directed rendering & shading using control images

Automatic synthesis of eye and head animation according to duration and point of gaze

BGMaker: example-based anime background image creation from a photograph

Chinese ink and brush painting with reflections

Fully automatic ID mattes with support for motion blur and transparency

Increasing realism of animated grass in real-time game environments

Interactive rigging

Jigsaw: multi-modal big data management in digital film production

Procedural floor plan generation from building sketches

Retargeting 3D objects and scenes

Rust aging simulation considering object's geometries

Synthesizing close combat using sequential Monte Carlo

UnAMT: unsupervised adaptive matting tool for large-scale object collections

3D face reconstruction from a single non-frontal face image

A prediction model on 3D model compression and its printed quality based on subjective study

atmoRefractor: spatial display by controlling heat haze

Augmented dynamic shape for live high quality rendering

Bubble rupture simulation by considering high density ratio

Burning the medial axis

Color perception difference: white and gold, or black and blue?

Component segmentation of sketches used in 3D model retrieval

Continuous and automatic registration of live RGBD video streams with partial overlapping views

Contour guided surface deformation for volumetric segmentation

Critical points with discrete Morse theory

Display of diamond dispersion using wavelength-division rendering and integral photography

Dynamic realistic lip animation using a limited number of control points

Enhancing time and space efficiency of kd-tree for ray-tracing static scenes

ExPixel FPGA: multiplex hidden imagery for HDMI video sources

Fairy lights in femtoseconds: aerial and volumetric graphics rendered by focused femtosecond laser combined with computational holographic fields

Feature extraction on digital snow microstructures

Fractured 3D object restoration and completion

Freeform honeycomb structures and lobel frames

Image based relighting using room lighting basis

Inferring gaze shifts from captured body motion

Mid-air plus: a 2.5 D cross-sectional mid-air display with transparency control

Musasabi: 2D/3D intuitive and detailed visualization system for the forest

Non-diffuse effects for point-based global illumination

OpaqueLusion: opaque mid-air images using dynamic mask for occlusion expression

Optimization of natural frequencies for fabrication-aware shape modeling

Paint-like compositing based on RYB color model

Photometric compensation for practical and complex textures

Phygital field: integrated field with visible images and robot swarm controlled by invisible images

Real-time rendering of atmospheric glories

Real-time rendering of subsurface scattering according to translucency magnitude

Reassembling 3D thin shells using integrated template guidance and fracture region matching

Reconfigurable three-dimensional prototype system using digital materials

Reducing geometry-processing overhead for novel viewpoint creation

Texture preserving garment transfer

Toward validation of a Monte Carlo rendering technique

Tracking water droplets under descent and deformation

Virtual headcam: pan/tilt mirror-based facial performance tracking

Visualizing valley wind flow

Jigsaw: multi-modal big data management in digital film production

Content Provider	ACM Digital Library
Author	Hilton, Adrian Kim, Hansung Ila, Viorela Pabst, Simon Waine, Ted Polok, Lukáš Clifford, Jeff
Abstract	Modern digital film production uses large quantities of data captured on-set, such as videos, digital photographs, LIDAR scans, spherical photography and many other sources to create the final film frames. The processing and management of this massive amount of heterogeneous data consumes enormous resources. We propose an integrated pipeline for 2D/3D data registration aimed at film production, based around the prototype application Jigsaw. It allows users to efficiently manage and process various data types from digital photographs to 3D point clouds. A key step in the use of multi-modal 2D/3D data for content production is the registration into a common coordinate frame (match moving). 3D geometric information is reconstructed from 2D data and registered to the reference 3D models using 3D feature matching [Kim and Hilton 2014]. We present several highly efficient and robust approaches to this problem. Additionally, we have developed and integrated a fast algorithm for incremental marginal covariance calculation [Ila et al. 2015]. This allows us to estimate and visualize the 3D reconstruction error directly on-set, where insufficient coverage or other problems can be addressed right away. We describe the fast hybrid multi-core and GPU accelerated techniques that let us run these algorithms on a laptop. Jigsaw has been used and evaluated in several major digital film productions and significantly reduced the time and work required to manage and process on-set data.
Starting Page	1
Ending Page	1
Page Count	1
File Format	PDF
ISBN	9781450336321
DOI	10.1145/2787626.2792617
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2015-07-31
Publisher Place	New York
Access Restriction	Subscribed
Content Type	Text
Resource Type	Article

Central Library (ISO-9001:2015 Certified)
Indian Institute of Technology Kharagpur
Kharagpur, West Bengal, India | PIN - 721302

See location in the Map
03222 282435
Mail: support@ndl.gov.in

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in