NDLI: Synthesis of a video of performers appearing to play user-specified band music

Please wait, while we are loading the content...

A biologically inspired latent space for gait parameterization

A colloidal display: membrane screen that combines transparency, BRDF and 3D volume

Synthesis of a video of performers appearing to play user-specified band music

Turn: a virtual pottery by real spinning wheel

Design ornamentation & fabrication by multi agent system

A stereo nine-band camera for accurate color and spectrum reproduction

Graphic narratives: generative book covers

The flying : Kinect art using OpenNI and learning system

Typeface styling with ramp responses

A simulation game for line memorization

8D display: a relightable glasses-free 3D display

Stop-motion cameras in the network: connected multi-cameras for the collaboration work in stop-motion

CoDAC: compressive depth acquisition using a single time-resolved sensor

2D denoising factor for high dynamic range imaging

Active touch sensing of being-pulled illusion for pedestrian route navigation

3D human head geometry estimation from a speech

A collision detection method for high resolution objects using tessellation unit on GPU

A dynamic system for controlling the head movement and gaze of virtual characters

A collaborative real time previsualization tool for video games and film

A stereoscopic representation of impossible rectangle twisted torus figure

Door: the evolution of messenger and analogue emotion

High-definition and multispectral capturing for digital archiving of large 3D woven cultural artifacts

SketchGraph: gestural data input for mobile tablet devices

Vignette: a style preserving sketching tool for pen-and-ink illustration with texture synthesis

Lifelike interactive characters with behavior trees for social territorial intelligence

A cell phone based platform for facial performance capture

Development of a portable anisotropic reflectance measurement system for modeling and rendering of bidirectional texture functions

Automatic music video generating system by remixing existing contents in video hosting service based on hidden Markov model

Direct, spatial, and dexterous interaction with see-through 3D desktop

A resolution reduction method for multi-resolution terrain maps

Acquiring perceptually diffuse shading from general objects in actual scenes

A video see-through face mounted display for view sharing

A motion sensor interactive interface for viewing and manipulating protein structural data in 3D

CurveThis: a tool to create controllable massive crawling

Growing documentary: creating a collaborative computer-supported story telling environment

Optimized color LUT transformations by means of analysis of image memorable and subject important colors

Sketching knots

When cheesecake craving unplugs the pleasure button: understanding aesthetics and quality of experience in a computer generated graphics

Texture-size-independent address translation for virtual texturing

GaussSketch: add-on magnetic sensing for natural sketching on smartphones

Calligraphic cutting: extreme image resizing with cuts in continuous domain

Drum On: interactive personal instrument learning system

Analysis and synthesis of realistic eye movement in face-to-face communication

Acquiring shell textures from a single image for realistic fur rendering

Hand-rewriting: automatic rewriting like natural handwriting

Advanced GPU-based ray casting for bricked datasets

Easy-to-use authoring system for Noh (Japanese traditional) dance animation

living floccus: floating volumetric pixels using fog rings with stroboscopic effect

Use of periodic shift and color combinations to enhance illusory motion

tamable looper: creature-like expressions and interactions by movement and deformation of clusters of sphere magnets

GeigerCam: measuring radioactivity with webcams

Compressive light field photography

Image based smartphone interaction with large high resolution displays

Base mesh construction using global parametrization

Coarse irradiance estimation using curvilinear skeleton

CrowDiffuse: information diffusion over crowds with social network

LabaNOHtation: Laban meets Noh

Micro sized art "the weight of life"

Transparent: brain computer interface and social architecture

Ikimo: open entry-level robotics platform

Computational cellphone microscopy

mimicat: face input interface supporting animatronics costume performer's facial expression

De-aging high-resolution 3D facial models by example-driven mesh deformation

Consistent stylization of stereoscopic 3D images

Magic pot: interactive metamorphosis of the perceived shape

Light-field supported fast volume rendering

Lace curtain: rendering animation of woven cloth using BRDF/BTDF: estimating physical characteristics from subjective impression

ViewPaint (vol. 1 The Milkmaid by Johannes Vermeer)

Improved linear light source material reflectance scanning

Computational retinal imaging via binocular coupling and indirect illumination

NanoAR: mobile AR application with microscopic interaction

Facial aging simulator considering geometry and patch-tiled texture

Distance aware ray tracing for curves

Shadow++: a system for generating artificial shadows based on object movement

Omnistereo images from ground based lidar

Particle-based simulation of snow trampling taking sintering effect into account

Printing 3D light field with 1D halftone screening

CosmicAI: generating sky backgrounds through content-based search and flexible composition

NeonDough: crafting with interactive lighted clay

Fast-automatic 3D face generation using a single video camera

Efficient terrain & ocean rendering for a real size planet

Virtual Yamahoko parade with vibration

Rupture simulation of a bubble with MPS

Shape deformation using freeform deformation axis

SGRT: a scalable mobile GPU architecture based on ray tracing

Effective global prediction for dense light-field compression by using synthesized multi-focus images

Neu: how brain activity can change an animated scene

How to draw illustrative figures?

Fast multi-image-based photon tracing with grid-based gathering

Tongue visualization for specified speech task

Towards a transparent, flexible, scalable, and disposable image sensor

Estimating diffusion parameters from polarized spherical gradient illumination

New interactive visualisation of multiscale biomedical data

Improving registration using active shape models and depth

Interactive generation of (paleontological) scientific illustrations from 3D-models

Using motion capture to manipulate and edit meshes

Estimating specular normals from spherical Stokes reflectance fields

Perifoveal display: combining foveal with peripheral vision in one visualization

Iterative cage-based registration for dynamic shape capture

Multi-resolution depth-of-field rendering

Focus tracking for cinematography

SAION: selective audio image reproduction system using multiple hyper directional loudspeakers

LiveTree: realistic tree growth simulation tool

Pixelating vector line art

Guided tone mapping

Network for sciences, engineering, arts and design

Non-rigid shape correspondence and description using geodesic field estimate distribution

Radiance filtering for interactive path tracing

Hair motion capturing from multiple view videos

Stuffed toys alive!: cuddly robots from fantasy world

Simplification of hexahedral mesh

Randomized coherent sampling for reducing perceptual rendering error

High detail marker based 3D reconstruction by enforcing multiview constraints

Technoculture of handcraft: fine gesture recognition for haute couture skills preservation and transfer in Italy

Rendering of human skin during physical exercise

Measurement-based synthesis of facial microgeometry

The telematic dinner party

Rich intrinsic image decomposition of outdoor scenes from multiple views

Panorama light-field imaging

Video retrieval based on user-specified deformation

Stereoscopic line drawing using depth maps

Patching of moving objects for ghosting-free HDR synthesis

Perceptually-optimized content remapping for automultiscopic displays

Physical simulation for real-time image/video retargeting

Real-time HDR video reconstruction for multi-sensor systems

Turning photographs into abstract expressionist paintings

Use of CUDA streams for block-based MPEG motion estimation on the GPU

Synthesis of a video of performers appearing to play user-specified band music

Content Provider	ACM Digital Library
Author	Yamamoto, Tomohiro Okabe, Makoto Onai, Rikio
Abstract	We propose a novel method to synthesize a video of multiple performers appearing to play the user-specified band music. The performance video often helps us to enjoy or understand the music. For example, watching the performance of a bass player makes it easier for us to focus on the bass sound, which is an experience different from listening to the music just using speakers or headphones. Our approach is based on the database of performance videos: given the band music, our system chooses appropriate footages from the database, slightly modifies their speeds and timings according to the music, and then concatenates them as the resulting video. In existing research, there are several methods proposed for synchronizing videos to a user-specified music, e.g., to synthesize a dance video [Nakano et al. 2011]. These methods synchronize a video to the music by analyzing its mood based on tempo or chord changes in the music. On the other hand, since we want to synthesize a performance video and require more precise synchronization, we analyze the music extracting the timings of musical notes from the audio signal (Fig.1). We perform best match search using the timings as feature vector, and copy the footage that has a similar set of timings (Fig.1-a and b). We demonstrate that our method enables to create a performance video of a band music, which is a fake but looks interesting.
Starting Page	1
Ending Page	1
Page Count	1
File Format	PDF
ISBN	9781450316828
DOI	10.1145/2342896.2342909
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2012-08-05
Publisher Place	New York
Access Restriction	Subscribed
Content Type	Text
Resource Type	Article

Central Library (ISO-9001:2015 Certified)
Indian Institute of Technology Kharagpur
Kharagpur, West Bengal, India | PIN - 721302

See location in the Map
03222 282435
Mail: support@ndl.gov.in

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in