NDLI: 3D Town: The Automatic Urban Awareness Project

Content Provider	IEEE Xplore Digital Library
Author	Corral-Soto, E.R. Tal, R. Langyue Wang Persad, R. Luo Chao Solomon, C. Hou, B. Sohn, G. Elder, J.H.
Copyright Year	2012
Abstract	The 3DTown project is focused on the development of a distributed system for sensing, interpreting and visualizing the real-time dynamics of urban life within the 3D context of a city. At the heart of this technology lies a core of algorithms that automatically integrate 3D urban models with data from pan/tilt video cameras, environmental sensors and other real-time information sources. A key challenge is the "three-dimensionalization" of pedestrians and vehicles tracked in 2D camera video, which requires automatic real-time computation of camera pose relative to the 3D urban environment. In this paper we report preliminary results from a prototype system we call 3DTown, which is composed of discrete modules connected through pre-determined communication protocols. Currently, these modules consist of: 1) A 3D modeling module that allows for the efficient reconstruction of building models and integration with indoor architectural plans, 2) A GeoWeb server that indexes a 3D urban database to render perspective views of both outdoor and indoor environments from any requested vantage, 3) Sensor modules that receive and distribute real-time data, 4) Tracking modules that detect and track pedestrians and vehicles in urban spaces and access highways, 5) Camera pose modules that automatically estimate camera pose relative to the urban environment, 6) Three-dimensionalization modules that receive information from the GeoWeb server, tracking and camera pose modules in order to back-project image tracks to geolocate pedestrians and vehicles within the 3D model, 7) An animation module that represents geo-located dynamic agents as sprites, and 8) A web-based visualization module that allows a user to explore the resulting dynamic 3D visualization in a number of interesting ways. To demonstrate our system we have used a blend of automatic and semi-automatic methods to construct a rich and accurate 3D model of a university campus, including both outdoor and indoor detail. The demonstration allows web-based 3D visualization of recorded patterns of pedestrian and vehicle traffic on streets and highways, estimations of vehicle speed, and real-time (live) visualization of pedestrian traffic and temperature data at a particular test site. Having demonstrated the system for hundreds of people, we report our informal observations on the user reaction, potential application areas and on the main challenges that must be addressed to bring the system closer to deployment.
Starting Page	433
Ending Page	440
File Size	984162
Page Count	8
File Format	PDF
ISBN	9781467312714
DOI	10.1109/CRV.2012.64
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2012-05-28
Publisher Place	Canada
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Solid modeling Transmission line matrix methods visualization Buildings camera calibration distributed VR recti?cation tracking Vehicles Earth mixed reality Cameras Data models
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Automatic extrinsic calibration for an onboard camera

General Framework of Photo-Realistic 3D Visualization of Urban Building

Freehand 3D ultrasound volume imaging using a miniature-mobile 6-DOF camera tracking system

A calibration method for structured light systems based on a virtual camera

Visualization of corn acquired from stereovision

AffTrack: Robust tracking of features in variable-zoom videos

Recursive Camera Autocalibration with the Kalman Filter

Camera calibration and 3D reconstruction from single images using parallelepipeds

Camera self-calibration based on single rectangle

3D Town: The Automatic Urban Awareness Project

Similar Documents

Automatic extrinsic calibration for an onboard camera

General Framework of Photo-Realistic 3D Visualization of Urban Building

Freehand 3D ultrasound volume imaging using a miniature-mobile 6-DOF camera tracking system

A calibration method for structured light systems based on a virtual camera

Visualization of corn acquired from stereovision

AffTrack: Robust tracking of features in variable-zoom videos

Recursive Camera Autocalibration with the Kalman Filter

Camera calibration and 3D reconstruction from single images using parallelepipeds

Camera self-calibration based on single rectangle

3D Town: The Automatic Urban Awareness Project