NDLI: Online learning for wireless video transmission with limited information

Content Provider	IEEE Xplore Digital Library
Author	Yu Zhang Fangwen Fu van der Schaar, M.
Copyright Year	2009
Description	Author affiliation: Electrical Engineering Department, UCLA, USA (Yu Zhang; Fangwen Fu; van der Schaar, M.)
Abstract	In this paper, we address the problem of joint packet scheduling at the application layer as well as power and rate allocation at the physical layer for delay-sensitive video streaming over slow-varying flat-fading wireless channels. Our goal is to find the optimal cross-layer policy that maximizes the cumulative received video quality, while minimizing the total transmission energy. We first formulate the cross-layer optimization using a systematic layered Markov Decision Process (MDP) framework and then propose a layered real-time dynamic programming (RTDP) algorithm for solving this cross-layer optimization problem by combining together the policy update and real-time decision making. This approach reduces the high complexity of the conventionally used offline dynamic programming methods. Moreover, to accommodate the cases when the network environment dynamics (e.g. state transition probabilities) are unknown or non-stationary (e.g. state transition probabilities are changed over time), we further improve our RTDP method by collecting the required network information and estimating the dynamics online, using a model-free approach. Based on this information, a user (a transmitter-receiver pair) can adaptively change its policy to cope in real-time with the experienced environment dynamics. We also prove the convergence of this RTDP method (which complies with the layered architecture of the OSI stack). Finally, our numerical experiments show that the proposed RTDP solutions outperform the conventional offline DP methods for real-time video streaming.
Starting Page	1
Ending Page	10
File Size	3531428
Page Count	10
File Format	PDF
ISBN	9781424446513
DOI	10.1109/PACKET.2009.5152166
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2009-05-11
Publisher Place	USA
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Real time systems layered markov decision process Heuristic algorithms wireless video transmission Decision making real-time learning dynamic programming Physical layer Scheduling algorithm Delay Open systems Streaming media Dynamic programming State estimation online learning
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Online learning for wireless video transmission with limited information.

On-Line Learning and Optimization for Wireless Video Transmission

Network coding-based wireless media transmission using POMDP

A systematic framework for dynamically optimizing delay-sensitive wireless transmission

Reinforcement learning aided smart-home decision-making in an interactive smart grid

Adaptive policies for real-time video transmission: A Markov decision process framework

A cross-layer scheduling algorithm for H.264 video transmission over wireless networks

Reinforcement learning for energy-efficient wireless transmission

A QoS aware cross-layer optimisation for wireless video streaming

Online learning for wireless video transmission with limited information

Similar Documents

Online learning for wireless video transmission with limited information.

On-Line Learning and Optimization for Wireless Video Transmission

Network coding-based wireless media transmission using POMDP

A systematic framework for dynamically optimizing delay-sensitive wireless transmission

Reinforcement learning aided smart-home decision-making in an interactive smart grid

Adaptive policies for real-time video transmission: A Markov decision process framework

A cross-layer scheduling algorithm for H.264 video transmission over wireless networks

Reinforcement learning for energy-efficient wireless transmission

A QoS aware cross-layer optimisation for wireless video streaming

Online learning for wireless video transmission with limited information