NDLI: On-Line Learning and Optimization for Wireless Video Transmission

Content Provider	IEEE Xplore Digital Library
Author	Yu Zhang Fangwen Fu van der Schaar, M.
Copyright Year	1991
Abstract	In this paper, we address the problem of how to optimize the cross-layer transmission policy for delay-sensitive video streaming over slow-varying flat-fading wireless channels on-line, at transmission time, when the environment dynamics are unknown. We first formulate the cross-layer optimization using a systematic layered Markov decision process (MDP) framework, which complies with the layered architecture of the OSI stack. Subsequently, considering the unknown dynamics of the video sources and underlying wireless channels, we propose a layered real-time dynamic programming (LRTDP) algorithm, which requires no a priori knowledge about the source and network dynamics. LRTDP allows each layer to learn the dynamics on-the-fly, and adjusts its policy autonomously, based on their experienced dynamics as well as limited message exchanges with other layers. Unlike existing cross-layer methods, LRTDP optimizes the cross-layer policy in a layered and on-line fashion, exhibits a low computational complexity, requires limited message exchanges among layers, and is capable to adapt on-the-fly to the experienced environment dynamics. Finally, we prove that LRTDP converges to the optimal cross-layer policy asymptotically. Our numerical experiments show that LRTDP provides comparable performance to the idealized optimal cross-layer solutions based on complete knowledge.
Sponsorship	IEEE Signal Processing Society
Starting Page	3108
Ending Page	3124
Page Count	17
File Size	1140074
File Format	PDF
ISSN	1053587X
Volume Number	58
Issue Number	6
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2010-06-01
Publisher Place	U.S.A.
Access Restriction	One Nation One Subscription (ONOS)
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Access protocols Dynamic programming Streaming media Telecommunication traffic Delay effects Open systems Heuristic algorithms Optimization methods Computational complexity Wireless networks wireless video transmission Layered Markov decision process layered real-time dynamic programming on-line learning
Content Type	Text
Resource Type	Article
Subject	Signal Processing Electrical and Electronic Engineering

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Reference Frame Optimization for Multiple-Path Video Streaming With Complexity Scaling

Fast Reinforcement Learning for Energy-Efficient Wireless Communication

A Dynamic Programming Approach for QoS-Aware Power Management in Wireless Video Sensor Networks

Opportunistic scheduling for a two-way relay network using Markov decision process

Optimal Foresighted Multi-User Wireless Video

Adaptive Transmission for Delay-Constrained Wireless Video

Content-Aware Concurrent Multipath Transfer for High-Definition Video Streaming over Heterogeneous Wireless Networks

${Q}$-Learning Algorithms for Constrained Markov Decision Processes With Randomized Monotone Policies: Application to MIMO Transmission Control

MEC-enabled video streaming in device-to-device networks

On-Line Learning and Optimization for Wireless Video Transmission

Similar Documents

Reference Frame Optimization for Multiple-Path Video Streaming With Complexity Scaling

Fast Reinforcement Learning for Energy-Efficient Wireless Communication

A Dynamic Programming Approach for QoS-Aware Power Management in Wireless Video Sensor Networks

Opportunistic scheduling for a two-way relay network using Markov decision process

Optimal Foresighted Multi-User Wireless Video

Adaptive Transmission for Delay-Constrained Wireless Video

Content-Aware Concurrent Multipath Transfer for High-Definition Video Streaming over Heterogeneous Wireless Networks

${Q}$-Learning Algorithms for Constrained Markov Decision Processes With Randomized Monotone Policies: Application to MIMO Transmission Control

MEC-enabled video streaming in device-to-device networks

On-Line Learning and Optimization for Wireless Video Transmission