Loading...
Please wait, while we are loading the content...
Spectrum Management using Markov Decision Processes
| Content Provider | Semantic Scholar |
|---|---|
| Author | Meier, John L. |
| Copyright Year | 2015 |
| Abstract | . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xii Chapter 1: Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1 1.1 Research Questions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5 1.2 Contributions and Dissertation Overview . . . . . . . . . . . . . . . . . . . . 6 Chapter 2: Background and Related Work . . . . . . . . . . . . . . . . . . 9 2.1 RF Spectrum . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9 2.2 Markov Decision Process Models . . . . . . . . . . . . . . . . . . . . . . . . 13 2.3 Uses of Markov Decision Process Models . . . . . . . . . . . . . . . . . . . . 15 2.4 Validation of Models . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16 Chapter 3: Markov Decision Process Models for RF Spectrum Management 19 3.1 RF Spectrum Physical Model . . . . . . . . . . . . . . . . . . . . . . . . . . 20 3.2 Basic MDP Model with a Bernoulli Reward Function . . . . . . . . . . . . . 23 3.2.1 States, Actions, and Transitions for the Basic Bernoulli MDP . . . . 24 3.2.2 The Basic Bernoulli Model Reward Function . . . . . . . . . . . . . . 27 3.3 Extending the Basic Bernoulli MDP to Support Multiple Message Sizes . . . 30 3.4 Basic MDP Model with a Shannon Reward Function . . . . . . . . . . . . . 32 3.4.1 States, Actions, and Transitions for the Basic Shannon MDP . . . . . 33 3.4.2 Shannon Reward Function Design . . . . . . . . . . . . . . . . . . . . 33 3.5 Generalization of Spectrum Allocation Models . . . . . . . . . . . . . . . . . 40 3.6 Chapter Summary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41 Chapter 4: Heuristic Approximation of Value-Optimal Policies . . . . . . 42 4.1 Empirical Parametric Study . . . . . . . . . . . . . . . . . . . . . . . . . . . 44 4.1.1 Impact of Spectrum Size . . . . . . . . . . . . . . . . . . . . . . . . . 44 |
| File Format | PDF HTM / HTML |
| DOI | 10.7936/K7QC01S8 |
| Alternate Webpage(s) | https://openscholarship.wustl.edu/cgi/viewcontent.cgi?article=1134&context=eng_etds&httpsredir=1&referer= |
| Alternate Webpage(s) | http://openscholarship.wustl.edu/cgi/viewcontent.cgi?article=1134&context=eng_etds |
| Alternate Webpage(s) | https://doi.org/10.7936/K7QC01S8 |
| Language | English |
| Access Restriction | Open |
| Content Type | Text |
| Resource Type | Article |
