Loading...
Please wait, while we are loading the content...
Similar Documents
Designing agent collectives for systems with markovian dynamics (Document No: 20020078198)
| Content Provider | NASA Technical Reports Server (NTRS) |
|---|---|
| Author | Wolpert, David H. Lawson, John W. |
| Copyright Year | 2001 |
| Description | The "Collective Intelligence" (COIN) framework concerns the design of collectives of agents so that as those agents strive to maximize their individual utility functions, their interaction causes a provided "world" utility function concerning the entire collective to be also maximized. Here we show how to extend that framework to scenarios having Markovian dynamics when no re-evolution of the system from counter-factual initial conditions (an often expensive calculation) is permitted. Our approach transforms the (time-extended) argument of each agent's utility function before evaluating that function. This transformation has benefits in scenarios not involving Markovian dynamics, in particular scenarios where not all of the arguments of an agent's utility function are observable. We investigate this transformation in simulations involving both linear and quadratic (nonlinear) dynamics. In addition, we find that a certain subset of these transformations, which result in utilities that have low "opacity (analogous to having high signal to noise) but are not "factored" (analogous to not being incentive compatible), reliably improve performance over that arising with factored utilities. We also present a Taylor Series method for the fully general nonlinear case. |
| File Size | 770660 |
| Page Count | 8 |
| File Format | |
| Alternate Webpage(s) | http://archive.org/details/NASA_NTRS_Archive_20020078198 |
| Archival Resource Key | ark:/13960/t2c877r1d |
| Language | English |
| Publisher Date | 2001-11-19 |
| Access Restriction | Open |
| Subject Keyword | Cybernetics, Artificial Intelligence And Robotics Utilities Incentives Simulation Observation Markov Processes Nonlinearity Taylor Series Transformations Mathematics Ntrs Nasa Technical Reports Server (ntrs) Nasa Technical Reports Server Aerodynamics Aircraft Aerospace Engineering Aerospace Aeronautic Space Science |
| Content Type | Text |
| Resource Type | Article |
