• Publication
  • 2014
  • Issue No. 4 - April
  • Abstract - Optimizing Spatial and Temporal Reuse inWireless Networks by Decentralized Partially Observable Markov Decision Processes
 This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Optimizing Spatial and Temporal Reuse inWireless Networks by Decentralized Partially Observable Markov Decision Processes
April 2014 (vol. 13 no. 4)
pp. 866-879
Joni Pajarinen, Department of Automation and Systems Technology, Aalto University, PO Box 15500, Espoo, Uusimaa, Finland
Jaakko Peltonen, Department of Information and Computer Science, Aalto University, PO Box 15400, Espoo, Uusimaa, Finland
Ari Hottinen, Asparrow Ltd., Finland
The performance of medium access control (MAC) depends on both spatial locations and traffic patterns of wireless agents. In contrast to conventional MAC policies, we propose a MAC solution that adapts to the prevailing spatial and temporal opportunities. The proposed solution is based on a decentralized partially observable Markov decision process (DEC-POMDP), which is able to handle wireless network dynamics described by a Markov model. A DEC-POMDP takes both sensor noise and partial observations into account, and yields MAC policies that are optimal for the network dynamics model. The DEC-POMDP MAC policies can be optimized for a freely chosen goal, such as maximal throughput or minimal latency, with the same algorithm. We make approximate optimization efficient by exploiting problem structure: the policies are optimized by a factored DEC-POMDP method, yielding highly compact state machine representations for MAC policies. Experiments show that our approach yields higher throughput and lower latency than CSMA/CA based comparison methods adapted to the current wireless network configuration.
Index Terms:
Transmitters,Wireless networks,Interference,Receivers,Computational modeling,Markov processes,medium access control,Spatial reuse,wireless network,decentralized POMDP,multi-agent planning
Citation:
Joni Pajarinen, Jaakko Peltonen, Ari Hottinen, "Optimizing Spatial and Temporal Reuse inWireless Networks by Decentralized Partially Observable Markov Decision Processes," IEEE Transactions on Mobile Computing, vol. 13, no. 4, pp. 866-879, April 2014, doi:10.1109/TMC.2013.39
Usage of this product signifies your acceptance of the Terms of Use.