Optimizing Spatial and Temporal Reuse in Wireless Networks by Decentralized Partially Observable Markov Decision Processes
Issue No.04 - April (2014 vol.13)
Jaakko Peltonen , Dept. of Inf. & Comput. Sci., Aalto Univ., Aalto, Finland
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/TMC.2013.39
The performance of medium access control (MAC) depends on both spatial locations and traffic patterns of wireless agents. In contrast to conventional MAC policies, we propose a MAC solution that adapts to the prevailing spatial and temporal opportunities. The proposed solution is based on a decentralized partially observable Markov decision process (DEC-POMDP), which is able to handle wireless network dynamics described by a Markov model. A DEC-POMDP takes both sensor noise and partial observations into account, and yields MAC policies that are optimal for the network dynamics model. The DEC-POMDP MAC policies can be optimized for a freely chosen goal, such as maximal throughput or minimal latency, with the same algorithm. We make approximate optimization efficient by exploiting problem structure: the policies are optimized by a factored DEC-POMDP method, yielding highly compact state machine representations for MAC policies. Experiments show that our approach yields higher throughput and lower latency than CSMA/CA based comparison methods adapted to the current wireless network configuration.
Transmitters, Wireless networks, Interference, Receivers, Computational modeling, Markov processes,medium access control, Spatial reuse, wireless network, decentralized POMDP, multi-agent planning
Jaakko Peltonen, "Optimizing Spatial and Temporal Reuse in Wireless Networks by Decentralized Partially Observable Markov Decision Processes", IEEE Transactions on Mobile Computing, vol.13, no. 4, pp. 866-879, April 2014, doi:10.1109/TMC.2013.39