Optimizing Spatial and Temporal Reuse in Wireless Networks by Decentralized Partially Observable Markov Decision Processes
Issue No. 04 - April (2014 vol. 13)
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/TMC.2013.39
Joni Pajarinen , Dept. of Autom. & Syst. Technol., Aalto Univ., Aalto, Finland
Ari Hottinen , Asparrow Ltd., Finland
Jaakko Peltonen , Dept. of Inf. & Comput. Sci., Aalto Univ., Aalto, Finland
The performance of medium access control (MAC) depends on both spatial locations and traffic patterns of wireless agents. In contrast to conventional MAC policies, we propose a MAC solution that adapts to the prevailing spatial and temporal opportunities. The proposed solution is based on a decentralized partially observable Markov decision process (DEC-POMDP), which is able to handle wireless network dynamics described by a Markov model. A DEC-POMDP takes both sensor noise and partial observations into account, and yields MAC policies that are optimal for the network dynamics model. The DEC-POMDP MAC policies can be optimized for a freely chosen goal, such as maximal throughput or minimal latency, with the same algorithm. We make approximate optimization efficient by exploiting problem structure: the policies are optimized by a factored DEC-POMDP method, yielding highly compact state machine representations for MAC policies. Experiments show that our approach yields higher throughput and lower latency than CSMA/CA based comparison methods adapted to the current wireless network configuration.
Transmitters, Wireless networks, Interference, Receivers, Computational modeling, Markov processes
J. Pajarinen, A. Hottinen and J. Peltonen, "Optimizing Spatial and Temporal Reuse in Wireless Networks by Decentralized Partially Observable Markov Decision Processes," in IEEE Transactions on Mobile Computing, vol. 13, no. 4, pp. 866-879, 2014.