This Article 
 Bibliographic References 
 Add to: 
Reducing Electricity Cost of Smart Appliances via Energy Buffering Framework in Smart Grid
Sept. 2012 (vol. 23 no. 9)
pp. 1572-1582
Yang Cao, Huazhong University of Science and Technology, Wuhan
Tao Jiang, Huazhong University of Science and Technology, Wuhan
Qian Zhang, Hong Kong University of Science and Technology, Hong Kong
To reduce the long term electricity cost of smart appliances (SAs) with deferrable operation time in smart grid, we propose a novel energy buffering framework to intelligently schedule the distributed energy storage (DES) for the cost reduction of SAs in this paper. The proposed energy buffering framework determines the action policy (e.g., charging or discharging) and the power allocation policy of the DES to provide DES power to proper SAs at proper time with lower price than that of the utility grid, resulting in the reduction of the long term financial cost of SAs. Specifically, we first formulate the optimal decision problem in the energy buffering framework as a discounted cost Markov decision process (MDP) over infinite-horizon. Then, we propose an optimal scheme for the energy buffering framework to solve the discounted cost MDP based on online learning approach. Extensive simulation results show that the proposed optimal scheme for the energy buffering framework can significantly reduce the long term financial cost comparing with the baseline schemes and the myopic scheme.

[1] H. Farhangi, "The Path of the Smart Grid," IEEE Power and Energy Magazine, vol. 8, no. 3, pp. 18-28, Jan./Feb. 2010.
[2] A.Q. Huang, M.L. Crow, G.T. Heydt, J. Zheng, and S. Dale, "The Future Renewable Electric Energy Delivery and Management (FREEDM) System: The Energy Internet," Proc. IEEE, vol. 99, no. 1, pp. 133-148, Jan. 2011.
[3] M. He, S. Murugesan, and J. Zhang, "Multiple Timescale Dispatch and Scheduling for Stochastic Reliability in Smart Grids with Wind Generation Integration," Proc. IEEE INFOCOM, pp. 461-465, 2011.
[4] F. Katiraei, R. Iravani, N. Hatziargyriou, and A. Dimeas, "Microgrids Management," IEEE Power and Energy Magazine, vol. 6, no. 3, pp. 54-65, May/June 2008.
[5] S. Borenstein, M. Jaske, and A. Rosenfeld, "Dynamic Pricing, Advanced Metering, and Demand Response in Electricity Markets," UC Berkeley: Center for the Study of Energy Markets, , Oct. 2002.
[6] B.P. Roberts and C. Sandberg, "The Role of Energy Storage in Development of Smart Grids," Proc. IEEE, vol. 99, no. 6, pp. 1139-1144, June 2011.
[7] S. Han, S. Han, and K. Sezaki, "Development of an Optimal Vehicle-to-Grid Aggregator for Frequency Regulation," IEEE Trans. Smart Grid, vol. 1, no. 1, pp. 65-72, June 2010.
[8] A. Saber and G. Venayagamoorthy, "Plug-in Vehicles and Renewable Energy Sources for Cost and Emission Reductions," IEEE Trans. Industrial Electronics, vol. 58, no. 4, pp. 1229-1238, Apr. 2011.
[9] S. Newman, "Smart Appliances for an Energy-Efficient Future," http:/, 2008.
[10] D. Neill, M. Levorato, A. Goldsmith, and U. Mitra, "Residential Demand Response Using Reinforcement Learning," Proc. IEEE Int'l Conf. Smart Grid Comm. (SmartGridComm), pp. 409-414, 2010.
[11] K. Turitsyn, S. Backhaus, M. Ananyev, and M. Chertkov, "Smart Finite State Devices: A Modeling Framework for Demand Response Technologies," Arxiv preprint arXiv:1103.2750, 2011.
[12] A. Marchiori, D. Hakkarinen, H. Qi, and L. Earle, "Circuit-Level Load Monitoring for Household Energy Management," IEEE Pervasive Computing, vol. 10, no. 1, pp. 40-48, Jan.-Mar. 2011.
[13] S.C. Lee, S.J. Kim, and S.H. Kim, "Demand Side Management with Air Conditioner Loads Based on the Queuing System Model," IEEE Trans. Power Systems, vol. 26, no. 2, pp. 661-668, May 2011.
[14] L. Rao, X. Liu, and W. Liu, "Minimizing Electricity Cost: Optimization of Distributed Internet Data Centers in a Multi-Electricity-Market Environment," Proc. IEEE INFOCOM, pp. 1-9, 2010.
[15] D. Pendarakis, N. Shrivastava, L. Zhen, and R. Ambrosio, "Information Aggregation and Optimized Actuation in Sensor Networks: Enabling Smart Electrical Grids," Proc. IEEE INFOCOM, pp. 2386-2390, 2007.
[16] H. Mohsenian-Rad, V. Wong, J. Jatskevich, R. Schober, and A. Leon-Garcia, "Autonomous Demand Side Management Based on Game-Theoretic Energy Consumption Scheduling for the Future Smart Grid," IEEE Trans. Smart Grid, vol. 1, no. 3, pp. 320-331, Dec. 2010.
[17] H. Mohsenian-Rad and A. Leon-Garcia, "Optimal Residential Load Control with Price Prediction in Real-Time Electricity Pricing Environments," IEEE Trans. Smart Grid, vol. 1, no. 2, pp. 120-133, Sept. 2010.
[18] M. Erol-Kantarci and H.T. Mouftah, "Wireless Sensor Networks for Cost-Efficient Residential Energy Management in the Smart Grid," IEEE Trans. Smart Grid, vol. 2, no. 2, pp. 314-325, June 2011.
[19] L. Qu and W. Qiao, "Constant Power Control of DFIG Wind Turbines with Supercapacitor Energy Storage," IEEE Trans. Industry Applications, vol. 47, no. 1, pp. 359-367, Jan./Feb. 2011.
[20] Y. Riffonneau, S. Bacha, F. Barruel, and S. Ploix, "Optimal Power Flow Management for Grid Connected PV Systems with Batteries," IEEE Trans. Sustainable Energy, vol. 2, no. 3, pp. 309-320, July 2011.
[21] R. Abe, H. Taoka, and D. McQuilkin, "Digital Grid: Communicative Electrical Grids of the Future," IEEE Trans. Smart Grid, vol. 2, no. 2, pp. 399-410, June 2011.
[22] M.A.A. Pedrasa, T.D. Spooner, and I.F. MacGill, "Coordinated Scheduling of Residential Distributed Energy Resources to Optimize Smart Home Energy Services," IEEE Trans. Smart Grid, vol. 1, no. 2, pp. 134-143, Sept. 2010.
[23] K. Kok, Z. Derzsi, M. Hommelberg, C. Warmer, R. Kamphuis, and H. Akkermans, "Agent-Based Electricity Balancing with Distributed Energy Resources, A Multiperspective Case Study," Proc. Hawaii Int'l Conf. System Sciences, pp. 1-10, 2008.
[24] Z.M. Fadlullah, M.M. Fouda, N. Kato, A. Takeuchi, N. Iwasaki, and Y. Nozaki, "Toward Intelligent Machine-to-machine Communications in Smart Grid," IEEE Comm. Magazine, vol. 49, no. 4, pp. 60-65, Apr. 2011.
[25] D. Doerffel and S. Sharkh, "A Critical Review of Using the Peukert Equation for Determining the Remaining Capacity of Lead-Acid and Lithium-Ion Batteries," J. Power Sources, vol. 155, no. 2, pp. 395-400, Apr. 2006.
[26] K. Bullis, "Automakers Hope to Make Money on Used EV Batteries," http:/, 2011.
[27] J. Wang, M.A. Biviji, and W.M. Wang, "Lessons Learned from Smart Grid Enabled Pricing Programs," Proc. IEEE Power and Energy Conf. at Illinois (PECI), pp. 1-7, 2011.
[28] C. Papadimitriou and K. Steiglitz, Combinatorial Optimization: Algorithms and Complexity. Prentice Hall, 1982.
[29] R. Sutton and A. Barto, Introduction to Reinforcement Learning. MIT Press, 1998.
[30] E.A. Feinberg and A. Shwartz, Handbook of Markov Decision Processes, Int'l Series in Operations Research and Management Science Series. Springer 2005.
[31] V. Borkar and S. Meyn, "The Ode Method for Convergence of Stochastic Approximation and Reinforcement Learning," SIAM J. Control and Optimization, vol. 38, no. 2, pp. 447-469, 2000.

Index Terms:
Electricity,Real time systems,Batteries,Pricing,Delay,Smart grids,Resource management,distributed energy storage,Electricity,Real time systems,Batteries,Pricing,Delay,Smart grids,Resource management,Markov decision process.,Smart grid,energy buffering framework,smart appliance
Yang Cao, Tao Jiang, Qian Zhang, "Reducing Electricity Cost of Smart Appliances via Energy Buffering Framework in Smart Grid," IEEE Transactions on Parallel and Distributed Systems, vol. 23, no. 9, pp. 1572-1582, Sept. 2012, doi:10.1109/TPDS.2012.126
Usage of this product signifies your acceptance of the Terms of Use.