Abstract
In this article, an agent-based transactive energy (TE) trading platform to integrate energy storage systems (ESSs) into the microgrids' energy management system is proposed. Using this platform, two different types of energy storage market models are proposed to promote local-level (within the microgrid) and communal- or global-level ESSs' participation in the intra- and intermicrogrid TE markets. Also, a reinforcement learning algorithm known as simulated-annealing-based Q-learning is used to develop bidding strategies for ESSs to participate in the TE markets. Besides energy trading, the proposed system also accounts for the losses caused by energy transactions between ESSs and microgrids using a complex current-tracing-based loss allocation method. The overall efficacy of the proposed energy market management system is demonstrated using a modified IEEE 123-bus distribution system with multiple microgrids and ESSs. Based on simulation results, it is observed that the proposed model can effectively reinforce the balance between the supply and the demand in the microgrids using the mix of local and global ESSs.