Graduate Seminar: Ala’eddin Masadeh

Date(s) - 29 Aug 2018
1:10 PM - 2:00 PM

3043 ECpE Building Addition

Speaker: Ala’eddin Masadeh, ECpE Graduate Student

Adviser: Ahmed Kamal and Zhengdao Wang

Title: Reinforcement Learning Exploration Algorithms for Energy Harvesting Communications Systems

Abstract: Prolonging the lifetime, and maximizing the throughput are important factors in designing an efficient communications system, especially for energy harvesting-based systems. In this work, the problem of maximizing the throughput of point-to-point energy harvesting communications system, while prolonging its lifetime is investigated. This work considers more real communications system, where this system does not have a priori knowledge about the environment. This system consists of a transmitter and receiver. The transmitter is equipped with an infinite buffer to store data, and energy harvesting capability to harvest renewable energy and store it in a finite battery. The problem of finding an efficient power allocation policy is formulated as a reinforcement learning problem. Two different exploration algorithms are used, which are the convergence-based and the epsilon-greedy algorithms. The first algorithm uses the action-value function convergence error and the exploration time threshold to balance between exploration and exploitation. On the other hand, the second algorithm tries to achieve balancing through the exploration probability (i.e. epsilon). Simulation results show that the convergence-based algorithm outperforms the epsilon-greedy algorithm. Then, the effects of the parameters of each algorithm are investigated.

Download event reminder

back to Seminars list

Events Calendar

<< Jul 2019 >>
30 1 2 3 4 5 6
7 8 9 10 11 12 13
14 15 16 17 18 19 20
21 22 23 24 25 26 27
28 29 30 31 1 2 3

Contact Information

Interested in giving a seminar? Contact Professor Namrata Vaswani.

Announcements and publicity by Kristin Clague, and scheduling by the department secretary.