Policy Optimization I: REINFORCE, Actor-Critic, A2C & A3C