Value-Based RL with Samples II