Value-Based RL with Samples I