Of Arrogant and Humble Learners