There are two complementary ways to view probability; namely, we can define and apply it in terms of counting or in terms of betting. Both ways are useful in applications of probability including statistics. I will give a historical account of these two ways, argue that they are in some sense dual to each other, and conclude with a brief review of recent work on game-theoretic statistics.