In this article, we will shortly review a few old thoughts and recent thoughts on the relation between Mathematics and the Natural Sciences. Of course, the classic references to this open problem will include Wigner’s paper (1964); a more recent review article is Darvas (2008). But it appears that this issue is partly on the domain of natural philosophy and also philosophy of inquiry. Therefore we will begin with a review on some known thoughts of Kant, Bacon, Popper, etc.