Optimization is a key component in machine learning. When problems scale up, normally only first-order optimization methods can be used in practice. In this talk I will briefly review some advances in the first-order optimization methods in machine learning. If time permits, I will also introduce some of my recent work on first order optimization.