Advice for students of machine learning

Advice for students of machine learning

Written by David Mimno

One of my students recently asked me for advice on learning ML. Here's what I wrote. It ' s biased toward my own experience, but should generalize.

My Current Favorite Introduction is Kevin Murphy's book (Machine learning). Might also want to look at books by Chris Bishop (Pattern recognition), Daphne Koller (Probabilistic graphical Models) , and David MacKay (information theory, inference and learning algorithms).

Anything can learn about linear algebra and probability/statistics would be useful. Strang ' s Introduction to Linear Algebra, Gelman, Carlin, Stern and Rubin's Bayesian Data analysis, and Gelman and Hill ' s D ATA analysis using Regression and multilevel/hierarchical models is some of my favorite books.

Don ' t expect to get anything the first time. Read descriptions of the same thing from several different sources.

There ' s nothing like trying something yourself. Pick a model and implement it. Work through open source implementations and compare. Is there computational or mathematical tricks that do things work?

Read a lot of papers. When I am a grad student, I had a minute bus ride in the morning and the evening. I always tried to a interesting paper in my bag. The bus isn ' t the important part-what was useful is having a about half a hour every day devoted to reading.

Pick a paper "Live inside it" for a week. Think about it all the time. Memorize the form of each equation. Take a long walks and try to figure out how each variable affects the output, and how different variables interact. Think about the get from EQ. 6 to Eq. 7-authors often gloss over algebraic details. Fill them in.

Be patient and persistent. Remember von Neumann: "In the mathematics you don ' t understand things, you just get used to them."

Advice for students of machine learning