Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

This is not true and harmful to the progress of the field: http://www.fast.ai/2017/03/17/not-commoditized-no-phd/


While it may not require a Ph.D, effective use of Machine Learning does require Ph.D like scientific skills. Even the link you mention talks about reading research papers and building good models does require scientific rigor.


Hmm... for this statement, I guess it depends on what you would classify as "machine learning".

From what I've read on machine learning, a lot of the more basic techniques includes statistical methods (linear regression, logical regression, random forests, Bayesian statistics) that more or less are taught at master's degree level statistics courses at most, not doctorate level. If I remember right basic linear regression even showed up in stat 101.

I realize that many of these techniques can't solve some of the problems the deeper, more complex machine learning techniques can (for which your Ph.D statement might be right). But not every problem needs a very complex solution.


Well the article builds around a very superficial view of ML.

If you want to do simple recommendation systems or spam filters than O.k. Those are solved problems, hence commoditized.

If you want to build novel things, you really need academic-grade ML.

If you want another argument, I came from working in VC and startups, and they think they understand ML. Boy, they really don't. They are like kids pretending to play a guitar that can't strike a single chord right.


Different approaches suit different people and PHD is a relatively specialized route. It's good to have people targeting similar goals with different approaches.

For an anecdote, I recall hearing one of the Kaggle founders mention that many of their bounties are won by non-statisticians/ML-ists. Producing novel (in the academic sense) stuff is unlikely outside of an academic setting, but producing products or solving problems is do-able.

Edit/comment: no need to downvote rsrsrs86 people. He's putting forward a position and defending it, not trolling. If you disagree, then disagree. The whole point of a thread like this is hearing people's take. Surely, PHD is a valid suggestion.


Kaggle competitions are very restricted in the sense that they are supervised learning problems. This typically results in applications in analytics. This should o.k. be easier to get into.

But ML can do much more than analytics., and much more than supervised problems. And the great problems to be solved are not supervised problems. They involve learning as you go, without a clean database with examples to learn from. They are adaptive problems.

You might optimize prices in an online retail player by trying to estimate supply and demand curves, but you will fail, and the best way to do it is not much different than teaching a neural network to play video games, but is fundamentally different from supervised learning and regressions.

ML can do self-driving cars, it can build drones that learn to fly, it can translate horses to zebras, it can play defeat humans at Go, it can make guitars sound like pianos.

There is a lot of technique and theory into framing any problem as a problem that can be solved by machine learning. Machine learning is generally not feasible unless you restrict the problem properly.


I think if the problem is figuring out an ML solution to an already existing large dataset (as in the case of Kaggle and big companies), you do not need an advanced education. However, if you are doing a start-up one needs to answer questions like when should I stop collecting data, when should I give up trying this algorithm, when should I conclude this problem is impossible in its current form etc. These questions require crazy amount of experience of solving novel problems. During your PhD, you try to solve many novel problems and it makes you an expert to answer these questions. I also think you need an advisor/mentor to develop these skills. This is the real knowledge you can learn in PhD and that's why they are valuable and hard to replace


"If you want to build novel things, you really need academic-grade ML." is a bit tricky.

If you want to achieve novel (better than yesterday's state of art) results on existing problems, then yes, you really need academic grade ML. Especially for "solved" (i.e. well researched) problems - if the current solution isn't good enough for your needs, then you're going to need serious work to improve on that.

However, if you want to attack novel business problems, then it's quite likely that you can solve them without needing to solve any new ML problems. You have to know what "instruments" are available, and you have to be able to read&learn how implement a particular solution that you choose, but generally you just need to squint hard enough to map your business problem to one or more ML tasks that have a known solution.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: