Controversial opinion: We should stop teaching students any ML methods other than neural networks. There is so much inertia against forgetting things that never panned out. It& #39;s hard to let go of ideas, especially one& #39;s own, but our objective should be to make real progress in AI
Ok, a bit of nuance is in order. There is a wealth of connections between ML and other established mathematical fields and we should emphasize those! We should studying statistics, linear algebra, ODEs, optimal transport etc... The only "pure ML" things we need are NNs.