I have found several points in my career where taking the extra time to learn math fundamentals (particularly linear algebra) has paid off when learning something more high level. People often say that the math in machine learning doesn't matter and you can staple python libraries together but I've made convincing arguments in product design meetings based on how the mathematics of certain algorithms lends itself to our particular use case and how it helps scalability