Integrating Numerical and Physical Insights Into Scientific Deep Learning