Easy there killer - all I'm saying is that someone can, in fact, understand a given physical phenomena without ever using mathematics as his/her modelling tool. The problem that person might encounter when talking to someone who uses mathematics as his/her basis for understanding reality is that they would expect to get mathematically-based answers to questions. That bias toward mathematics does not discount the ability of someone to understand physical phenomena without mathematics.
Does the physics world as a whole use mathematics - yes.
Is it difficult to separate mathematics from physical reality once you've learned to look at it through a mathematical lense - yes.
Is it possible to understand the physical world without mathematics - yes.
The experiment used to validate a mathematical model can just as easliy be used as the basis for understanding. Trial, error and inspection, while time consuming, is a valid method for developing an understanding of a given phenomena.