If you are dealing with higher dimensional data and metric spaces, I think topology and related disciplines may be of value. Understanding the structure of your data will allow for the design and development of unique tools with which to handle it, an example being new dissimilarity metrics.
As an aside, some of the best programmers I have known were musicians and linguists, with little understanding of the math behind the problem, but an intuitive and often very different instinct for unique solutions.