Some of the brightest minds in finance are turning to behavioral science, complexity theory and evolutionary biology to come up with new models that can help banks and investors stay out of trouble when the so-called black swans return.