Can a trading strategy become too dependent on one market condition?

A system that performs exceptionally well in one environment may struggle outside it. Specialising can be perfectly reasonable, but traders need to understand the conditions under which their edge exists. How do you determine whether a strategy's specialisation is a strength or an unacceptable vulnerability?