Should traders separate strategy development from strategy execution?

Changing a system while trading it makes it difficult to determine which version produced the results. Keeping research and live execution separate may help preserve consistency and produce cleaner records. How do you test improvements without constantly changing the rules you currently trade?