Should Automated Trading Systems Be Tested After Every Software Update?

A system that worked previously may behave differently after changes to its platform or dependencies. What level of retesting would you consider necessary before allowing it to operate again?