There is an option to define the "Operator Hours" of your IVR, ie. the times of day when your calls will be routed through the IVR.
Outside the defined operator hours, calls will be routed according to the main setup.
More info and the setup steps can be found in the main guide here under 2. Advanced Configuration.