How do you identify whether a Fair Value Gap is acting as a Rebalancing Zone or an Inversion Gap?

When price fails to respect an FVG and slices straight through it, how quickly do you switch your bias to trade the retest of that imbalance from the opposite side?