Have absolutely nothing to do with evil. Jesus was known to crack a whip and turn a table.

Ephesians 5:11-16
King James Version
11 And have no fellowship with the unfruitful works of darkness, but rather reprove them.

12 For it is a shame even to speak of those things which are done of them in secret.

13 But all things that are reproved are made manifest by the light: for whatsoever doth make manifest is light.

14 Wherefore he saith, Awake thou that sleepest, and arise from the dead, and Christ shall give thee light.

15 See then that ye walk circumspectly, not as fools, but as wise,

16 Redeeming the time, because the days are evil.

Love for our neighbor involves the same principle. There are occasions when God requires us to confront serious error and sin.

1 John 1:8
If we say that we have no sin, we deceive ourselves, and the truth is not in us.