You can remove this item on page 3 in the XFolder Global Settings.
Note that, per default, XFolder also defines the F5 key in folders as a shortcut to the "Refresh now" function.