Don't search inside or scroll the focused scrollable element when it is offscreen.