If you think the SV will satisfy you, buy it, and you'll have $2,500 more in your pocket than if you bought the XSR. That's $2,500 you could put towards gear, or farkles, or just save up towards a trip, or towards maintenance expenses (they are inevitable).
2005 Suzuki V-Strom 1000 (for sale)
2003 Triumph Trophy 1200
2009 BMW F650GS (wife's)
2012 Triumph Tiger 800