How to style the RSS feed?

Yep, you’ve got it right. Use a custom theme, override the rss.xml template, and put the XSLT file in the static directory.