This plugin does work with https, but if you are using some third party plugin then it may not work.
I suppose that you are using a plugin like Really Simple SSL, are you?
Also, make sure that you are using the latest version of the plugin.
You can use the RSS plugin, but you need to uncheck the box with “Auto Replace Mixed Content” in the settings.