GPodder was slow in my case because it was indexing all the files in its folder to maintain an internal database.  You can set options in the GPodder options to delete files after x number of days.  Also you can manually clean up files in the application. That said, never delete the underlying files because it will cause the GPodder database to become desynchronized which causes its own set of problems.  