Can I use it on episodes I have not published yet?

Yes. Type a future episode idea and Podspun will suggest a title and a thumbnail for it, so you can plan the look before you record.