SSD wear is on write. It's a bit of a double edged sword as you mentioned. Effectively you want the stuff you want to LOAD quickly on the SSD and you want to minimize unnecessary writes to the SSD.
NEVER EVER put your swap file on your SSD. Yes it's fast, but it will severely shorten the life of your SSD with useless writes.