I must say that in the games I have played on the PS4 so far (Watchdogs, Killzone: Shadowfall, inFAMOUS: Second Son), the load times have been significantly better than what was average on the PS3 and XBox 360, so it's been quite a nice experience for me so far. I haven't yet played The Witcher 3, Bloodborne, or Fallout 4, which are newer and seem to be the ones with particularly heavy load times, so my opinion might change once I try some of those.
The big problem is that replacing my 1TB stock HDD with anything approaching a 1TB SSD is probably going to cost as much as the PS4 itself, and a smaller SSD would probably fill up really quickly.
Maybe it'll be worthwhile once SSD prices have dropped quite a bit more and their capacities have increased. I'd say give it a year or so...