All guns are fun to shoot, at least once. Many only so you can describe exactly what you don't like about them. For most the reason they don't like a firearm is because of recoil. With rifles, at least recoil can be mitigated with muzzle brakes and good recoil pads. My 300 and 338 Win Mags have about the recoil between a 243 and 308. The Backstop recoil pad made by Jim Harmer at Backfire.com works really well, decreases the felt recoil by 50% or more and when teamed with a brake tames the worst recoil down to easily manageable. I fired a friends 458 Win Mag with both a brake and Backstop pad and the recoil was no worst than a standard 30-06
Handguns are quite different. Not too many ways to tame recoil with a handgun. I am not very recoil sensitive but anything above a 45 ACP or 357 Magnum is simply not fun to shoot. I can handle a 44 mag, shoot it well, just not a lot. None of the hand cannons interest me. I've fired a S&W 500, and it was not the least bit enjoyable. I have to wonder about all these macho guys that say that the recoil from the hand cannons doesn't bother them. I have to wonder how many really have to go home and soak their hand in warm water to relieve the pain, or how many in the long run will have to resort to hand surgery.
Moving on, and into territory not mentioned here, but in many other posts is the old, handgun for a charging Grizzly or Alaskan Brown bear arguments. Since this is way off base to this topics subject will save those comments for another post.