It was definitely the most physically demanding job I've ever had. I broke a few ribs and fingers while pulling anchor in 15 foot seas. Got stung by a couple poisonous fish. 8 hours on, 4 hours off for 5 days straight gets pretty old in a hurry. No to mention dealing with 50 other "fishermen" that you couldn't get away from because you were stuck on a boat for 2-3 days at a time.
However, on my days off I was able to go out and chase tarpon, sails, bones, shark, kings, wahoo and all the other wonderful fish that Key West has to offer.
I was there from November to May, and then we fished out of Gloucester, MA for Cod & Haddock during the summer months. Gloucester was even more fun because we had to deal with shitty weather and fillet over 1,000 fish per trip for customers. Needless to say I'm pretty handy with a fillet knife...
In September and October we did long-range trips for tuna before heading back down to the keys.