Heritage makes a "fishing" kayak that seems cheap and light. It won't paddle like the sleeker ones, but it would be a good way to check things out, and it only weighs 45#.
Or maybe rent one from EMS for a weekend.
I would rather fish out of a canoe, but they can get blown around. Best for flatter water and a partner.
One cast can change your day...maybe your life.