Some of the most enjoyable swims I've had were in the rain. Once time there was a heavy rain storm riding a howling southerly gale while I was swimming laps. Every time I turned to go back down the pool it felt as though I was swimming in the surf. Lots of fun,.
But NEVER EVER swim when there's lightning. It's very dangerous.