You could try putting a little peroxide in your ear and let it bubble for a while and then drain it out. I've used that when I had an earache and it seemed to help. It might help draw out the infection. You should do it around twice a day.

Next time try ear plugs before you go swimming so water doesn’t get in. Many professional swimmers actually go deaf from the water and wind in their ears so they use these.

There are over-the-counter treatments just for swimmer's ear available at the drugstore. You could also ask the pharmacist there about using hydrogen peroxide; my mom used it for my ear infections when I was a kid, but I haven't researched its use myself, or been advised on it medically. What I was told once by a doctor was that sometimes just the shape of one's ear canal can make them more prone to retaining water in their ear than other people. Also, I used to have eczema and a doctor suggested that I might have a little in my ear canals too -I certainly didn't feel it -but he suggested that maybe this was leading to more water being plugged in my ears. I would definitely suggest making a point to lightly and shallowly dab the entrance to your ears with the corner of a towel after your shower. But if you have an earache or infection, don't use the same corner of the towel for both ears (you could help the infection spread). Also, tilting your head, and shaking the opposite leg works quite well for me too for getting water out. And I make a point to never go outside with wet or damp ears or hair. A LIGHT hairdrying AT A DISTANCE can help if ears are really damp and you need to get outside, but take care not to use a strong setting to close to your ears, as you could force water deeper inside.

A hair dryer on the warm setting works well. There is also a new product out, the Sahara Dry Ear, which is designed to dry out the ear canal safely (http://www.dryear.net/). I have not personally used it, but it sounds promising.