Azureus Problem

Yeah, I need major help with an issue i've been having with azureus, I have all my ports forwarded, my firewall test shows as "ok" (no NAT errors), and when it downloads, I have a green smiley face with speeds between 20kb/s to 45kb/s...so that's all good. What my problem is: Sometimes my downloads and uploads will stop, i'll see the number of peers and seeds in brackets, but i won't be connected to any of them, no matter what ports i select, how many times I restart, how many downloads i have going on, and how fast i have my setup, I can;t connect to any peers. This will be ongoing for a couple days when all of a sudden the smileys will turn green and the downloads will start up again by themselves. I can't seem to find anyone with a similar problem. Anyone have the slightest idea whats going on?