Had wisdom teeth removed a month ago, swelling started again?!

I had my two bottom wisdom teeth removed, and everything seemed fine, around 3 weeks ago, on my left side, it started swelling up and it hurt, so the doctor said it was an infection and made an incision, allowing the blood and pus to exit. I was on a course of anti-biotics for a week. Now, on Sunday morning I wake up and it feels swollen on my right side, and it's bigger than it was last time. I thought not much of it because it was barely noticeable, but today it's swollen substantially and I feel a bit off, like I think I'm getting a fever, it's creeping in very slowly though, mucus buildup and i'm heating up and feeling the chills at times. Is this in any way related to the swelling?

I'm due for a checkup with the surgeon on Thursday, should I wait till then or see him asap? What do you think the problem is?

Thanks