Breaking a lease on a house?

Me and my wife have decided to move from the house were living in to move to a house that's a lot cheaper in rent and closer to civilization(here in SC). We have a few move months on our lease with this house but were tired of living here. Our landlord is probably the worst landlord in history, he never fixes anything in the house, never answers his phone when we call, but if he calls us for rent and we miss the call he threats eviction EVERY TIME. But when our fridge went out and we needed a new one we ended up getting one cheap and we called him to tell him how much it was and he avoided us til the next month, I took it out of the rent when I paid him and he made a comment about it. Were moving in a few weeks and don't plan on paying him this next months rent, which he is already asking for early like he does every month. He comes around on the 21th of every month wanting rent early saying that the taxes are due on the house(he using this excuse every month), how often are taxes due on a house anyways? I'm sure it's not every month. But my question is, can us leaving like this bite us in the *** later? Like him taking us to court? He's in a lawsuit now with our neighbors who also rent from him because he pried the back door open to get into the house without telling them also damaging the back door. Any comments would be helpful