Maybe keep a big roaring fire in your fireplace for a while? Probably not something you want to do in the summertime but the smoke may drive them away.

Why do you want to get rid of them? Honey bees are very valuable insects as they make honey and pollinate trees, flowers, and all types of plants. I would suggest at the end of summer having your chimney tuck pointed if you are dead set on getting rid of them. Otherwise you will have to kill them or move the queen – she will be the largest in the colony – useless if you cannot get to them.

Typically ive seen a dead air space within chimenys that honey bees seem to like, theres no good way to drive them away. Honey bees unlike wasps, keep their nest throughout the winter and therefore wont be leaving anytime soon unless you eliminate them now. Most bee keepers dont usually extract bees from homes due to the possiblity of them having a disease and contaminating their bees they currently have. In any event you will want to deal with this very quickly, honey bee colonies grow very large. The longer you wait the harder it will be to get rid of them. And they can also be a little aggressive if you come to close. Due to the fact that depending on where you live you live you could be dealing with the africanized honey bee. Id strongly suggest contacting a bee keeper, or a Pest Control Professional. Ive done services for these myself, and if you dont have the proper equiptment(ex. a bee suit) than your really putting yourself in harms way. I wish i had a better answer for you, and i dont commonly suggest someone to call a professional, however this situation is totally different. Multiple bee stings can be fatal, and even worse if your allergic, and if you dont thoroughly inspect correctly you could drive them into your house and that would be a horrible situation.

Please do avoid killing them. I don't know where you live, but the United States is having a honey bee shortage and it is really hurting our plant life. I have heard of smoking them out, but be careful.

It is illegal in most staes to kill honey bees. I would contact a beekeeper to come get the bees. What they will do is seal up all the entrances, and leave the bees one exit( a sort of funel that they can get out but not back in)They will place a portion of a beehive for the bees to relocate to with a pherpmone scent( mimics a queen scent)It take a minimum of 8 weeks for this to work. Usually it takes longer because the bees really want to be in "their home" they do not want to move and they will find any and every hole to go back in. It usually takes a good bit of caulk to seal all the holes. If you cannot find a beekeeper contact an exterminator, they may know how to find a beekeper.Good luck with this please don't kill the bees a beekeeper would keep them in a regular hive after trapping them.