It sounds like the hysteris setting in the thermostat is not right. I'm not sure that is adjustable these days. If this happened with the old thermostat also, then I would consider the thermostat location. Could it be too close to a source of the heat generated by the furnace? Because, it sounds like positive feedback!