Leave in probe thermometer