DurablowBattery Pack Compatible with Dexen Fireplace Electronic IPI Pilot Ignition Control Module (593-594A)

For a heatilator electric/gas fireplace, can you leave this plugged in without the batteries when not in use or should you remove it altogher?