Temperatures are expected to drop into the teens across most regions of New Jersey Wednesday night into early Thursday morning.