Mike Ashley of Frasers Group described Harvey Nichols as being in a "death spiral".