Desborough Castle, Pettifer Way