Despite being a sword bearer at Charles II's coronation in 1661, his father's (the 7th Earl) loyalty was quickly forgotten as the King refused to restore the family to their estates. Both of his sons, William and James went on to inherit the title.