JJ was involved in a roadside bomb explosion in 2011 which killed two of his fellow Royal Marines. As a result of the accident, JJ lost a large part of his right arm and two fingers on his left hand and was flown back to the UK.
Although the Daily Mail reports that JJ will "continue to work in an ambassadorial role for Invictus," his departure as a trustee has come as a surprise.
Just two months ago, he reflected on his impressive career as a motivational speaker and broadcaster and admitted: "None of it would have been possible without the Invictus Games."
This latest update for the Invictus Games comes after his beloved Sentebale charity has spent many months embroiled in controversy and an investigation by the Charity Commission.
Earlier this month, Sentebale called on a watchdog to clarify that its report did not investigate allegations of bullying and misogyny levelled against the Duke.
A source close to Harry then accused Sentable of "rehashing unsubstantiated allegations of bullying, misogyny and more". They described the decision to write to the watchdog as "provocative" and "pitiful".
The Prince launched the charity back in 2006. Sentebale, which means "forget-me-not" in Lesotho, was jointly set up by Harry and Prince Seeiso of Lesotho in 2006 in memory of Diana, Princess of Wales.