The Australian model hosted the reality show, which saw Jessica Simpson, Nicole Richie and John Varvatos acting as judges and mentors to the designer hopefuls.
Elle has confirmed she won’t be returning to the program, but will still be involved.
“I have been involved with Fashion Star from the beginning, and am very proud to see it come to life, not only in America but globally,” she told New York Post.
“The show is in great hands, and although I will not be hosting this season, I will still be very involved and will be reviewing the format for the upcoming season.”
Elle will continue to executive produce the show. She is also the host and a judge on Britain and Ireland’s Next Top Model and is working on a new series called Goddess With Guts.
Fashion Star sees a group of wannabe designers competing to get their clothes featured in one of three stores; H&M, Macy’s and Saks Fifth Avenue. The winner will launch a collection in each of the shops.
It’s been reported H&M has also pulled out of the program, apparently as it wants to focus on other things. The store is famed for offering cheap collections by high-end designers, most notably Versace and Karl Lagerfeld.