The former 'Two and a Half Men' actor is said to have parted ways with Peter McGuigan of Foundry Media Group after the agent failed to sell the star's life story at a big enough price.
Peter recently approached publishers for the book – which reportedly has the working title 'Apocalypse Me' – but didn't succeed in getting the $10 million offer Charlie was hoping for.
According to the New York Post newspaper, the 45-year-old actor apparently called the single offer of $1 million "paltry" and not worthy of his "bitchin' rock star from Mars" status.
It is thought the book was turned down by most publishing houses because reports of the star's antics – including suing Warner Bros. Television for dismissing him from ‘Two and a Half Men’ and his unusual living arrangement with his 'goddess' girlfriends – has made his life so public there will be too little left to reveal.
Peter responded to the rumours by saying they are "very, very wrong".
Meanwhile, Charlie is suing an arbitration company hired to mediate in his case against Warner Bros. Television and 'Two and a Half Men' creator Chuck Lorre, who fired him from the sitcom.
He is taking action against JAMS - who were hired by his former employer to try and resolve the matter out of court - claiming they didn't provide him with enough notice to prepare for the proceedings and is also suing for declaratory relief.