A source close to the production confirmed the news to Access Hollywood.
The reality couple reportedly made the decision after the live portion of the premiere was taped in the Costa Rican jungle on Monday night, according to TMZ.
However, a source has confirmed to Access the couple has not left the jungle yet and will wait to do so until after Tuesday night's episode, when their fate on the show will be revealed.
While a rep for NBC wouldn't confirm the news when contacted by Access, it's unlikely the duo will be missed by their fellow reality show jungle dwellers.
Not long after arriving to their makeshift campsite in the Costa Rican jungle on Monday night's show, Spencer stormed out of the filming area – with Heidi in tow – and got on the phone with NBC executive Ben Silverman.
"I'm too rich and I'm too famous to be sitting with these people and cleaning up their s*** in the jungle, my man. And this cast is devaluing our fame right now. I'm sitting next to VH1 comedians that I have never even seen before… I thought it was gonna be all celebrities," Spencer told Ben. "Stars of shows get treated like stars, dude. I'm f***ing supposed to be cleaning up John Salley's s*** in a bucket? Dude! You've never cleaned up your own s*** let alone taken John Salley's s*** to the creek, have you? Don't throw me in the jungle and try and make me your little guinea pig torture act."
The couple then agreed to return to camp and spent the night with the rest of the cast, before trying to leave again the next morning.
In their absence, their fellow castmates decided to divvy up their belongings, assuming they weren't coming back.
But when Spencer and Heidi came back a second time, Spencer threw a fit when he discovered some of the other contestants had rummaged through his wife's things. He even took a swing at VH1 comedian Angela Shelton, knocking a water bottle out of her hand.
Following the altercation, a tearful Heidi tried to defend her husband during a confessional interview.
"My husband is a very new Christian so he is working very hard on his temper and stuff, but I feel like with anyone, like with the momma bear, you mess with the cubs, you're gonna get the wrath of the daddy bears," she said to the camera.
Related Content from AccessHollywood.com:
PLAY IT NOW: On TV: Speidi Quits 'I'm A Celebrity, Get Me Out Of Here'? (June 1, 2009)
PLAY IT NOW: Dish Of Salt: Heidi & Spencer Deliver 100 Pizza To Los Angeles Mission