The rocker was arrested just before midnight in Hollywood on a traffic warrant for driving without a license.
Stump was taken to the West Hollywood Sheriff's station. He posted $15,000 bail and was released at 5 AM on Wednesday.
Related Content from AccessHollywood.com:
VIEW THE PHOTOS: Proud Pop Star Parents: Ashlee Simpson & Pete Wentz
PLAY IT NOW: Access Extended: 'DJ Hero' Game Launch Party
PLAY IT NOW: Pete Wentz Talks Baby Photo Rumors, New Album & Tour