(figurative) people whose criticisms are regarded as irrelevant or insignificant (resembling uneducated people who throw peanuts on the stage to express displeasure with a performance)
He ignored complaints from the peanut gallery.
source: WordNet 3.0
rearmost or uppermost area in the balcony containing the least expensive seats