(can be buckets really: 0-10, 10-20...70dB+)
dB is a logarithmic scale, and you are attempting to measure and average tiny slices of the ambient sound on a linear scale. That approach certainly won't capture a hand clap.
The 10 bit Arduino ADC barely covers 0-60 dB in voltage ratios.