Because there is effectively a head on each end of an installed rivet, it can support tension loads. However, it is much more capable of supporting shear loads (loads perpendicular to the axis of the shaft).
eBay