The phrase apparently comes from the twelfth century, when the author John of Salisbury wrote that philosopher Bernard of Chartres compared people to dwarves perched on the shoulders of giants.
Noel Gallagher also used it - his reason is much more down to earth:
He saw the quote and liked it so much he thought it would be a suitable name for an Oasis' album..