At length did cross an Albatross,
from Samuel Taylor Coleridge – Rime Of The Ancient Mariner on Rap Genius
Meaning

Also, a metaphor. The Albatross following the ship was considered a sign of good luck. For those who are interested, see below.
Reference:
http://en.wikipedia.org/wiki/Albatross_%28metaphor%29
To help improve the meaning of these lyrics, visit "Rime Of The Ancient Mariner" by Samuel Taylor Coleridge and leave a comment on the lyrics box