Nantucket ...

One of the oldest and most famous first lines for a limerick is "There was a young man from Nantucket". Its obvious rhyming potential has led to many rude limericks, but the earliest versions are rather more ingenious and cleaner. According to Wikipedia, the original one was:

There once was a man from Nantucket 
Who kept all his cash in a bucket
But his daughter, named Nan
Ran away with a man 
And as for the bucket, Nantucket

This led to variations on the same style, playing ingenious games with the first and last lines. Two of them are:

But he followed the pair to Pawtucket
The man and the girl with the bucket
And he said to the man
He was welcome to Nan
But as for the bucket, Pawtucket

Then the pair followed Pa to Manhasset
Where he still held the cash as an asset
But Nan and the man 
Stole the money and ran
As as for the bucket, Manhasset 

So, now two small additions to the series:

The man then went back to Nantucket
And put some more cash in the bucket
Nan flashed him a smile
And then ran a mile  
So once more the wily Nantucket

That foolish old man from Nantucket
Wept over the now empty bucket
With Nan on the run
Once again she had won
So all he could say was "Oh! fuck it"   

There now I've said it!