Stop in Torshavn

If travelling directly from Denmark to Iceland (and vice versa), is it possible to get off the ship (and visit Torshavn) during the few hours it is lying in the port of Torshavn?

Due to our schedule, there is no problem to go ashore, in low season - but in the high season there is no time - the ferry is only 1 1/2 hour in port.