Efforts to raise £3.5m are under way to give the jewellery a public rather than private home.