A small London museum dedicated to the first tunnel in the world to be built under a major river will close in September to undergo a £1.85m revamp.