I headcanon that that gramophone belonged to James and Lily; before that it was James's father's. Remus rescued it from the rubble of their house after it was destroyed without even really being aware what he was doing. He wanted to go there and save Harry, but of course Harry was already gone. When Remus got home, he found himself holding a gramophone.