the one是特指,特指你几天前去过的那个博物馆。原句其实是省略了that的,即原句是:Is this museum the one (that) you visit a few days ago?
the one是指代museum的如果换成that,that就变成指代visit museum这个动作了。不过其实日常口语中用that也并不算错,只是考试中更加注重语法。