The work aims to propose a scene-based digital restoration process based on based on virtual reality technology and com-bined with Cinema 4D 3D modeling software, in order to restore the dynanic scene changes of the original building shape of Nan-jing Drum Tower. First of all, through the study on the surrounding environment, building components, indoor fumishings and so on of Nanjing Drum Tower, based on the existing surveying and mapping data, the artistic scene reproduction design was carmried ou,and the three-dimensional modeling tchnology was used to restore the real building shape. Then, the virtual reality technology was used to realize the scene interaction design between the Drum Tower of the Ming Dynasty and the audience. Nanjing Drum Tower was first built in Hongwu Period of the Ming Dynasty, and its scale, grade and practice had changed greatly with the historial chang-es, so that the architectural orientation of Nanjing Drum Tower in the early Ming Dynasty in each reconstruction stage was still un- clear. Finally, through the vitual reality technology, the building shape of Nanjing Drum Tower could be preserved in the form of vi-sualization. A simplified and real interactive strategy of ancient building modeling is proposed in the virtual process, so that uscrs can directly experience the process of ancient building restoration and repair through immersive experience.