Off-site construction (OSC) has been recognized as an approach to transform the construction sector from a labor–intensive to a modernized and green industry. Despite a number of advantages, the development of OSC still remains its infancy in China due to various interactive barriers. Some studies have been conducted to explore the barriers to the OSC adoption. However, very few studies attempted to investigate the complex interrelationships among these barriers. In order to fill this gap, this study adopts Interpretive Structural Model (ISM) technique to explore the interrelationships amongst barriers to the OSC adoption in China. Firstly, critical barriers were identified through literature review and semi-structured interviews with various stakeholders. Then, the overall structure amongst barriers was revealed through ISM technique. By using the Matriced’ Impacts Croise's Multiplication Appliquée a UN Classement (MICMAC) technique, the barriers were classified into four groups according to their driving-power and dependence power. The results indicate that specific attentions should be given to inadequate policy and regulations, lacking knowledge and expertise, dominated traditional project process as well as low standardization. The research findings provide valuable information for policy-makers on the overall structure amongst barriers. These results shed lights on effectively developing measures to facilitate the OSC adoption in the construction sector.