This paper examines how accessibility to the station impacts HSR ridership considering regional heterogeneity. Our study targeted on Taiwan High-speed rail (THSR). Monthly ridership data of THSR from 2007 to 2015 have been obtained from eight stations that are currently in operation. With a panel data set shown as two dimensions, a region i and time t, two-way error components model was applied in this study. Our results suggest that differences in the regional heterogeneity measured by population, road infrastructure supply, car ownership and business, would influence the HSR demand pattern. We further show that bus service (shuttle bus and BRT) would induce more demand than rail services (MRT/TR). In addition, our results show that the demand was also influenced by station’s allocation; the one closest to city center had attracted more ridership. Under these findings, we discuss the way for pursuing long-term demand for HSR through improving accessibility to HSR stations and increasing quality of rail travel.