In this paper, three kinds of glass fiber reinforced polymer (GFRP) connectors were proposed for use in precast concrete sandwich panels, including “I” beam, corrugated plate and hexagonal tube. Direct shear tests based on a typical push-out configuration (i.e., three concrete wythes linked with connectors and two rigid foam layers in between) were conducted to compare their performance with that of one commercially available product, which is being widely used in PCSPs in prefabricated construction. The test results indicated that, the shear resistance of all proposed connectors was governed by the material failure in GFRP and no pull out failure of the connectors from the concrete wythes occurred. All proposed GFRP connectors showed a higher shear stiffness and shear resistance (more than 13kN per connector) than corresponding existing systems. The corrugated GFRP plate performed the best while the GFRP tube performed the second in terms of shear stiffness and shear resistance, demonstrating their good potential for applications in partially or fully composite concrete sandwich panels. Finite element analyses were also conducted to investigate the stress condition in the proposed connectors during the loading stage. The analytical results indicated that “I” beam and corrugated plate connectors mainly generate shear deformation whereas the hexagonal tube generate both significant flexural and significant shear deformation.