Chimeric antigen receptor T (CAR-T) cells show remarkable efficacy for some hematological malignancies. However, CAR targets that are expressed at high level and selective to tumors are scarce. Several strategies have been proposed to tackle the on-target off-tumor toxicity of CAR-T cells that arise from suboptimal selectivity, but these are complicated, with many involving dual gene expression for specificity. In this study, we show that switchable CAR-T cells with a tumor targeting adaptor can mitigate on-target off-tumor toxicity against a low selectivity tumor antigen that cannot be targeted by conventional CAR-T cells, such as CD40. Our system is composed of anti-cotinine murine CAR-T cells and cotinine-labeled anti-CD40 single chain variable fragments (scFv), with which we show selective tumor killing while sparing CD40-expressing normal cells including macrophages in a mouse model of lymphoma. Simple replacement of the tumor-targeting adaptor with a suicidal drug-conjugated tag may further enhance safety by enabling permanent in vivo depletion of the switchable CAR-T cells when necessary. In summary, our switchable CAR system can control CAR-T cell toxicity while maintaining therapeutic efficacy, thereby expanding the range of CAR targets.