The application of chimeric antigen receptor (CAR) T cell therapy in solid tumors is hindered by life-threatening toxicities resulting from on-target, off-tumor killing of nonmalignant cells that express low levels of the target antigen. Mesothelin (MSLN) has been identified as a target antigen for CAR T cell treatment of mesothelioma, lung, ovarian, and other cancers because of its high expression on tumor cells and limited expression on mesothelial cells. However, fatal off-tumor toxicity of high-affinity MSLN-targeting CAR T cells has been reported in multiple clinical trials. In this study, we constructed CARs using mutant variants of a single-domain nanobody that bind both human and mouse MSLN with a wide range of affinities and examined tumor responses and their toxicities from on-target, off-tumor interactions in mouse models. CAR T cells with low nanomolar affinity (equilibrium dissociation constant, KD) exhibited profound systemic expansion with no apparent infiltration into the tumor. With a gradual reduction of CAR affinity toward the micromolar KD, the expansion of CAR T cells became more restricted to tumors. Our preclinical studies demonstrated that high-affinity MSLN CARs were associated with fatal on-target, off-tumor toxicity and that affinity-tuned CARs rendered T cells more selective for MSLN-high tumors.