Male reproductive development in higher plants experienced a series of complex biological processes, which can be regulated by Gibberellins (GA). The transcriptional factor GAMYB is a crucial component of GA signaling in anther development. However, the mechanism of GAMYB in wheat male reproduction is less understood. Here, we found that the thermo-sensitive genic male sterility (TGMS) wheat line YanZhan 4110S displayed delayed tapetum programmed cell death (PCD) and pollen abortive under the hot temperature. Combined with RNA-Sequencing data analysis, TaGAMYB was isolated and involved in fertility conversion, which was located in the nucleus and highly expressed in fertility anthers. The silencing of TaGAMYB in wheat displayed fertility decline, delayed tapetum programmed cell death, defects in pollen and exine formation, where the abortion characteristics were the same as Yanzhan 4110S. In addition, either hot temperature or GA3 treatment in YanZhan 4110S caused the downregulation of TaGAMYB at binucleate stage and trinucleate stage, as well as fertility decrease. Further, the transcription factor TaWRKY2 significantly changed under GA3-treatment and directly interacted with the TaGAMYB promoter. Therefore, we suggested that TaGAMYB may be essential for anther development and male fertility, and GA3 activates TaGAMYB by TaWRKY2 to regulate fertility in wheat.