Pollen exine is essential for protection from the environment of the male gametes of seed-producing plants, but its assembly and composition remain poorly understood. We previously characterized Arabidopsis (Arabidopsis thaliana) mutants with abnormal pollen exine structure and morphology that we named kaonashi (kns). Here we describe the identification of the causal gene of kns4 that was found to be a member of the CAZy glycosyltransferase 31 gene family, identical to UNEVEN PATTERN OF EXINE1, and the biochemical characterization of the encoded protein. The characteristic exine phenotype in the kns4 mutant is related to an abnormality of the primexine matrix laid on the surface of developing microspores. Using light microscopy with a combination of type II arabinogalactan (AG) antibodies and staining with the arabinogalactan-protein (AGP)-specific β-Glc Yariv reagent, we show that the levels of AGPs in the kns4 microspore primexine are considerably diminished, and their location differs from that of wild type, as does the distribution of pectin labeling. Furthermore, kns4 mutants exhibit reduced fertility as indicated by shorter fruit lengths and lower seed set compared to the wild type, confirming that KNS4 is critical for pollen viability and development. KNS4 was heterologously expressed in Nicotiana benthamiana, and was shown to possess β-(1,3)-galactosyltransferase activity responsible for the synthesis of AG glycans that are present on both AGPs and/or the pectic polysaccharide rhamnogalacturonan I. These data demonstrate that defects in AGP/pectic glycans, caused by disruption of KNS4 function, impact pollen development and viability in Arabidopsis.