Early life conditions play an important role in determining adult body size. In particular, childhood malnutrition and disease can elicit growth delays and affect adult body size if severe or prolonged enough. In the earliest stages of farming, skeletal growth impairment and small adult body size are often documented relative to hunter-gatherer groups, though this pattern is regionally variable. In Central/Southeast Europe, it is unclear how early life stress, growth history, and adult body size were impacted by the introduction of agriculture and ensuing long-term demographic, social, and behavioral change. The current study assesses this impact through the reconstruction and analysis of mean stature, body mass, limb proportion indices, and sexual dimorphism among 407 skeletally mature men and women from foraging and farming populations spanning the Late Mesolithic through Early Medieval periods in Central/Southeast Europe (~7100 calBC to 850 AD). Results document significantly reduced mean stature, body mass, and crural index in Neolithic agriculturalists relative both to Late Mesolithic hunter-gatherer-fishers and to later farming populations. This indication of relative growth impairment in the Neolithic, particularly among women, is supported by existing evidence of high developmental stress, intensive physical activity, and variable access to animal protein in these early agricultural populations. Among subsequent agriculturalists, temporal increases in mean stature, body mass, and crural index were more pronounced among Central European women, driving declines in the magnitude of sexual dimorphism through time. Overall, results suggest that the transition to agriculture in Central/Southeast Europe was challenging for early farming populations, but was followed by gradual amelioration across thousands of years, particularly among Central European women. This sex difference may be indicative, in part, of greater temporal variation in the social status afforded to young girls, in their access to resources during growth, and/or in their health status than was experienced by men.