Lifestyle factors, including exercise and diet, is offering a promising solution for age-related negative effects on brain health, with a potential to postpone the onset of neurodegenerative diseases. The results, however, are muffled with large individual difference in the effects, and it appears as if one-size does not fit all. In this talk I will provide an overview about our current understanding about the link between exercise- and dietary-induced brain plasticity in aging. I will also discuss potential reasons why some individuals gain from these lifestyle interventions and why some individuals appear to have little room for brain plasticity. I believe that understanding these factors is the necessary next step to harvest the full potential of lifestyle factors for brain health.