Not to mention that the brain is an immuno-privileged site as the immune system is reluctant to destory infected brain cells given their extremely low to none regeneration capacity.

A bit off-topic but HSV-1 (repeated reactivations throughout lifetime) has been suggested as causative agent for (at least contribute to) Alzheimer's disease. Another example of long-term effects of uncontrolled virus activity in the body.