What causes low self-esteem? Created with Sketch. Feelings of high or low self-worth often start in childhood. Family life that is riddled with disapproval can follow a person into adult life.