The present study aims to investigate the association between educational qualification and early labor market exit among men and to examine the contribution of labor market marginalization measured across the working life on this association. A register-linked cohort study was conducted including men who completed military service in 1969/70 (born between 1949 and 1951) and were alive at age 55 and not disability pension beneficiaries (n = 40 761). Information on the highest level of educational qualification and the outcome of early exit (disability pension, sickness absence, unemployment, and early old-age pension) was obtained from Swedish nationwide registers between the ages of 55 and 64 years. Labor market marginalization was defined as periods of long-term unemployment and sickness absence over the working life and up to follow-up. Cox regression analyses were used to obtain hazard ratios (HR) with 95% confidence intervals (CI). Low-educated men were more likely to leave the labor force early due to disability pension or sickness absence (HR: 2.48), unemployment (HR: 2.09), and early old-age pension with- (HR:1.25) and without -income (HR: 1.58). Labor market marginalization across the working life explained a large part of the association for the more involuntary early exit routes (disability pensions, sickness absence, unemployment) and explained very little with regards to the more voluntary early exit routes (early old-age pension with and without income). Exposure to labor market marginalization across the working life was important in explaining educational differences in early labor market exit due to disability pension or sickness absence and unemployment. This study underscores the importance of identifying and implementing preventive measures in the workplace (e.g. adaptions) to prevent new spells of sickness absence and unemployment, especially among low educated individuals.