The `Milk` actor - whose 14-year marriage to Robin Wright was officially ended in July 2010 - admits his life has changed in many ways since the separation and is upset he will no longer be able to raise his family, including children Dylan, 19, and Hopper, 17, in a traditional way.
He said: "A profound change in life for me personally was not being able to raise my son in a whole family through high school.
"I got practical issues, like everybody ... I had just got taken for one half of everything I had in the divorce, so it`s not like I don`t have to work."
However, the 50-year-old star will be spending his free time on the earthquake-struck Caribbean island of Haiti, where he has been undertaking charity work since the disaster in early 2010.
He told The Hollywood Reporter: "This is where I`ll be when I`m not working, for the rest of my life."
Sean - who was married to pop star Madonna from 1985 to 1989 - had a troubled relationship with former wife Robyn.
Having initially filed for divorce in 2007, the pair reconciled in 2008 before filing for legal separation in April 2009, only to call of proceedings the next month.
The final divorce petition was entered in August 2009.