The house was built as a New England Colonial style mansion in 1915 for Dr. and Mrs. H. D. Morris. He was an early Port Arthur physician and British Consul. The Clarence Booz family subsequently purchased the property and added the large verandas and columns to change the style to Southern Greek Revival. Carl and Stella White, final residents of the home, brought interior glory to their home with their avid collection of Victorian furniture and other antiques. They named the house "White Haven" when they bought the house in 1942. They lived here with their only child, Michael.

Stella White left the home and furnishings to the Captain William Sanders Chapter, NSDAR, on her death in 1985. Her husband and son had preceded her in death. Charter Member, Ella Young Atwell, endowed the elegant restoration of the home in 1986. White Haven has assumed an important role in Port Arthur's Historic District for tourism and education.

The chapter had many fund raisers to maintain the home. In 1997, it was equipped and designated as a Bed and Breakfast. Subsequently, in 1999, the Captain William Sanders Chapter offered the beautiful home with all its Victorian furnishings as a gift to Lamar State College, Port Arthur.  The college uses the home for various functions, as well as a guest home.

White Haven has a Texas Historical Marker and is a Recorded Texas Historic Landmark.