Ebenezer's mother was Dorothy Smith and his father was Ebenezer Mattoon, just like his son. His grandfather was Eleazar. He had six children. They were named Mary Dickinson, Ebenezer III, Noah Dickinson, Dorothy Smith, Fanny E., and Fanny. Fanny E. lived for three years and Fanny lived for two.
Mattoon Street is by the Amherst Pelham Regional High School. It is named for the Mattoon family.