Seeking a permanent home for his collection of over 4,000 objects, in 1972 he welcomed an overture from the financially troubled Pasadena Museum of Modern Art. He ultimately assumed control and naming rights, and in 1974 it was renamed the Norton Simon Museum. In 1987, the University of California, Los Angeles, announced an "agreement in principle" with Simon for the transfer to the university of the art collection owned by two Simon foundations – the Norton Simon Foundation and the Norton Simon Art Foundation. The plan was to keep most of collection in Pasadena, administered by UCLA, the Simon board and the Norton Simon Foundation. The university was to build a separate museum facility on campus for part of the collection. However, Simon withdrew his offer three months after the announcement was made.
In 1969, his son Robert Simon committed suicide. Leaving Donald (Norton's other son), Lucille, and Norton shocked. In 1970, he and his wife Lucille Ellis were divorced. In 1971, he married actress Jennifer Jones, the widow of David O. Selznick. He retired from active involvement in his business in 1969. He accepted appointments to the University of California Board of Regents, the Carnegie Commission on the Future of Higher Education, the boards of Reed College (in his hometown of Portland), the Los Angeles Music Center, the California School of Professional Psychology at Alliant International University, and the Institute for Advanced Study.
The group’s activism has ensured the return of art works like Sripuranthan Nataraja, Vriddchachlam Ardhanari (brought back from Australia), the Sripuranthan Uma and more. These have been returned with much fanfare during the visits of heads of state/government of Australia/Germany. You can see pictures of Modi with the returned Nataraja, Angela Merkel handing over the Kashmir Valley Durga (housed in Stuttgart) below.