This is one of the more somber world heritage sites you can visit, along with Auschwitz.
In addition to the park, I would also suggest visiting the museum which tells the history of the dropping of the atomic bomb and its aftermath in the city of Hiroshima.
While in Hiroshima, it is easy to visit the nearby Itsukushima Shrine.