The highlight of Kandy is the Temple of the Tooth and I spent most of my time there. What I found most interesting was all the people there. Every generation within a family comes along together and spends time in the temple - often just sitting on the floor and hanging out together. It's a lovely portrait of the people in Sri Lanka and their relationship with their religious buildings.
Kandy is a really easy city to get to and it has good train connections with other parts of Sri Lanka and it's a pleasant way to get in and out of the city.