Ubeda and Baeza are two of the most gorgeous cities I have ever been too. We spent hours just wandering the streets and trying to cram in a visit to every historic building open to the public.
What was best was that it wasn't full of tacky touristy-ness, we were two of only about 5 English speakers that we saw all day. Hooray.
All the staff in the museums/churches etc were very polite and helpful and patient enough to listen to my beginner level Spanish.
Just watch out for little old ladies who will be your best friend and offer to show you their houses - in an attempt to make you buy their wares or give them a few Euros for their troubles...