The Caves and Ice Age Art are yet another prehistoric site with all the caveats that go along with it. There isn’t all that much to see. The findings were moved off site and are shown in several museums. As upside, I really enjoyed hiking along the Lone valley on a sunny summer day. And as the caves aren't that touristy you are free to explore them.
Getting There
Blaubeuren and Schelklingen are on the same train line from Ulm. The caves are found between Schelklingen and Blaubeuren. Seeing the Urgeschichtliches Museum is in Blaubeuren, it seems best to start at the far end in Schelklingen and end up at the museum at the end.
Getting to the Lone area is a bit trickier. The Archäopark Vogelherd has a shuttle bus to the train station in Niederstotzigen. Bihourly there is a direct bus (#59) from Ulm stopping in Öllingen (get off at Hirsch) for the Bocksteinhöhle and Stetten ob Lontal (get off at Kirche) for the Archäopark. My recommendation would be to start in Öllingen. From the bus stop it's a 30min walk to get to the Lone river. Be advised that the signposting in the area leaves much to be desired and that especially the area around the Bocksteinhöhle is a bit challenging.
Google Maps is wrong for the area. The location of the Bocksteinhöhle is wrong. And the buses are missing from the public transport connections. Our data meanwhile is correct. The best public transport information is available from Deutsche Bahn. This holds true for all of Germany (and some other countries, too).
While You Are There
Ulm is a pleasant city in the mold of Strasbourg. The most famous site is the Münster, the largest church tower and for a short period the largest building in the world. The city also offers great views of the Danube. If you are into Pile Dwellings, there seems to be one pretty close to Ulm.
One of Germany's top attractions, Neuschwanenstein, can be reached from Ulm via train to Füssen. From there buses will take you to the pseudo castle. Just follow the crowds. Some of the buses will continue to the pilgrimage church in Wies.
Stuttgart is an hour by train and there you can see one of Le Corbusier’s lesser works. Aalen to the North is on the Limes and the museum seems rather interesting. Via Friedrichshafen you can travel to St Gallen as a day trip. Finally, the Augsburg water works are on the tentative list.