The largest savings usually come from changing the shape of the trip: travel in shoulder season, stay longer in fewer places, use an open-jaw flight when it avoids backtracking, and compare the total door-to-door cost of trains and flights.
Set a complete daily budget for lodging, food, local transit, attractions, and intercity travel. That makes a seemingly cheap city or fare comparable with the rest of the route.