Memphis and San Diego are about 1,558 miles apart by road. Split the difference and you arrive near Albuquerque, the city closest to the halfway point between them. That puts roughly 19 hr 39 min of driving on the Memphis side and 13 hr 5 min on the San Diego side — the fairest single meeting point among the cities near the middle.
Over this distance most people will fly rather than drive the whole way. Albuquerque still makes a fair, central place for Memphis and San Diego to converge, splitting the travel instead of asking one side to cross the country.
If Albuquerque doesn't have what you're after, El Paso and Oklahoma City are also close to the midpoint and worth a look — each keeps the drive reasonably balanced between Memphis and San Diego.
City descriptions adapted from Wikipedia (CC BY-SA); photos via Wikimedia Commons, credited above.