Los Angeles and San Diego are about 111 miles apart by road. Split the difference and you arrive near Las Vegas, the city closest to the halfway point between them. That puts roughly 4 hr 47 min of driving on the Los Angeles side and 5 hr 33 min on the San Diego side — the fairest single meeting point among the cities near the middle.
At this range, Las Vegas works for a same-day meetup: close enough from both Los Angeles and San Diego to meet for lunch or an afternoon and still be home by evening.
If Las Vegas doesn't have what you're after, Phoenix and San Jose are also close to the midpoint and worth a look — each keeps the drive reasonably balanced between Los Angeles and San Diego.
City descriptions adapted from Wikipedia (CC BY-SA); photos via Wikimedia Commons, credited above.