Detroit and Milwaukee are about 252 miles apart by road. Split the difference and you arrive near Chicago, the city closest to the halfway point between them. That puts roughly 4 hr 58 min of driving on the Detroit side and 2 hr 2 min on the Milwaukee side — the fairest single meeting point among the cities near the middle.
At this range, Chicago works for a same-day meetup: close enough from both Detroit and Milwaukee to meet for lunch or an afternoon and still be home by evening.
If Chicago doesn't have what you're after, Indianapolis and Cleveland are also close to the midpoint and worth a look — each keeps the drive reasonably balanced between Detroit and Milwaukee.
City descriptions adapted from Wikipedia (CC BY-SA); photos via Wikimedia Commons, credited above.