The race to commercialize self-driving cars is in high gear. As carmakers and tech companies focus on creating sensors with more nuanced capabilities to achieve maximal effectiveness, efficiency, and safety, an interesting paradox has arisen: the human element has been dismissed. If machines are to seamlessly interact with humans, they must integrate the fundamentals that make us human like spontaneous rule-breaking behaviour. Bridging the gap between engineering and cognitive science, the case for bringing complex human cognition like collaborative real-time adaptive problem solving and decision-making back into the equation of perception R&D is presented and that intelligent improvisation is argued as the future