Autonomous AI still requires human oversight in critical decisions
How does the human role change when AI moves beyond automation and begins to make decisions?
Are we prepared for autonomous systems that require constant human supervision?
There are moments when technology stops feeling like a distant tool and begins to quietly transform how people make decisions, work, and interact with their environment. That inflection point is now being marked by intelligent systems.
NTT DATA, a global company specializing in artificial intelligence, digital business, and technology services, presented a new edition of The Future Uncovered, a forum for dialogue with journalists, opinion leaders, and communicators across the region. This session focused on one of the trends identified in the NTT DATA Foresight 2026 report: “human-orchestrated autonomy,” which envisions a landscape where technological autonomy requires increasingly strategic human oversight.
Human-supervised autonomy.
Technology is entering a phase of profound transformation, possibly the most disruptive since the first Industrial Revolution: the shift from automation to autonomy. In this new environment, systems not only execute tasks but also analyze large volumes of information, learn from data, and make decisions in real time.
Shifting roles.
This shift is redefining the role of people within organizations. Time is moving away from operational tasks toward more strategic functions: interpreting, validating, deciding, and setting the criteria under which systems operate. The focus is no longer on “doing,” but on directing how things are done.
This trend is already visible across key sectors. In finance, algorithms analyze multiple variables and suggest credit decisions within seconds. In industry, autonomous systems adjust production processes and anticipate failures before they occur. In telecommunications, networks dynamically self-optimize to prevent congestion and improve user experience.
Trust in AI.
Amid this evolution, trust has become a central issue. For these technologies to be adopted sustainably, decisions must be understandable, traceable, and aligned with clear rules.
When this is not the case, risks can emerge, including decisions that are difficult to explain, potential biases, or mistrust among users and customers.
In this context, technology governance takes on a central role. It involves defining, from the design stage, what decisions systems can make, under what conditions, and when human intervention is required. It also requires establishing monitoring mechanisms to understand what happened in each case and why.
As explained by Carles Company Ros, Head of Business Process Services – Iberia, International Organisations, LATAM and Consulting in Benelux and France at NTT DATA:
“In this scenario, organizations that lead this transformation will be those capable of balancing three key dimensions: the speed of AI, system governance and transparency, and human oversight in critical processes. The future does not belong to machines, but to those who can orchestrate intelligence while keeping humans in control.”
NTT DATA noted that supporting organizations through this transformation process focuses on providing knowledge, capabilities, and frameworks that enable companies to translate the potential of AI into tangible results and broader operational impact.
|
|
