With consumers increasingly worried about privacy and data protection, organizations are under ever greater pressure to establish trust and transparency in data and information systems, with new regulations such as the EUâs GDPR raising the prospect of harsh financial penalties for compliance failures.
Digital ethics is also growing in importance to organizations, given concerns about how companies are using artificial intelligence (AI) to make opaque decisions with major ramifications for society.
Restoring trust in information systems was the central theme of an executive panel discussion at Global Female Leaders 2022, a conference involving ĂykĂŒ IĆık, Professor of Digital Strategy and Cybersecurity at IMD.
A big part of the solution, she said, is to strengthen digital governance from a regulatory perspective. But companies must also ensure effective internal governance surrounding the processing of sensitive information.
IĆık pointed to a broader digital responsibility for organizations to understand the impact of technologies on society, noting the potential for AI to displace vast swathes of the global labor force. âThis must be a prerequisite; managers as well as consumers must have a basic understanding of how technology works,â she said.
Yet levels of awareness are still low because of the opacity surrounding the decisions companies have reached through AI, given just how complex machine learning is becoming.
IĆık highlighted the ethical challenges by using real-world examples, such as Amazonâs âsexistâ AI recruiting tool that showed bias against women, and an algorithm that Uber used to verify driversâ identity that was allegedly biased and led the ride-hailing firm to unfairly dismiss drivers.
She also cited a scandal that engulfed the Dutch government recently after the countryâs tax authorities, trying to spot fraud among people applying for childcare benefits, used an algorithm that penalized certain families.
The examples underscore the potential negative implications of automated systems without the right safeguards in place, she said.
We need to make algorithms transparent and explainable; AI is a black box. We have a responsibility that if we are applying this in our organizations, there are things we should do to debias the data sets and the software development process. We also need someone watching over these systems.
Further, IĆık underscored the importance of enhancing companiesâ digital resilience to cyber-attacks. She noted a significant shift in thinking about the subject, from building great firewalls to keep hackers out, to accepting that a cyber breach is inevitable and focusing on damage limitation.
Another crucial aspect that businesses often get wrong is communication around a breach, she added. âThere are technical elements and leadership implications as well. A resilient organization has this mindset that regulations are coming around cybersecurity and AI, just like regulations on data protection and privacy did. So how can I be prepared as much as I can about this changing landscape of technology?â
Her co-panelist was Bertrand de La Chapelle, co-founder and executive director of the Internet & Jurisdiction Policy Network. He underscored the importance of data governance, a problem which has only been amplified by digital technologies.
The deluge of data and misinformation, and the vast array of connections enabled by the internet, is making it harder than ever for policymakers and regulators to understand the world. He said rising to this challenge will require greater coordination between all actors (public, private and civil society) at a time when society has never looked more polarized.
âThereâs a need for global dialogue and innovation,â de La Chapelle said, as he highlighted his recent launch of a âDatasphere Initiative1â with the mission to âresponsibly unlock the value of data for allâ. âThis century is the century of data,â he said. Current estimates suggest at least 2.5 quintillion bytes (a billion billions) are produced every day.
While de La Chapelle underlined the manifold challenges facing business and society, from planetary warming to economic inequalities and human rights abuses, he said there was enormous potential to leverage digital data for the good of humankind. âI strongly believe we can build frameworks that will build trust. I think it is possible to aim for a collective effort for the wellbeing of society.â
He called for a shift from traditional hierarchical systems of data governance to a multi-stakeholder approach in which the actors affected by rules and regulations are involved in the debate about their formulation. âWe need a systems approach to data governance,â de La Chapelle said — not just rules created by the EU, China and the US.
He also advocated for policymaking that transcends national borders, given the interconnections that exist today. âIn a digital field you may need a portion of your laws to apply to actors outside of your jurisdiction, but this needs to be done responsibly.â He pointed out that some US websites have blocked European users entirely, for fear of running afoul of the EUâs GDPR.
The former French diplomat thought that technology could help to make governance more manageable and transparent in the long run. âWe could have technical solutions that automate some of the biggest challenges of enforcement and validation.â
Ultimately, concluded IĆık, restoring trust in data and information systems was a work in progress with there still being much further for regulators and companies to go.
From the untamed rise of semi-autonomous agents to growing concerns around accountability and security risks, AI agents are creating new headaches for CIOs. Here's how tech leaders can navigate the challenges. ...
AI's true revolution isn't in chatbots but in transforming industrial operations through dark factories and predictive maintenance. This will require leaders to balance technological advancement with responsible societal impact....
In a world of deepfakes, hallucinations, and bias, we offer practical guidance on how you can trust your AI systems....
Audio available
Companies are rushing to embrace the game-changing opportunities to improve operations and scale that AI offers; yet many are unaware of the pitfalls. Test your knowledge of the risks here â and...
Explore first person business intelligence from top minds curated for a global executive audience