...
MEASURING, ANALYZING, OPTIMIZING: WHEN INTELLIGENT MACHINES TAKE OVER SOCIETAL CONTROL
In the digital age, machines steer everyday life to a considerable extent already. We should, therefore, think twice before we share our personal data, says expert Yvonne Hofstetter
If Norbert Wiener (1894-1964) had experienced the digital era, for him it would have been the land of plenty. “Cybernetics is the science of information and control, regardless of whether the target of control is a machine or a living organism”, the founder of Cybernetics once explained in Hannover, Germany in 1960. In history, the world never produced such amount of data and information as it does today.
Cybernetics, a science asserting ubiquitous importance, makes a strong claim: “Everything can be controlled.” During the 20th century, both the US armed forces and the Soviet Union applied Cybernetics to control their arms’ race. The NATO had deployed so-called C3I systems (Command, Control, Communication and Information), a term for military infrastructure that leans linguistically to Wiener’s book on Cybernetics: Or Control and Communication in the Animal and the Machine, published in 1948. Control refers to the control of machines as well as of individuals or entire social systems like military alliances, financial markets or, pointing to the 21st century, even the electorate. Its major premise: keeping the world under surveillance to collect data. Connecting people and things to the Internet of Everything is a perfect to way to obtain the required mass data as input to cybernetic control strategies.
With Cybernetics, Wiener proposed a new scientific concept: the closed-loop feedback. Feedback—e.g. the Likes we give, the online comments we make—is a major concept of digitization, too. Does that mean digitization is the most perfect implementation of Cybernetics? When we use smart devices, we are creating a ceaseless data stream disclosing our intentions, geo position or social environment. While we communicate more thoughtlessly than ever online, in the background, an ecosystem of artificial intelligence is evolving. Today, artificial intelligence is the sole technology being able to profile us and draw conclusions about our future behavior.
An automated control strategy, usually a learning machine, analyzes our actual situation and then computes a stimulus that should draw us closer to a more desirable “optimal” state. Increasingly, such controllers govern our daily lives. As digital assistants they help us making decisions in the vast ocean of optionality and intimidating uncertainty. Even Google Search is a control strategy. When typing a keyword, a user reveals his intentions. The Google search engine, in turn, will not just present a list with best hits, but a link list that embodies the highest (financial) value rather for the company than for the user. Doing it that way, i.e. listing corporate offerings at the very top of the search results, Google controls the user’s next clicks. This, the European Union argues, is a misuse.
But is there any way out? Yes, if we disconnected from the cybernetic loop. Just stop responding to a digital stimulus. Cybernetics will fail, if the controllable counterpart steps out of the loop. Yet, we are free to owe a response to a digital controller. However, as digitization further escalates, soon we may have no more choice. Hence, we are called on to fight for our freedom rights—afresh during the digital era and in particular at the rise of intelligent machines.
For Norbert Wiener (1894-1964), the digital era would be a paradise. “Cybernetics is the science of information and control, regardless of whether a machine or a living organism is being controlled”, the founder of cybernetics once said in Hanover, Germany in 1960.
Cybernetics, a science which claims ubiquitous importance makes a strong promise: “Everything is controllable.” During the 20th century, both the US armed forces and the Soviet Union applied cybernetics to control the arms’ race. NATO had deployed so-called C3I systems (Command, Control, Communication and Information), a term for military infrastructure that linguistically leans on Wiener’s book entitled Cybernetics: Or Control and Communication in the Animal and the Machine published in 1948. Control refers to the control of machines as well as of individuals or entire societal systems such as military alliances, NATO and the Warsaw Pact. Its basic requirements are: Integrating, collecting data and communicating. Connecting people and things to the Internet of Everything is a perfect way to obtain the required data as input of cybernetic control strategies.
With cybernetics, a new scientific concept was proposed: the closed-loop feedback. Feedback—such as the likes we give or the online comments we make—is another major concept related to digitization. Does this mean that digitization is the most perfect implementation of cybernetics? When we use smart devices, we create an endless data stream disclosing our intentions, geolocation or social environment. While we communicate more thoughtlessly than ever online, in the background, an artificial intelligence (AI) ecosystem is evolving. Today, AI is the sole technology able to profile us and draw conclusions about our future behavior.
An automated control strategy, usually a learning machine, analyses our current state and computes a stimulus that should draw us closer to a more desirable “optimal” state. Increasingly, such controllers govern our daily lives. Such digital assistants help us to make decisions among the vast ocean of options and intimidating uncertainty. Even Google Search is a control strategy. When typing a keyword, a user reveals his intentions. The Google search engine, in turn, presents not only a list of the best hits, but also a list of links sorted according to their (financial) value to the company, rather than to the user. By listing corporate offerings at the very top of the search results, Google controls the user’s next clicks. That is a misuse of Google’s monopoly, the European Union argues.
But is there any way out? Yes, if we disconnect from the cybernetic loop and simply stop responding to the digital stimulus. Cybernetics will fail, if the controllable counterpart steps out of the loop. We should remain discreet and frugal with our data, even if it is difficult. However, as digitization further escalates, soon there may be no more choices left. Hence, we are called on to fight once again for our freedom in the digital era, particularly against the rise of intelligent machines.
______________________________________
ABOUT THE AUTHOR(S)
Dirk Helbing
Dirk Helbing is Professor of Computational Social Science at the Department of Humanities, Social and Political Sciences and affiliate professor at the Department of Computer Science at ETH Zurich. His recent studies discuss globally networked risks. At Delft University of Technology he directs the PhD programme "Engineering Social Technologies for a Responsible Digital Future." He is also an elected member of the German Academy of Sciences "Leopoldina" and the World Academy of Art and Science.
Bruno S. Frey
Bruno Frey is an economist and Visiting Professor at the University of Basel, where he directs the Center for Research in Economics and Well-Being (CREW). He is also Research Director of the Center for Research in Economics, Management and the Arts (CREMA) in Zurich.
Gerd Gigerenzer
Gerd Gigerenzer is Director at the Max Planck Institute for Human Development in Berlin and the Harding Center for Risk Literacy, founded in Berlin in 2009. He is a member of the Berlin-Brandenburg Academy of Sciences and the German Academy of Sciences "Leopoldina". His research interests include risk competence and risk communication, as well as decision-making under uncertainty and time pressure.
Recent Articles
Ernst Hafen
Ernst Hafen is Professor at the Institute of Molecular Systems Biology at ETH Zurich and also its former President. In 2012, he founded the initiative "Data and Health." The initiative's intention is to strengthen citizens' digital self-determination at a political and economic level, as well as to encourage the establishment of organised cooperative databases for personal data.
Michael Hagner
Michael Hagner is Professor of Science Studies at ETH Zurich. His research interests include the relationship between science and democracy, the history of cybernetics and the impact of digital culture on academic publishing.
Yvonne Hofstetter
Yvonne Hofstetter is a lawyer and AI expert. The analysis of large amounts of data and data fusion systems are her specialities. She is the Managing Director of Teramark Technologies GmbH. The company develops digital control systems based on artificial intelligence, for, among other purposes, the optimisation of urban supply chains and algorithmic currency risk management.
Jeroen van den Hoven
Jeroen van den Hoven is University Professor and Professor of Ethics and Technology at Delft University of Technology, as well as founding Editor in Chief of the journal of Ethics and Information Technology. He was founding Chairman of the Dutch Research Council program on Responsible Innovation and chaired an Expert Group Responsible Research and Innovation of the European Commission. He is member of the Expert Group on Ethics of the European Data Protection Supervisor.
Roberto V. Zicari
Roberto V. Zicari is Professor for Databases and Information Systems at the Goethe University Frankfurt and Big Data expert. His interests also include entrepreneurship and innovation. He is the founder of the Frankfurt Big Data Lab at the Goethe University and the editor of the Operational Database Management Systems (ODBMS.org) portal. He is also a Visiting Professor at the Center for Entrepreneurship and Technology of the Department of Industrial Engineering and Operations Research at the University of California at Berkeley.
Andrej Zwitter
Andrej Zwitter is Professor of International Relations and Ethics at the University of Groningen, in the Netherlands, and Honorary Senior Research Fellow at Liverpool Hope University, U.K. He is the co-founder of the International Network Observatory for Big Data and Global Strategy. His research interests include international political theory, emergency and martial law, humanitarian aid policy, as well as the impact of Big Data on international politics and ethics.
|