Digital technologies are increasingly transforming how citizens interact with public administration. Chatbots, agents, and other AI-supported systems are already in use across many public agencies – for answering inquiries, providing information, or assisting through service portals. But what does this transformation mean for the quality of communication and how it is perceived by citizens?
Our Goal
This project investigates how communication between citizens and public administration changes when human interaction is supplemented or replaced by artificial intelligence. The aim is to generate scientific insights into the effects of different forms of communication. In collaboration with public sector partners, we seek to identify ways to ensure linguistic equity (“communicative fairness”) and strengthen public trust in government services.
What We Do
The project analyzes real-world conversations in public service settings and compares them to AI-supported dialogue systems. We evaluate audio recordings of anonymized service encounters and then construct experimental scenarios involving AI systems. Using natural language processing (NLP) techniques, we examine how language functions and affects citizen perceptions—both in terms of content and emotional tone—and whether communication patterns differ across various population groups.
About the Project
The research project is funded through an ERC Consolidator Grant and runs for five years at Zeppelin University. Its official title is “BiASE-AI – Biases in Administrative Service Encounters: Transitioning from Human to Artificial Intelligence.”
Funding: European Research Council (ERC), 2025–2030.
Project Team:
Selected Publications:
Eckhard, S., & Friedrich, L. (2024). Linguistic features of public service encounters: How spoken administrative language affects citizen satisfaction. Journal of Public Administration Research and Theory, 34(1), 122–135. https://doi.org/10.1093/jopart/muac052
Siskou, W., & Espinoza, I. (2024). “So, are you a different person today?” Analyzing bias in questions during parole hearings. In Proceedings of the Second Workshop on Social Influence in Conversations (SICon 2024) (pp. 116–128). Miami, FL: Association for Computational Linguistics.
Itani, A., Siskou, W., & Hautli-Janisz, A. (2024). Automated anonymization of parole hearing transcripts. In Proceedings of the Natural Legal Language Processing Workshop 2024 (pp. 115–128). Miami, FL: Association for Computational Linguistics.
Espinoza, I., Frenzel, S., Friedrich, L., Siskou, W., Eckhard, S., & Hautli, A. (2024). PSE v1.0: The first open access corpus of public service encounters. Paper presented at the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024).
Eckhard, S., Espinoza, I., Frenzel, S., Friedrich, L., Hautli-Janisz, A., & Siskou, W. (2024). Public Service Encounters (PSE) Corpus v1.0. Retrieved from https://doi.org/10.7910/DVN/GHZKIG
Eckhard, S., Espinoza, I., Frenzel, S., Hautli-Janisz, A., Siskou, W. (2023). Language and Power. Computational analysis can help us understand inequalities in communication. In_equality Magazine No. 5. https://www.exc.uni-konstanz.de/en/inequality/research/publications/in-equality-magazine/
Eckhard, S., & Friedrich, L. (August 2022). Kommunikation ist alles. Wie gesprochene Verwaltungssprache die Bürgerzufriedenheit erhöhen kann. Behördenspiegel, 08/2022.
Eckhard, S., Friedrich, L., Hautli-Janisz, A., Mueden, V., & Espinoza, I. (2022). A taxonomy of administrative language in public service encounters. International Public Management Journal, 27(1), 60–75. https://doi.org/10.1080/10967494.2022.2075062
Siskou, W., Friedrich, L., Eckhard, S., Espinoza, I., & Hautli-Janisz, A. (2022). Measuring plain language in public service encounters. In Proceedings of the 2nd Workshop on Computational Linguistics for Political Text Analysis (CPSS-2022), Potsdam, Germany. https://old.gscl.org/en/arbeitskreise/cpss/cpss-2022/workshop-proceedings-2022
International organizations (IOs) and their administrations are key players in tackling global policy challenges. They have been central to some of humanity’s greatest achievements, such as the eradication of contagious diseases, the reduction of extreme poverty and global access to basic education. Increasingly, however, the organizations of the liberal international system are the focus of criticism and politicization. The research project aims to explore the consequences of these dynamics for the performance of IOs in policy implementation.
Although a number of case and comparative studies at the organizational level already exist, the data and instruments for comparative research on IOs in policy implementation – that is, at the level of projects and programs – have been lacking until now. The research project will close this crucial gap.
It focuses on the compilation of a comprehensive corpus of over 25,000 publicly available evaluation reports from 42 IOs of the United Nations system and the analysis of this data using current techniques of computer-assisted text analysis. Against this background, the project pursues four interrelated objectives:
1. Empirical and methodological development: The project creates and publishes a comprehensive data set with a large number of quantitative performance measurements based on evaluation reports. This dataset will be analyzed and annotated using computer-based natural language processing. Even beyond the research questions of this project, it offers a valuable resource for research on international organizations.
2. Conceptual and theoretical innovation: The project breaks down the concept of organizational performance into several dimensions and explores how these are influenced by political and bureaucratic factors in the context of increasing politicization and legitimacy pressures. Particular attention is paid to clarifying potential conflicts of interest between the short- and long-term dimensions of performance.
3. Scientific development: At the interface of literature on international relations and public administration, the project further develops the still young research on ‘international public administrations (IPA)’ and cooperates closely with colleagues from the field of international relations.
4. Practical transfer: The data and methods will provide practitioners with new ways of measuring policy outcomes and assessing the learning outcomes of IOs. Against this background, the applicant cooperates with organizations such as the United Nations Development Programme (UNDP) and the United Nations International Children's Emergency Fund (UNICEF), which ensures the practical applicability and dissemination of the knowledge gained. Overall, the project makes an important contribution to improving the global governance of IOs and their transparency.
Funding: Deutsche Forschungsgemeinschaft (2025-2028).
Related Publications:
Eckhard, S., Jankauskas, V., Leuschner, E., Burton, I., Kerl, T., & Sevastjanova, R. (2023). The Performance of International Organizations: A New Measure and Dataset Based on Computational Text Analysis of Evaluation Reports. Review of International Organizations. doi:10.1007/s11558-023-09489-1
Project Team:
Following on from the success
of the HybOrg project, the InnoLoK research project focuses on local
administrative crisis management. The collaborative research project is being
coordinated by Prof. Dr. Steffen Eckhard and involves partners from Zeppelin
University, Fraunhofer
ISI as well as Hochschule Kehl. It is part of the funding line "Social
Impact of the Corona Pandemic - Research for Integration, Participation and
Renewal" of the German Federal Ministry of Education and Research.
Focusing on the Covid-19-Pandemic, the project addresses the question of the impact of the crisis on social cohesion in Germany. On the one hand, the project examines how groups were affected and how they interacted with each other in society. On the other hand, it focuses on the role of administrative action in managing the pandemic. The extent to which innovations emerged during the crisis and how variation in administrative action in German counties affected communities is explored both theoretically and empirically.
Funding: Federal Ministry of Research, Technology, and Space (2023-2026).
Related Publications:
Lenz, A., & Eckhard, S. (2022). Conceptualizing and explaining flexibility in administrative crisis management – a cross-district analysis in Germany. Journal of Public Administration Research and Theory. doi:10.1093/jopart/muac038
Behnke, N., & Eckhard, S. (2022). A systemic perspective on crisis management and resilience in Germany. Introduction to the special issue. dms – der moderne staat, 15(1), 1-17. doi:10.3224/dms.v15i1.11
Lenz, A., Eckhard, S., Obermaier, K., &
Hoffmann, P. (2022). Wie nimmt die Bevölkerung das Krisenmanagement während
der Corona-Pandemie wahr? Repräsentative Bevölkerungsbefragung zur öffentlichen
Wahrnehmung in der Corona-Pandemie. Retrieved from University of Konstanz: http://nbn-resolving.de/urn:nbn:de:bsz:352-2-cwtrntsqw5wm2
Eckhard, S., Lenz, A., Seibel, W., Roth, F., & Fatke, M. (2021). Latent Hybridity in Administrative Crisis Management: The German Refugee Crisis of 2015/16. Journal of Public Administration Research and Theory, 33(2), 416–433. doi:10.1093/jopart/muaa039
Project Team:
Since November 2022, the chair has been cooperating with the German Society for International Cooperation (GIZ) to support its Evaluation Unit in setting up the infrastructure and methodology for computer-based text analysis of evaluation reports. The organization has been conducting evaluations of its projects for many years and also has a large amount of additional text-based data, such as reports. These documents provide a valuable source for future evaluations and are to be made available for future analysis within the framework of the project.
Project Team:
Prof. Dr. Steffen Eckhard (Zeppelin University)
Dr. Vytautas Jankauskas (Zeppelin University)
Daniel Baumann (Zeppelin University)
Sebastian Korb (Zeppelin University)
The project “Linguistic Analysis of Public Service Encounters“ systematically studies face-to-face interactions between public administrators and citizens. It aims to develop a procedure for measuring linguistic communication processes in the interaction of public administration with citizens.
The research project builds upon the current state of knowledge on addressing societal diversity in the provision of public services. This topic has long attracted the interest of empirical administrative research and is highly relevant in everyday public administration practice. Nevertheless, there is still very little scientific knowledge about the demands on civil servants due to dealing with people from a wide range of cultural and social backgrounds in the provision of services. The role of administrative language in direct encounters with citizens has remained completely unaddressed in this context.
The interdisciplinary project combines computer-based linguistic analysis on the one hand and political science and public administration analytical methods on the other. Researchers from the University of Konstanz, the University of Passau and the Chair of Public Administration and Public Policy at Zeppelin University are involved.
Funding: Cluster of Excellence „The Politics ofInequality” at the University of Konstanz.
Related Publications:
Eckhard, S., & Friedrich, L. (2022). Linguistic features of public service encounters: How spoken administrative language affects citizen satisfaction. Journal of Public Administration Research and Theory. doi:10.1093/jopart/muac052
Eckhard, S., Friedrich, L., Hautli-Janisz, A., Mueden, V., & Espinoza, I. (2022). A taxonomy of administrative language in public service encounters. International Public Management Journal. doi.org/10.1080/10967494.2022.2075062 (1.72).
Siskou, W., Friedrich, L., Eckhard, S., Espinoza, I., & Hautli-Janisz, A. (2022). Measuring Plain Language in Public Service Encounters. Paper presented at the Proceedings of the 2nd Workshop on Computational Linguistics for Political Text Analysis (CPSS-2022) Potsdam, Germany. https://old.gscl.org/en/arbeitskreise/cpss/cpss-2022/workshop-proceedings-2022
Project Team:
International interventions are common in today's world. States, intergovernmental organizations and non-state actors routinely engage in a wide range of activities - development aid, disaster relief, humanitarian assistance, and peace operations - that aim to change political, economic and/or social conditions in sovereign states other than their own. The effectiveness of these interventions depends crucially on how well intervening actors understand local realities, perspectives, and priorities.
Yet while there is near universal agreement among scholars and practitioners about the importance of local knowledge in peacebuilding - and in other international interventions - there is no consensus on what local knowledge is, much less how best to access it. In practice, moreover, intervenors not only struggle to integrate local knowledge in their decision-making but also face incentives not to do so. In short, while local knowledge is vital to the success of international interventions, it is notoriously difficult for outsiders to acquire and intervenors are inconsistent in weather, how and why they seek to access it.
The essential task of this project is to theorize and empirically study the mechanisms by which international interveners can gain local knowledge about the societies in which they operate.
The Peacebuilding and Local Knowledge Network (PLKN) brings together a diverse group of scholars and practitioners to foster more informed public discussions about local peacebuilding interventions, with the aim of contributing evidence-based recommendations to influence the development of more effective and responsible local peacebuilding policies and practices.
Funding: The Peacebuilding and Local Knowledge Network (PLKN) is funded by the Canadian Research foundation SSHRC for a period of three years.
Related Publications:
von Billerbeck, S., Coleman, K. P., Eckhard, S., & Zyla, B. (2024). Local Knowledges in International Peacebuilding: Acquisition, Filtering, and Systematic Bias. International Studies Review, 26(4). doi:10.1093/isr/viae047
Eckhard, S. (2020). Bridging the citizen gap: Bureaucratic representation and knowledge linkage in (international) public administration. Governance, online first. doi:doi:10.1111/gove.12494
Eckhard, S. (2019). Comparing how peace operations enable or restrict the influence of national staff: Contestation from within? Cooperation and Conflict, 54(4), 488–505. doi:10.1177/0010836718815528
Eckhard, S. (2014). Bureaucratic Representation and Ethnic Bureaucratic Drift: A Case Study of United Nations Minority Policy Implementation in Kosovo. American Review of Public Administration, 44(5), 600-621.
Project Team:
Prof. Dr. Sarah von Billerbeck (The University of Reading)
Prof. Dr. Katharina Coleman, (The University of British Columbia)
Prof. Dr. Steffen Eckhard (Zeppelin University)
Prof. Dr. Benjamin Zyla (University of Ottawa)
Evaluation has experienced spectacular proliferation at the international level. Today, the vast majority of international organizations (IOs) have institutionalized evaluation as an integral part of their organizational practices. More than 160 full time evaluators with several thousand expert consultants are now working in the UN system as compared to only 60 officers in the 1980s. Hundreds of reports are produced annually by major IOs and the number is growing. In the UN system, around 700 reports are produced each year which should lead to annual IO-evaluation expenses of up to half a billion Euros (about the entire annual budget of UNESCO or ILO).
Essentially, evaluation has become the ‘mantra of modernity’. Its main strength, as seen by the UN, is the ability “to provide evidence that is robust, valid, reliable and credible and can be used with confidence in decision-making” (JIU 2014a, p. 2). This is how policy makers typically conceive of evaluation – as a functional tool in the final phase of a cyclical policy process.
Yet, does evaluation really deliver on its promise of scientific evidence and policy adjustment? Contributing to such broader questions about the (in-)effectiveness of evidence-based policymaking, the project challenges the conventional understanding of evaluation as a value-free activity and demonstrates how a seemingly neutral technocratic tool can serve as an instrument for power in international governance.
While the first phase of the project (2017-2020) analysed the political use of evaluation in IOs, the second phase (2021-2023) delves into evaluation reports themselves, scrutinizing their content and potential political biases.
Following a mixed-method research design, we conducted field research with over 70 interviews at 19 international organizations, and even participated in training exercises for professional evaluators, to gain qualitative insights into evaluation processes. At the same time, creation of an original databank with 2,000 evaluation reports for the first time allowed to quantitatively scrutinize the actual content of IO evaluation reports, aiming at the identification of systematic political biases.
The project is associated to the DFG Research Unit "International Public Administration".
Research grant: Phase I: 223.644 Euro, Phase II: 237.292 Euro, funded by DFG (2017-2023).
Related Publications:
Eckhard, S., Jankauskas, V., & Leuschner, E. (2023). Institutional Design and Biases in Evaluation Reports by International Organizations. Public Administration Review. doi:10.1111/puar.13697
Eckhard, S., Jankauskas, V., Leuschner, E., Burton, I., Kerl, T., & Sevastjanova, R. (2023). The Performance of International Organizations: A New Measure and Dataset Based on Computational Text Analysis of Evaluation Reports. Review of International Organizations. doi:10.1007/s11558-023-09489-1
Eckhard, S., Jankauskas, V. (2023): The Politics of Evaluation in International Organizations. Oxford University Press.
Eckhard, S., Jankauskas, V. (2020): Explaining the political use of evaluation in international organizations. Policy Sciences 53, 667–695, https://doi.org/10.1007/s11077-020-09402-2.
Jankauskas, V., Eckhard, S. (2019): International Bureaucracies as Strategic Actors: How the Better Regulation Reform Strengthens the European Commission. Politische Vierteljahresschrift. 60, 681–699,
https://doi.org/10.1007/s11615-019-00189-3.
Eckhard, S., Jankauskas, V. (2019): The Politics of Evaluation in International Organizations: A comparative Study of Stakeholder Influence Potential. Evaluation. 25(1), https://doi.org/10.1177%2F1356389018803967.
Project Team:
Prof. Dr. Steffen Eckhard (Zeppelin University)
Dr. Vytautas Jankauskas (Zeppelin University)
Sebastian Korb (Zeppelin University)
Daniel Baumann (Zeppelin University)
Ian Burton (University of Exeter)
The research project created a dataset of 65,000 speeches from UN Security Council meetings taking place between 1995-2020. The team extracted the speech data from 5,000 meeting transcripts, and the dataset includes metadata regarding each speakers’ affiliation, the position of the speech in a sequence of speeches in a meeting, and the date of the speech.
Schönfeld, M., Eckhard, S., Patz, R., & van Meegdenburg, H. (2019). The UN Security Council Debates Dataset. Harvard dataverse: https://doi.org/10.7910/DVN/KGVSYH
Related Publications:
Eckhard, S., Patz, R., Schönfeld, M., & van Meegdenburg, H. (2021). International bureaucrats in the UN Security Council debates: A speaker-topic network analysis. Journal of European Public Policy, 1-20. https://doi.org/10.1080/13501763.2021.1998194
Our article combines natural language processing and network analysis to study the role of UN-bureaucracy in UNSC focusing on the debates on Afghanistan (1995-2017). We observed speaker position, topic introduction, and topic evolution and complemented the analysis with an illustrative case study on one “bureaucratic topic”. Our findings show that despite their general impartiality, UN Secretariat members sometimes acted as autonomous speechmakers, shaping the debate even in venues such as the UNSC where bureaucratic agency seems unlikely.
The authors also published an online tool that enables users to navigate the speech corpus used for the analysis: https://shiny.mircoschoenfeld.de/unsc_afg/
Schönfeld, M., Eckhard, S., Patz, R., & van Meegdenburg, H. (2019). The UN Security Council debates 1995-2017. https://arxiv.org/abs/1906.10969.
The dataset introduction paper offers a detailed description of the creation of the dataset as well as some basic statistics. After contextualizing the dataset in recent research on the UNSC, the paper presents descriptive statistics on UNSC meetings and speeches that characterize the period covered by the dataset. Data highlight the extensive presence of the UN bureaucracy in UNSC meetings as well as an emerging trend towards more lengthy open UNSC debates. These open debates cover key issues that have emerged only during the period that is covered by the dataset, for example the debates relating to Women, Peace and Security or Climate-related Disasters.
Project Team:
Prof. Dr. Steffen Eckhard (Zeppelin University)
Prof. Dr. Mirco Schönfeld (Bayreuth University),
Dr. Ronny Patz (Hertie School of Governance)
Prof. Dr. Hilde van Meegdenburg (Leiden University)
During its duration between
2018 and 2021, the HybOrg research project focused on the administrative
management of the so-called refugee crisis in Germany between 2015 and 2016,
asking about the societal effect of variation in local crisis management (Landkreise
and kreisfreie Städte). Supported by the German Federal Ministry of Education
and Research, the three-year project aimed to create a systematic record of
administrative action within the realm of crisis management, analyze its
effects on social cohesion, and formulate a set of concrete recommendations for
relevant stakeholders.
HybOrg was a collaborative research project which was coordinated by Prof. Dr. Wolfgang Seibel (University Konstanz) and involved researchers at ETH Zurich, LMU Munich, and University of Konstanz.
Research grant: 634.339 Euro, funded by the German Ministry for Education and Research (BMBF) (2018-2021).
Related Publications:
Eckhard, S., Lenz, A., Seibel, W., Roth, F.,
& Fatke, M. (2021). Latent hybridity in administrative crisis management:
The German refugee crisis of 2015/16. Journal of Public Administration
Research and Theory, 31(2), 416-433.
Eckhard, Steffen & Behnke, Nathalie (2022), A systemic perspective on crisis management and resilience in Germany. dms – der moderne staat – Zeitschrift für Public Policy, Recht und Management, 15(1), 3-19. https://doi.org/10.3224/dms.v15i1.11
Lenz, Alexa (2021). Trust in Times of Crisis: The Pitfalls of cooperation between Volunteers and Local Government. dms – der moderne staat – Zeitschrift für Public Policy, Recht und Management. 15(1), 130-148. https://doi.org/10.3224/dms.v15i1.09
The SDIPA project was an international research collaboration project administered by Universität Konstanz (Steffen Eckhard) and Charles University (Michal Parizek), that studied the administrations of international organizations.
The aim of the SDIPA project was
to understand the challenges and opportunities linked to the geographical
diversity in international organizations with a focus on the interaction
between international and national staff in country offices. The project sought
to understand how each staff group contributes to the success of country
operations, how teams in international organizations should ideally be
composed, and how country offices can manage and leverage diversity.
In the summer of 2019, the SDIPA survey was implemented (306 replies). The survey included a participant lottery for 5 Amazon vouchers which was conducted in December 2020. Remaining participants received a copy of the results. The data analysis was conducted in autumn 2019, manuscript submission and revision took place between spring 2020 and summer 2020, the project findings are now published in the Journal of Comparative Public Policy.
Related Publications:
Eckhard, S., & Parizek, M. (2020). Policy implementation by international organizations: A comparative analysis of strengths and weaknesses of national and international staff. Journal of Comparative Policy Analysis: Research and Practice. doi:10.1080/13876988.2020.1813032
Download the SDIPA survey report here (pdf).