eISSN: 2300-6722
ISSN: 1899-1874
Medical Studies/Studia Medyczne
Current issue Archive Manuscripts accepted About the journal Supplements Editorial board Abstracting and indexing Subscription Contact Instructions for authors Ethical standards and procedures
Editorial System
Submit your Manuscript
2/2024
vol. 40
 
Share:
Share:
Original paper

Publishing results of medical research: the effect of pressure or a natural intention to advance scientific knowledge?

Jarosław Karpacz
1
,
Konrad Januszewski
1
,
Aleksandra Pisarska
1

  1. Faculty of Law and Social Science, Jan Kochanowski University, Kielce, Poland
Medical Studies/Studia Medyczne 2024; 40 (2): 187–200
Online publish date: 2024/06/29
Article file
- Publishing results.pdf  [6.14 MB]
Get citation
 
PlumX metrics:
 

Introduction

Universities, financed mainly from public funds, including those with medical status, have for some time been encouraged to operate in accordance with the principles of New Public Management due to existing solutions regulating the higher education system [1–3]. In practice, this means that their operating mode is becoming similar to the one that corporations have, and they are therefore dominated by the concept of excellence [4], the main measure of which (in relation to universities) is the level of publishing activity of university employees [5–7]. It is therefore not surprising that this type of orientation of universities leads to widespread pressure from the managing authorities of these units/entities to intensify the publication of research results by their employees [8]. Owing to this, universities can present themselves as research-oriented institutions, and the scientific prestige built on this foundation affects funding. Universities encourage their researchers to publish their research results even more intensively in world-renowned journals. This mechanism makes employees feel that they are becoming “creative machines” [9]. It is sometimes noted that this type of orientation of public universities has contributed to reducing the number of differences between European and American universities [10], in which the employment of a scientist is closely related to their ability to produce high-quality publications.
Shaping university excellence requires appropriate tools and measures of results, such as journal rankings. Their use triggers much broader implications than those intended to discipline scientists and increase their scientific performance [4]. For instance, a broad academic debate points to the inevitable consequences of the “publishing game” caused by journal rankings and their sometimes-uncritical use, leading to the release of the idea called “you exist where you publish” [11]. This approach may primarily pose a threat to the diversity and innovation of research, to research traditions and niche research areas [12], as well as trigger excessive competition among scientists. This may threaten the quality of scientific research and, in consequence, also education.
We expect that the issue discussed in this article will contribute to this academic debate and reveal the question of publishing scientific research results in one of the extremely important social areas of knowledge, namely medicine. In our opinion, it will provide arguments to answer the question concerning the ways in which institutional and environmental pressure influenced the publication activity of scientists in this scientific discipline at Polish medical universities. We assumed that the publication pressure is the result of the corporatisation of medical universities in Poland, which has been strengthening over recent years, as shown by the results of recently conducted research in this area [13]. At the same time, publication pressure, in our definition, is constituted by a phenomenon increasing the intensity of publishing to a level higher than the one resulting from the natural pursuit of knowledge development through dissemination (publishing) of the results of research projects and motives resulting from the narcissism of scientists [14].
In this context, the aim of this study is to identify the intensity of publishing activity among medical researchers at Polish universities.
This intention will be achieved by using bibliometric analysis based on quantitative indicators illustrating the publication activity of employees of medical universities in Poland, who located the results of their research efforts in the area of “medicine”, and those efforts were published in the years 2017–2023. Additionally, we would like to reveal the main topic clusters in which these publications appeared, the inclusion of which in an article is generally believed to increase researchers’ chances of having it published in a prestigious journal. We expect that the results of our research in this area will complement observations and reveal a part of the broad scientific landscape related to the “publishing game”. It may influence the choice of a research topic, given that researchers are aware that the probability of being published in certain journals depends not only on the quality of their research, but also on the topic discussed. Additionally, they may perceive some of the top journals as not being as general as their mission defines them, because evidence might suggest that they do not publish the most cited articles in certain topical and methodological areas. Therefore, this phenomenon, especially in medical sciences, is considered undesirable [15]. A publication should not be considered as guiding the first stage of the research process. In addition, we will complement these observations, using appropriate indicators, recognising the significance of published scientific works, and therefore their impact on the research community, and thus their potential importance for the development of knowledge.
Theoretical background
The global landscape of contemporary higher education is shaped by the neoliberal policy of performativity and marketisation [16]. Although with varying intensity and speed, neoliberal behaviours and norms have been incorporated into organisational practices and expressed in the policies of public universities around the world [17], including in Poland [13]. The neoliberal path of these entities has resulted in new control mechanisms that have consequences for the conditions of conducting research, achieving scientific prestige and developing a reputation [18]. In these circumstances, publishing research results in prestigious journals is an important instrument with various individual and institutional consequences [19]. It is not controversial that publishing is essential for a scientist’s professional growth and important for developing their careers [20]. It is argued that dissemination of research results is the final stage of any research project, and it can be stated that only through the publication of research results can any individual project contribute to the overall knowledge in a given discipline. The accumulation of knowledge that comes from a continuum of scientific research conducted over centuries that we know about today is crucial to the development of a given profession. Research constitutes creative and systematic work conducted with the aim of increasing knowledge about people, the environment, culture, and society and using this knowledge to develop new applications [21]. Research is used to establish or confirm facts, confirm the results of previous work, solve problems, support theories, or develop new ones.
The scientific (publication) achievements resulting from research defined in this manner are a standard criterion of the effectiveness of individual researchers and research institutions [21]. The growing prestige and emphasis on the number of publications increases competition between researchers. This competition has traditionally been considered as an incentive to produce high-quality studies, but in practice there are also undesirable consequences of this hyper-competitive publishing climate in which a scientist is judged primarily on the number of publications. This may result in putting pressure on researchers to publish [22]. Publication pressure is being studied for its impact on research integrity since it can persuade researchers to cut corners [23]. Publication pressure is also associated with burnout among senior scientists, as well as with young researchers leaving their academic careers [24].
The problem is even more serious when we take into consideration the fact that the previously mentioned original purpose of a publication, which is the development and dissemination of knowledge, may be lost, which suggests the danger of shifting this purpose with possible harmful consequences for the strategies of individual researchers and research teams [10]. The abundant literature reveals critical issues and ambiguities related to the measurement of universities’ performance [25], showing that linking financial incentives and career development with publication indicators has a significant impact on reorienting individual behaviours of scientists [9, 26].
This issue is also present in the field of medical science, which has a vast scope and is essential for treating diseases and improving the health of individuals and the entire population, with the ultimate goal of extending knowledge beyond what is already known. A person’s (researcher’s) knowledge will only contribute to developing science when it is presented to others for an independent assessment of its validity. For this purpose, it is necessary to publish articles mainly in prestigious scientific journals, which increases the chances of contributing to the expansion of knowledge of the medical community, as well as the researcher’s recognition and well-deserved professional benefits (including awards), which will potentially encourage them to further research. In this form, this mechanism shows practically no controversies. However, if we take into account the pressure exerted by university management authorities, in accordance with the concept of university management [9], on medical scientists employed in those entities with the aim of increasing the number of prestigious publications, this mechanism may transform its current status based on scientific knowledge and environmental prestige, releasing pressure that may have a negative impact on the quality of research. This, in turn, may cause an interaction between high working demands and low resources among medical scientists [27], i.e. stress, development of predatory journals and manuscript writing services, a decrease in the quality of scientific publications, and a mad race for publications.
Moreover, it may lead to the belief that there is only one option – publish or perish. Under current rules, research publications in indexed journals are mandatory for promotion at many public medical universities. Additionally, quantitative measures of scientific achievements are the basis for financial rewards and grants awarded to scientists, and career development opportunities, prestige, and status depend on their implementation [28], but not only them – the intensity of competition between scientists as well. However, competition for publications and research funding is itself a driving force for scientists, increasing the effectiveness of their activities. For this reason, indicators of scientific achievement are, as already indicated, used as a parameter for assessing the effectiveness of both individual scientists conducting medical research and medical universities [28], which sometimes combine the number of publications with the selection and promotion of employment and education in medical fields of study. This increases the pressure on researchers also in the field of medical sciences to publish in prestigious journals. This increased pressure on scientific achievements has been accompanied by an enormous increase in the number of publications and publishers in recent decades. In these circumstances, there are concerns that scientists want to obtain “publish-ready” results, which may be at the expense of quality, validity, scientific rigor, and personal integrity. The matter is even more serious when we note that the potential negative effects of the publication pressure are less frequently highlighted in the literature [29], while it has been shown that unreliable medical research results are not uncommon. For instance, a recent study [30] found that 4.2% of authors who published in major journals dedicated to medical imaging had committed research fraud in the last 5 years, and 25.4% had witnessed or suspected a research fraud committed by faculty colleagues in the past 5 years. Fraud in medical imaging research was more common among younger scientists. Another recent study found that the number of withdrawn publications in medical sciences is still increasing, with scientific unreliability being the primary cause of this phenomenon. These data are disturbing. On the one hand, they may undermine confidence in the findings contained in medical publications. On the other hand, unreliable research may harm patient care and, as a consequence, may threaten the patient’s health and, in severe cases, even life. The pressure on researchers to publish more and in high-impact journals is the main reason that can provoke scientific unreliability. This, in turn, in the case of medical research, may result in a real threat to clinical practice based on research results [28]. Additionally, stress and burnout symptoms caused by the pressure to increase the number of scientific publications may also impact the poor mental well-being of physicians and residents, and consequently patient care, education and research.
Recent research has critically assessed the cultural, institutional, and organisational factors that may persuade academics to focus on research publications in specific journals, possibly at the expense of originality and intellectual innovation rather than research results per se (e.g. [31, 32]). The pressure to publish in the leading science journals encourages scientists to prioritise established publication trends, in particular by “gap hunting” to accelerate incremental knowledge production at the expense of bypassing interesting and influential research areas [33]. Some researchers warn that such practices lead to intellectual stagnation, conformism, and conservatism [34].
On the other hand, there is concern that the expectation of publishing in journals that are at the top of the ranking lists may reduce research to a game of academic politics, marginalising researchers who do not possess the required political skills [34]. This is a problem particularly for young researchers and for those at non-elite universities, as shown by research conducted among academics. Some authors therefore criticise the use of assessments based on quantitative measures as a powerful weapon of managerial control that spreads divisions and changes the rules of academic life [35].
In medicine, as in other disciplines with a high social status, competition for prestige is a standard practice, and publications are a way to gain recognition in the community. Being the strongest and most reliable predictor of success [36], research results are more and more often used as a measure of academic productivity with clear links to academic advancement and prestige around the world [37]. Therefore, to prove their worth, scientists must demonstrate consistent productivity in terms of English publications in indexed journals [38]. The message for scientists working in this environment is crystal clear: to succeed in the academic community, you must publish regularly [39] and do it in English language.
The pressure of performativity in the form of publications in selected journals promotes a sense of uncertainty, which often makes researchers susceptible to dominant practices and results in the acceptance of conformist attitudes [40].
Meanwhile, it is a balanced research climate combining competition with the persistence of striving to learn about the world that is a prerequisite for the development of scientists and universities and for the compliance with ethical standards in scientific research. Valuable academic work should therefore not be limited to writing articles to be published [32].
In these circumstances, after noticing, on the one hand, the necessity to publish the results of scientific research and the natural willingness to popularise them for the development of scientific knowledge, and, on the other hand, after identifying the institutional and environmental pressure to increase quantitative measures based on publications, it was decided to measure the phenomenon of publication pressure in order to determine its intensity.

Aim of the research

The aim of this article is to present the results of a survey of the intensity of publication activity among medical science researchers at Polish universities. This intention was accomplished using bibliometric analysis based on quantitative indices depicting the publication activity of medical university employees in Poland who located the results of their research efforts in the field of “medicine”, which were published between 2017 and 2023. Additionally, we wish to unveil the main topic clusters.

Material and methods

The bibliometric study covered publications published in the years 2017–2023 by employees of public medical universities in Poland. At the same time, these entities are included in the World University Rankings 2024 in the field called “clinical and health” for the region of Poland, which is a commonly used ranking in this type of research. The choice of this period was dictated by the radical changes that took place in the higher education system in Poland at that time, including those relating to the evaluation of the quality of universities’ scientific activities. It was assumed that incorporating an evaluation mechanism into this system, depending largely on the journals’ scoring, would reveal the expected behaviours of scientists. On the one hand, 2017 was the time immediately before the announcement of new solutions. However, 2023 was a year after the end of the 4-year period (which was extended to 5 years due to the SARS-CoV-2 virus, which caused the COVID-19 pandemic [41]) of evaluation of the university’s scientific activities. We expect that this interval is long enough to reveal the possible occurrence of publication pressure or absence of it. The results of the bibliometric study were preceded by a systematic review of the literature made for the issue of publication pressure as adequate and recognised to establish the existing state of knowledge [42].
The research procedure we used was developed in a manner adequate to the specific research problem and, at the same time, in a manner similar to other research conducted in this area. It proceeded in the following stages:
  1. Selection of the database – the SCOPUS database was selected as the largest scientific database. SciVal 10 was used as a dedicated comparison tool for the SCOPUS database.
  2. Selection of research objects – the World University Rankings 2024 was used. The ranking is published by Times Higher Education. It is also built on the basis of the SCOPUS database. All Polish universities in the field named “clinical & health” were selected for the study.
  3. Such identified universities were selected in the SciVal 10 tool for analysis. The field of Medicine was selected (according to the AJSC). All types of publications included in the SCOPUS database (articles, reviews, conference papers, books and book chapters) were selected as sources for the analysis. The research period was from 2017 to 2023.
  4. SO, FWCI, and FWVI indicators were generated in accordance with the assumptions adopted above.
  5. Using the SciVal 10 tool, a Topic Cluster was generated for the field of Medicine (according to the ASJC) for the period 2020–2023 for 2 geographical areas (Poland and the World).
Table 1 includes a set of Polish medical universities whose scientific achievements are published in journals available in the SCOPUS database according to the All Science Journal Classification Codes (ASJC).

Results

The Scholarly Output (SO) indicator for the field of Medicine – SOM, All Science Journal Classification Codes (ASJC)
The Scholarly Output (SO) indicator for the field of Medicine – SOM, All Science Journal Classification Codes (ASJC) – includes all classification codes of scientific journals. The SOM indicator informs about the number of published scientific achievements/studies of employees of individual medical universities (in the field of medicine).
Table 2 and Figure 1 contain data on the number of scientific studies published in the Scopus database for the field of Medicine in the years 2017–2023. Findings have been made regarding the Scholarly Output indicator in Medicine (SOM). The SOM indicator presents the number of publications indexed in the Scopus database. The largest numbers of items representing scientific achievements in the Scopus database in the field of medicine were published by employees of the Medical University of Warsaw (MUW) and the Jagiellonian University in Krakow (JUK). At MUW, there were 9832 items in the years 2017–2023, the largest number of publications written by the employees of this university was published in 2021 (1742 items), whereas at JUK there were 9425 achievements published according to the analysed classification and SOM indicator. The lowest numbers of publications according to the SOM indicator in the years 2017–2023 were determined for the Jan Kochanowski University of Kielce (JKUK) and the University of Warmia and Mazury in Olsztyn (UWMO). At JKUK there were 1229 studies, and at UWMO there were 1903 published achievements. During this period, at JKUK the lowest number of studies was recorded in 2017 (108 publications), and the highest in 2022 (233 publications), while at UWMO the lowest number of publications identified in 2017 was 186 achievements, and in 2022 there were 375 published achievements.
Table 2 and Figure 1 indicate growing publication activity in all analysed Polish medical universities classified in journals available in the SCOPUS database according to the ASJC until 2021, and these were as follows: JUK (in Krakow), MUB (in Bialystok), MUG (in Gdansk), MUL (in Lublin), MUW (in Warsaw), UMSP (in Poznan), and WMU (in Wroclaw). At some universities the growing activity occurred until 2022, and this group included the following: JKUK (in Kielce), MUSK (in Katowice), MULD (in Lodz), NCUT (in Torun), and UWMO (in Olsztyn). In the year 2023 all surveyed universities recorded a decline in the number of publications published according to the ASJC and analysed with the established SOM indicator.
The Field-Weighted Citation Impact indicator for the field of Medicine – FWCIM
The Field-Weighted Citation Impact indicator for the field of Medicine – FWCIM is an indicator presenting the significance of citations in a given scientific field in relation to the average of all similar publications.
The indicator for the N value defined as a gi- ven university is calculated according to the formula
(ci – number of citations of a publication
a given year and 3 previous years, ei – expected number of citations of a publication in a given year and 3 previous years).
A FWCI value of 1 indicates that a set of given publications in a scientific field is at an average global level. Values exceeding 1 indicate greater significance (e.g. an indicator of 1.25 means that the publications of a given entity were cited 25% more often than the world average, while an indicator of 0.90 signifies that the publications of a given entity were cited 10% less often than the world average). The indicator was developed by ELSEVIER and is part of the SciVal tool.
Table 3 and Figure 2 present the FWCI citation indicators in the field of medicine (FWCIM) established for all Polish public medical universities, in the established values based on data from the Scopus database for the field of Medicine in the years 2017–2023.
The highest levels of the studied FWCIM indicator were found at WMU (in Wroclaw) in 2017 – during this period it was set at 3.78; at JUK (in Krakow) also in 2017, its level this year equalled 3.01; in 2020 at MULD (in Lodz), in this university the indicator was set at 2.74; in 2017 at MUG (in Gdansk), in which it was 2.19; and in the following 2018 at MULD (in Lodz), this year it was set at 2.70. At MULD (in Lodz) in 4 out of the 7 examined periods of time, the FWCIM indicator was set at a level above level 2, while at WMU (in Lodz) the indicator obtained in 2017 at the level of 3.78 resulted in the fact that the average established for this unit for the period 2017–2023 also exceeded level 2.
The lowest levels of the studied FWCIM indicator were identified at JKUK (in Kielce) in 2017 and 2018 at the levels of 0.62 and 0.63, respectively. This university scored levels of the indicator below one in 4 out of the 7 examined periods.
Table 3 and Figure 2 present FWCIM indicators in all Polish public medical universities, and their values vary widely. Only 2 of the surveyed universities achieved (only in one surveyed year – 2017) levels of the studied indicator above 3, and these were the JUK (in Krakow) and WMU (in Wroclaw).
The lowest levels of the analysed indicator were set at JKUK (in Kielce), where the average indicator in the examined period was set at 0.87; at NCUT (in Torun), where the indicator reached the level of 1.02; and at MUL (in Lublin) where it equalled 1.04.
The Field-Weighted Views Impact (FWVI) for the field of Medicine (FWVIM)
The Field-Weighted Views Impact (FWVI) for the field of Medicine (FWVIM) is an indicator presenting the number of views for publications of a given university in relation to the average number of views obtained by all other similar publications in the SCOPUS database: the FWVI shows the way in which the number of views of publications of a given university can be compared to the world average. Similar publications in the SCOPUS database are those publications that have the same year of publication, publication type, and discipline (according to the ASJC). A value of FWVI equalling 1 indicates that a set of given publications in the researched scientific field is shaped at an average global level. Values exceeding 1 indicate greater importance (e.g. an indicator of 1.25 means that the publications of a given entity were viewed 25% more often than the global average, while an indicator of 0.90 indicates that the publications of a given entity were viewed 10% less often than the world average. The indicator was developed by ELSEVIER and is part of the SciVal tool.
Table 4 and Figure 3 present the levels of the FWVIM indicator. The highest of them at the surveyed public medical universities was found in WMU (in Wroclaw) in 2017 at the level of 3.43, then at MULD (in Lodz) where indicators exceeding level 3 were recorded in 2 surveyed periods of time – in 2020 it was set at level 3.31 and in 2018 at the level of 2.83. At JUK (in Krakow) in 2017, the indicator was found to be 2.74. In all remaining years that were examined, no FWVIM indicator was detected at a level above 2 in the analysed universities.
The lowest levels of the FWVIM indicator were found at NCUP (in Torun) in 3 examined years (2019–2021), these were the levels: 0.96, 0.91, and 0.95, respectively. Two such periods with levels of this indicator below 1 were recorded at JKUK (in Kielce) in 2020 when it equalled 0.84 and in 2019 when it was set at 0.97. Likewise, in 2 periods examined, the FWVIM indicator at levels below 1 was found at UMSP (in Poznan) in 2020 at 0.91 and at 0.96 in 2023. During the studied period, one entity was found among the surveyed universities with the level of the analysed indicator below 1, and this was MUSK (in Katowice) in 2020, when the indicator was set at 0.9.
Table 4 and Figure 3 indicate a varied situation regarding the levels of the studied indicator in public medical universities listed in the SCOPUS database. The FWVIM indicator shows interest in the publications of Polish scientists conducting research in the field of medicine and publishing their achievements, as well as affiliating them in the surveyed universities (public medical universities listed in the SCOPUS database). These indicators set as average for the examined period of 2017–2023 ranged from 1.04 to 2.12. The highest level (2.12) of the FWVIM indicator determined in this way was found at MULD (in Lodz), and the lowest (1.04) at JKUK (in Kielce) and at UMSP (in Poznan), also at the level of 1.04. At NCUT (in Torun), the average indicator for the studied period of 2017–2023 was also set at a low level of 1.05. It was at this university in Torun where there were 3 periods within the timeframe of 2017-–2023 in which these indicators were below level 1.
The International Collaboration (IC) indicator for the field of Medicine – ICM
The International Collaboration (IC) indicator for the field of Medicine – ICM is an indicator presenting the participation of foreign co-authors in publications of a given unit (university) and is expressed as a percentage. Thus, it shows the percentage of publications of a given (researched) entity that has international co-authorship. The ICM indicator proves the activity of the research and teaching staff of Polish medical universities at the international level, by their cooperation with other medical academic centres. The exchange of knowledge and research results creates new solutions and progress in this field of science on an international scale.
Table 5 and Figure 4 show the participation of foreigners in the publications of a given university. The highest levels of the analysed indicator were found at UWMO (in Olsztyn) where it equalled 48.7% in 2021 and 42.3% in both 2020 and 2023, as well as at WMU (in Wroclaw) in 2023 when it scored 44.5%, and at JUK (in Krakow) in 2023 – with 41.7%. In the remaining surveyed units, the level of the examined indicator was not exceeded in any of the studied years.
The lowest levels of the examined indicator were found for publications written at JKUK (in Kielce) in 2020 – 15.8%, and 20.1% in 2021.
Table 5 and Figure 4 indicate the participation of foreigners in the publications of Polish researchers at universities in Poland. The average lowest levels of this indicator ranged from 15.8% at JKUK (in Kielce) in 2020 up to 48.7% at UWMO (in Olsztyn) in 2021. The average values of the examined indicator in the years 2017–2023 were set at levels equalling 23.1% in JKUK (in Kielce), 25.7% at MUL (in Lublin), 27.8% at MUSK (in Katowice), 28.9% at MUB (in Bialystok), and 29.1% at UMSP (in Poznan); in these units they were the lowest in the examined period. The highest average levels (for 2017–2023) of the analysed indicator were found at UWMO (in Olsztyn) with the score of 37.2%, at MUG (in Gdansk) with 37.1%, at JUK (in Krakow) with 37.0%, and at WMU (in Wroclaw), at the level of 36.8%.
Topic Cluster -TC with the highest visibility for the field of Medicine – TCM
Topic Cluster -TC with the highest visibility for the field of Medicine – TCM is an indicator showing the topics with the highest number of views. The TC indicator combines 3 metrics: CiteScore, Citation Count and View Count. CiteScore shows the number of citations from the period of 4 years preceding the metric’s calculation divided by the number of documents. The basis for calculating the Topic Cluster indicator is the number of citations and views of articles published in the last 2 years.
Table 6 presents the Topic Clusters that fall within 1% of the most visible/most frequently undertaken and published topics published by researchers from Polish scientific and research units. The table includes the names of those Clusters, their number in the SCOPUS database, the SO indicator, the FWCI indicator, and the Prominence Percentile (PP) indicator. The PP indicator shows the dynamics of a given Topic Cluster. A value of 100 indicates the most dynamic Topic Cluster for the studied field and area. The PP indicator combines the following metrics: the number of citations in a given year for publications from this year and the previous one, the number of views in a given year for publications from this year, and the previous one and the average CiteScore result (the number of citations of a publication in a given journal within the last 4 years divided by the number of publications indexed in SCOPUS for the same period) for 2020–2023.
The Topic Cluster: COVID-19; SARS-CoV-2; Coronavirus, whose number in the SciVal 10 database is TC.1500, had the largest number of publications with 3519 items in the analysed TC. The FWCI indicator (in TC.1500) reached the level of 2.19, and the PP indicator scored the dynamics level of 100.
In the Topic Cluster: T-Lymphocytes; Neoplasmas; Immunotherapy, whose number in the SciVal 10 database is TC.12, 1028 publications were found, in which the FWCI indicator reached the level of 2.83, and the PP indicator scored the dynamics level of 99.532. In the Topic Cluster: Metagenome; Probiotics; Bacteria, whose number in the SciVal 10 database is TC.215, 967 publications were identified, in which the FWCI indicator reached the level of 1.42 and the PP indicator scored the dynamics level of 99.064. However, in the Topic Cluster: MicroRNAs; Long Untranslated RNA; Neoplasms, whose number in the SciVal 10 database is TC.219, 843 publications were identified, in which the FWCI indicator reached the level of 0.99 and the PP indicator scored the dynamics level of 99.331.
Table 7 presents the Topic Clusters falling within 1% of the most visible (with the highest number of views) topics in the world. The table contains the names of those Topic Clusters, their number in the SCOPUS database, the SO, the FWCI, and the PP indicators.
The Topic Cluster: COVID-19; Severe Acute Respiratory; Coronavirus Syndrome 2; Public Health, whose number in the SciVal 10 database is TC.1, had the largest number of publications with 245,359 items in the analysed Topic Cluster in the surveyed period. The FWCI indicator (in TC.1) reached the level of 2.49, and the PP indicator scored the dynamics level of 100. In the TC.80 Topic Cluster, 45,127 publications were found, in which the FWCI indicator reached the level of 1.56, the PP indicator – the dynamics level of 99,477. However, in the TC.620 Topic Cluster, the SO indicator was set at a level similar to TC.80 and amounted to 42,046; the FWCI indicator (presenting the significance of citations in a given field in relation to the average of all similar publications) was at the level (in TC.620) of 2.59 and the PP indicator was at a level higher than TC. 80, but lower than TC.1, scoring 99,738.

Conclusions

The study, made in a deliberately determined time sequence, revealed the intensity of the publication activity of scientists at Polish medical universities, with particular emphasis on medical sciences. In this way, arguments were provided enabling the implementation of the intention adopted at the beginning. For this purpose, an appropriately selected set of bibliometric indicators with high information value was used.
The SOM indicator levels in all public medical universities were revealed. The study showed that the level of the SOM indicator, in the initial period of analysis (in 2017 and 2018), remained at a constant or slightly increasing level (Table 2 and Figure 1). This growing publication activity was recorded in all analysed Polish medical universities classified in journals available in the SCOPUS database according to the ASJC until 2021. In turn, 2023 was the period in which all universities analysed according to the ASJC and surveyed with the established SOM indicator suffered a decline in the number of published achievements. However, the presented data showed a significant increase in the publication activity of employees in 2021. This was the last year of the evaluation introduced by the new Law on Higher Education and Science (2017–2021).
In turn, the FWCIM indicator (Table 3 and Figure 2) showed large differences in the publication activity of employees at all Polish public medical universities. Additionally, the FWVIM indicator (Table 4 and Figure 3) showed a diversified situation regarding its levels in public medical universities listed in the SCOPUS database. The indicator shows interest in the publications of Polish scientists conducting research in the field of medicine and publishing their achievements, as well as affiliating them in the surveyed universities (public medical universities listed in the SCOPUS database). These indicators set as average for the examined period of 2017-–2023 ranged from 1.04 to 2.12.
An equally interesting observation was provided by the results of research carried out using the International Collaboration indicator for the field of Medicine – ICM (Table 5 and Figure 4), which showed a growing participation of foreign researchers in scientific publications affiliated with Polish medical universities.
However, the number of Topic Clusters for the field of Medicine (Table 6) showed the highest number of publications in the Topic Cluster TC.1500 (3519), the highest level of the FWCI indicator in TC.12 (2.83), and the PP indicator - also in TC.1500 (at the level of 100). In turn, the number of Topic Clusters for the field of Medicine (Table 7) showed the largest number of publications in the Topic Cluster TC.1 (245,359), the highest level of the FWCI indicator, which presents the significance of citations in a given field in relation to the average of all similar publications, was in TC.620 (2.59), and the highest PP indicator was found in TC.1 (100).
In our opinion, the findings of this study contribute to broadening knowledge about the publication landscape, and in particular the intensity of employees’ activity in the field of medical sciences at Polish medical universities. They also shed light on the undertaken leading thematic scope and cooperation with foreign researchers. The observed phenomena did not indicate strong long-term increases in the number of publications, and at the same time the increase that was noted was clearly of an occasional nature. Thus, in our opinion, the conducted research relating to the last stage of a research process (publication of results) may be helpful in understanding the effects of the “publication game” by revealing topics that increased publication success. It is obvious that these topics are undertaken due to public expectations of scientific discoveries in certain areas (e.g. related to COVID-19). However, it cannot be ruled out that the attractiveness of these topics for publishers did not contribute to directing (subordinating) research efforts to this topic. This statement requires confirmation in additional research, which will provide empirical arguments based on which it can be later verified. It cannot be ruled out that the choice of a research topic is the result of a researcher’s scientific passion and their personal involvement in a significant and socially important topic. At the same time, it must be emphasised that the choice of socially relevant topics reflects scientific passion, and the willingness to publish is functional when scientists strive to share important discoveries. In contrast, the intention to publish to “score points” as the ultimate goal, regardless of the relevance of the topic, represents a significant departure from the primary goal that is a passion-driven scientist.
In the future, it will be worth supplementing the findings made and presented in this study and comparing them with the results of empirical research obtained using an available measurement tool in order to assess the degree of publication pressure experienced (or not) by scientists. Such an instrument may be valuable for further research on the causes and consequences of the publication pressure, such as its impact on publication quality and on the mental health and performance of scientists. Moreover, a multidimensional assessment of the publication pressure will make an important contribution to understanding its determinants and consequences and will constitute an important input to the current debate on scientific publications. We believe that further research is necessary to evaluate the psychometric properties of the publication pressure in specific research populations such as doctoral students and professors.

Funding

The publication, including access to research material, was financed by the project implemented by the Jan Kochanowski University in Kielce Analysis of the consolidation potential of the University of Wrocław and the Wroclaw Medical University”; BKOM.WPNZ.23.004.

Ethical approval

Not applicable.

Conflict of interest

The authors declare no conflict of interest.
References
1. Biondi L, Russo S. Integrating strategic planning and performance management in universities: a multiple case-study analysis. J Manag Gov. 2022 Mar; 26: 417-448.
2. Craig R, Amernic J, Tourish D. Perverse audit culture and accountability of the modern public university. Financ Account Manag. 2014 Jan; 30(1): 1-24.
3. Hood C. The “new public management” in the 1980s: variations on a theme. Account Organ Soc. 1995 Feb-Apr; 20(2-3): 93-109.
4. Nørreklit L, Jack L, Nørreklit H. Moving towards digital governance of university scholars: instigating a post-truth university culture. J Manag Gov. 2019; 23(7): 869-899.
5. Nicolo G, Manes-Rossi F, Christiaens J, Aversano N. Accountability through intellectual capital disclosure in Italian Universities. J Manag Gov. 2020 Dec; 24(4): 1055-1087.
6. Rebora G, Turri M. The UK and Italian research assessment exercises face to face. Res Policy. 2013 Nov; 42(9): 1657-1666.
7. Turri M. The new Italian agency for the evaluation of the university system (ANVUR): a need for governance or legitimacy? Qual High Educ. 2014 Jan; 20(1): 64-82.
8. Ramassa P, Avallone F, Quagli A. Can “publishing game” pressures affect the research topic choice? A survey of European accounting researchers. J Manag Gov. 2024 Jan; 28: 507-542.
9. Humphrey C, Gendron Y. What is going on? The sustainability of accounting academia. Crit Perspect Account. 2015 Oct; 26: 47-66.
10. Palea V. Whither accounting research? A European view. Crit Perspect Account. 2017; 42C: 59-73.
11. Moizer P. Publishing in accounting journals: a fair game? Account Organ Soc. 2009 Feb; 34(2): 285-304.
12. Van Helden J, Argento D. Our hate–love relationship with publication metrics. Public Money Manag. 2020 Nov; 40(2): 174-177.
13. Pisarska A. (Nie)stabilność finansowa uniwersytetów: optyka koncepcji uniwersytetu przedsiębiorczego. Wydawnictwa Uniwersytetu Jana Kochanowskiego w Kielcach. Kielce 2023.
14. Pertuz-Peralta V, Arias-Pérez J, Daza-Calier Y. Knowledge sharing among academics: why organizational narcissism in higher education matters? J Inf Knowl Manag Syst. 2022; 52: 141-157.
15. Summers SL, Wood DA. An evaluation of the general vs specialist nature of top accounting journals. Account Horiz. 2017; 31: 105-124.
16. Pusser B, Marginson S. University rankings in critical perspective. J High Educ. 2013; 84: 544-568.
17. Croucher G, Lacy WB. The emergence of academic capitalism and university neoliberalism: perspectives of Australian higher education leadership. High Educ. 2020; 83(2): 279-295.
18. Mertkan S, Aliusta GO, Bayrakli H. Pressured to publish: stories of inexperienced researchers. J Organ Change Manag. 2022; 35: 603-615.
19. Sandy W, Shen H. Publish to earn incentives: how do Indonesian professors respond to the new policy? High Educ. 2019 Feb; 77(1): 247-263.
20. Keen A. Writing for publication: Pressures, barriers and support strategies. Nurse Educ Today. 2007 Jul; 27(5): 382-388.
21. Xi X, Mao J, Zeng T, Ju D. Validation of publication pressure questionnaire-revised into Chinese nurses from a university hospital. Nurs Open. 2023 Dec; 10(12): 7713-7724.
22. Van Dalen HP, Henkens K. Intended and unintended consequences of a publish-or-perish culture: a worldwide survey. J Am Soc Inf Sci Technol. 2012 Apr; 63: 1282-1293.
23. Alberts B, Kirschner MW, Tilghman S, Varmus H. Rescuing US biomedical research from its systemic flaws. Proc Natl Acad Sci USA. 2014 Apr; 111(16): 5773-5777.
24. Levecque K, Anseel F, De Beuckelaer A, Van der Heyden J, Gisle L. Work organization and mental health problems in PhD students. Res Policy. 2017 Mar; 46(4): 868-879.
25. Vakkuri J, Johanson JE. Failed promises – performance measurement ambiguities in hybrid universities. Qual Res Account Manag. 2020; 17(1): 33-50.
26. Guarini E, Magli F, Francesconi A. Academic logics in changing performance measurement systems: an exploration in a university setting. Qual Res Account Manag. 2020 Feb; 17(1): 109-142.
27. Tamarinde LT, de Goede MEE, Tijdink JK, Oort FJ. Personally perceived publication pressure: revising the Publication Pressure Questionnaire (PPQ) by using work stress models. Res Integr Peer Rev. 2019 Apr; 4: 7.
28. Tijdink J, Vergouwen A, Smulders Y. Publication pressure and burn out among Dutch medical professors: a nationwide survey. PLoS One. 2013; 8(9): e73381.
29. Miller AN, Taylor SG, Bedeian AG. Publish or perish: academic life as management faculty live it. Career Dev Int. 2011 Sep; 16(5): 422-445.
30. Kwee MK, Toxopeus R, Kwee TC. Publication pressure in medical imaging. Eur J Radiol. 2024 May; 174: 111404.
31. Guthrie J, Parker LD, Dumay J, Milne MJ. What counts for quality in interdisciplinary accounting research in the next decade: a critical review and reflection. Account Aud Account J. 2019 Jan; 32(1): 2-25.
32. Chahed Y, Charnock R, Du Rietz Dahlström S, Lennon NJ, Palermo T, Parisi C, Pflueger D, Sundström A, Toh D, Yu L. The value of research activities “other than” publishing articles: reflections on an experimental workshop series. Account Aud Account J. 2024 Mar; https://doi.org/10.1108/AAAJ-05-2022-5818.
33. Alvesson M, Sandberg J. Generating research questions through problematization. Acad Manag Rev. 2011 Apr; 36(2): 247-271.
34. Malsch B, Tessier S. Journal ranking effects on junior academics: identity fragmentation and politicization. Crit Perspect Account. 2015; 26(C): 84-98.
35. Tourish D, Willmott H. In defiance of folly: journal rankings, mindless measures and the ABS guide. Crit Perspect Account. 2015; 26(C): 37-46.
36. Lutter M, Schröder M. Who becomes a tenured professor, and why? Panel data evidence from German sociology, 1980-2013. Res Policy. 2016; 45(5): 999-1013.
37. Maher MA, Feldon DF, Timmerman BE, Chao J. Faculty perceptions of common challenges encountered by novice doctoral writers. High Educ Res Dev. 2014; 33(4): 699-711.
38. Jiang X, Borg E, Borg M. Challenges and coping strategies for international publication: perceptions of young scholars in China. Stud High Educ. 2017 Jun; 42(3): 428-444.
39. Nygaard LP. Publishing and perishing: an academic literacies framework for investigating research productivity. Stud High Educ. 2017; 42(3): 519-532.
40. Mertkan S, Onurkan Aliusta G, Bayrakli H. Pressured to publish: stories of inexperienced researchers. J Organ Change Manag. 2022 Mar; 35: 603-615.
41. Tworek A, Rydzewski A, Rydzewska G, Głuszek-Osuch M, Lewandowski K. COVID-19 humoral response. Med Stud. 2023 Sep; 39(3): 296-303.
42. Piekut MJ, Pacian JA. Self-government of doctors in the context of their professional responsibility: economic, managerial, and legal aspects. Med Stud. 2023; 39(4): 405-413.
Copyright: © 2024 Jan Kochanowski University in Kielce This is an Open Access article distributed under the terms of the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International (CC BY-NC-SA 4.0) License (http://creativecommons.org/licenses/by-nc-sa/4.0/), allowing third parties to copy and redistribute the material in any medium or format and to remix, transform, and build upon the material, provided the original work is properly cited and states its license.
Quick links
© 2024 Termedia Sp. z o.o.
Developed by Bentus.