Publications

• [ 2024 ]
• [ 2023 ]
• [ 2022 ]
• [ 2021 ]
• [ 2020 ]
• [ 2019 ]
• [ 2018 ]
• [ 2017 ]
• [ 2016 ]
• [ 2015 ]
• [ 2014 ]
• [ 2013 ]
• [ 2012 ]
• [ 2011 ]
• [ 2010 ]
• [ 2009 ]
• [ 2008 ]
• [ 2007 ]
• [ 2006 ]
• [ 2005 ]
• [ 2004 ]
• [ 2003 ]
• [ 2002 ]
• [ 2001 ]
• [ 1999 ]

• 
  Thinking in Categories: A Survey on Assessing the Quality for Time Series Synthesis. M. Stenger; A. Bauer; T. Prantl; R. Leppich; N. Hudson; K. Chard; I. Foster; S. Kounev; in J. Data and Information Quality (2024). 16(2)
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  Time series data are widely used and provide a wealth of information for countless applications. However, some applications are faced with a limited amount of data, or the data cannot be used due to confidentiality concerns. To overcome these obstacles, time series can be generated synthetically. For example, electrocardiograms can be synthesized to make them available for building models to predict conditions such as cardiac arrhythmia without leaking patient information. Although many different approaches to time series synthesis have been proposed, evaluating the quality of synthetic time series data poses unique challenges and remains an open problem, as there is a lack of a clear definition of what constitutes a “good” synthesis. To this end, we present a comprehensive literature survey to identify different aspects of synthesis quality and their relationships. Based on this, we propose a definition of synthesis quality and a systematic evaluation procedure for assessing it. With this work, we aim to provide a common language and criteria for evaluating synthetic time series data. Our goal is to promote more rigorous and reproducible research in time series synthesis by enabling researchers and practitioners to generate high-quality synthetic time series data.

  @article{10.1145/3666006, abstract = {Time series data are widely used and provide a wealth of information for countless applications. However, some applications are faced with a limited amount of data, or the data cannot be used due to confidentiality concerns. To overcome these obstacles, time series can be generated synthetically. For example, electrocardiograms can be synthesized to make them available for building models to predict conditions such as cardiac arrhythmia without leaking patient information. Although many different approaches to time series synthesis have been proposed, evaluating the quality of synthetic time series data poses unique challenges and remains an open problem, as there is a lack of a clear definition of what constitutes a “good” synthesis. To this end, we present a comprehensive literature survey to identify different aspects of synthesis quality and their relationships. Based on this, we propose a definition of synthesis quality and a systematic evaluation procedure for assessing it. With this work, we aim to provide a common language and criteria for evaluating synthetic time series data. Our goal is to promote more rigorous and reproducible research in time series synthesis by enabling researchers and practitioners to generate high-quality synthetic time series data.}, address = {New York, NY, USA}, author = {Stenger, Michael and Bauer, Andr\'{e} and Prantl, Thomas and Leppich, Robert and Hudson, Nathaniel and Chard, Kyle and Foster, Ian and Kounev, Samuel}, journal = {J. Data and Information Quality}, keywords = {t_journalmagazine}, month = {06}, number = 2, publisher = {Association for Computing Machinery}, title = {Thinking in Categories: A Survey on Assessing the Quality for Time Series Synthesis}, volume = 16, year = 2024 }

  %0 Journal Article %1 10.1145/3666006 %A Stenger, Michael %A Bauer, André %A Prantl, Thomas %A Leppich, Robert %A Hudson, Nathaniel %A Chard, Kyle %A Foster, Ian %A Kounev, Samuel %C New York, NY, USA %D 2024 %I Association for Computing Machinery %J J. Data and Information Quality %N 2 %T Thinking in Categories: A Survey on Assessing the Quality for Time Series Synthesis %U https://doi.org/10.1145/3666006 %V 16 %X Time series data are widely used and provide a wealth of information for countless applications. However, some applications are faced with a limited amount of data, or the data cannot be used due to confidentiality concerns. To overcome these obstacles, time series can be generated synthetically. For example, electrocardiograms can be synthesized to make them available for building models to predict conditions such as cardiac arrhythmia without leaking patient information. Although many different approaches to time series synthesis have been proposed, evaluating the quality of synthetic time series data poses unique challenges and remains an open problem, as there is a lack of a clear definition of what constitutes a “good” synthesis. To this end, we present a comprehensive literature survey to identify different aspects of synthesis quality and their relationships. Based on this, we propose a definition of synthesis quality and a systematic evaluation procedure for assessing it. With this work, we aim to provide a common language and criteria for evaluating synthetic time series data. Our goal is to promote more rigorous and reproducible research in time series synthesis by enabling researchers and practitioners to generate high-quality synthetic time series data.
• 
  An Empirical Investigation of Container Building Strategies and Warm Times to Reduce Cold Starts in Scientific Computing Serverless Functions. A. Bauer; M. Gonthier; R. Chard; H. Pan; D. Grzenda; M. Straesser; J. G. Pauloski; A. Kamatar; M. E. Baughman; N. Hudson; I. Foster; K. Chard; in 2024 IEEE 20th International Conference on e-Science (e-Science) (2024).
  • [ BibTeX ]
  • [ EndNote ]
  @inproceedings{bauer2024coldstarts, author = {Bauer, André and Gonthier, Maxime and Chard, Ryan and Pan, Haochen and Grzenda, Daniel and Straesser, Martin and Pauloski, J. Gregory and Kamatar, Alok and Baughman, Matthew E. and Hudson, Nathaniel and Foster, Ian and Chard, Kyle}, booktitle = {2024 IEEE 20th International Conference on e-Science (e-Science)}, keywords = {Scientific_Computing}, title = {An Empirical Investigation of Container Building Strategies and Warm Times to Reduce Cold Starts in Scientific Computing Serverless Functions}, year = 2024 }

  %0 Conference Paper %1 bauer2024coldstarts %A Bauer, André %A Gonthier, Maxime %A Chard, Ryan %A Pan, Haochen %A Grzenda, Daniel %A Straesser, Martin %A Pauloski, J. Gregory %A Kamatar, Alok %A Baughman, Matthew E. %A Hudson, Nathaniel %A Foster, Ian %A Chard, Kyle %B 2024 IEEE 20th International Conference on e-Science (e-Science) %D 2024 %T An Empirical Investigation of Container Building Strategies and Warm Times to Reduce Cold Starts in Scientific Computing Serverless Functions
• 
  Early Explorations of Lightweight Models for Wound Segmentation on Mobile Devices. V. Borst; T. Dittus; K. Müller; S. Kounev; in 47th German Conference on Artificial Intelligence - KI 2024 (2024).
  • [ BibTeX ]
  • [ EndNote ]
  • [ DOI ]
  • [ Download ]
  @conference{borst2024early, author = {Borst, Vanessa and Dittus, Timo and Müller, Konstantin and Kounev, Samuel}, booktitle = {47th German Conference on Artificial Intelligence - KI 2024}, keywords = {t_interdisciplinary}, title = {Early Explorations of Lightweight Models for Wound Segmentation on Mobile Devices}, year = 2024 }

  %0 Generic %1 borst2024early %A Borst, Vanessa %A Dittus, Timo %A Müller, Konstantin %A Kounev, Samuel %B 47th German Conference on Artificial Intelligence - KI 2024 %D 2024 %R https://doi.org/10.1007/978-3-031-70893-0_21 %T Early Explorations of Lightweight Models for Wound Segmentation on Mobile Devices
• 
  Unveiling Temporal Performance Deviation: Leveraging Clustering in Microservices Performance Analysis. A. Bauer; T. Dittus; M. Straesser; A. Kamatar; M. Baughman; L. Beierlieb; M. Hadry; D. Grillmeyer; Y. Lubas; S. Kounev; I. Foster; K. Chard; in Companion of the 15th ACM/SPEC International Conference on Performance Engineering (2024). 72–76.
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  • [ Download ]
  As the market for cloud computing continues to grow, an increasing number of users are deploying applications as microservices. The shift introduces unique challenges in identifying and addressing performance issues, particularly within large and complex infrastructures. To address this challenge, we propose a methodology that unveils temporal performance deviations in microservices by clustering containers based on their performance characteristics at different time intervals. Showcasing our methodology on the Alibaba dataset, we found both stable and dynamic performance patterns, providing a valuable tool for enhancing overall performance and reliability in modern application landscapes.

  @inproceedings{10.1145/3629527.3651843, abstract = {As the market for cloud computing continues to grow, an increasing number of users are deploying applications as microservices. The shift introduces unique challenges in identifying and addressing performance issues, particularly within large and complex infrastructures. To address this challenge, we propose a methodology that unveils temporal performance deviations in microservices by clustering containers based on their performance characteristics at different time intervals. Showcasing our methodology on the Alibaba dataset, we found both stable and dynamic performance patterns, providing a valuable tool for enhancing overall performance and reliability in modern application landscapes.}, address = {New York, NY, USA}, author = {Bauer, André and Dittus, Timo and Straesser, Martin and Kamatar, Alok and Baughman, Matt and Beierlieb, Lukas and Hadry, Marius and Grillmeyer, Daniel and Lubas, Yannik and Kounev, Samuel and Foster, Ian and Chard, Kyle}, booktitle = {Companion of the 15th ACM/SPEC International Conference on Performance Engineering}, keywords = {descartes}, pages = {72–76}, publisher = {Association for Computing Machinery}, series = {ICPE '24 Companion}, title = {Unveiling Temporal Performance Deviation: Leveraging Clustering in Microservices Performance Analysis}, year = 2024 }

  %0 Conference Paper %1 10.1145/3629527.3651843 %A Bauer, André %A Dittus, Timo %A Straesser, Martin %A Kamatar, Alok %A Baughman, Matt %A Beierlieb, Lukas %A Hadry, Marius %A Grillmeyer, Daniel %A Lubas, Yannik %A Kounev, Samuel %A Foster, Ian %A Chard, Kyle %B Companion of the 15th ACM/SPEC International Conference on Performance Engineering %C New York, NY, USA %D 2024 %I Association for Computing Machinery %P 72–76 %T Unveiling Temporal Performance Deviation: Leveraging Clustering in Microservices Performance Analysis %U https://doi.org/10.1145/3629527.3651843 %X As the market for cloud computing continues to grow, an increasing number of users are deploying applications as microservices. The shift introduces unique challenges in identifying and addressing performance issues, particularly within large and complex infrastructures. To address this challenge, we propose a methodology that unveils temporal performance deviations in microservices by clustering containers based on their performance characteristics at different time intervals. Showcasing our methodology on the Alibaba dataset, we found both stable and dynamic performance patterns, providing a valuable tool for enhancing overall performance and reliability in modern application landscapes.
• 
  Attack-Aware Security Function Chaining. L. Iffländer; L. Beierlieb; S. Kounev; in Electronics (2024). 13(17)
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  • [ DOI ]
  Cyberattacks have become more frequent and more violent in recent years. To date, defensive infrastructure has been relatively static, and security functions are usually placed in a common order that does not depend on the current situation. We propose the concept of attack-aware Security Service Function Chain reordering. The idea is to change the order of security functions depending on the malicious traffic observed. We present the basic idea, evaluate the impact of the function chain order, and introduce a framework for function chain reordering. Our evaluation shows that the order often has a significant impact on the performance of the security function chain and that there is no single order that outperforms all other orders in every situation. The proposed proof-of-concept framework successfully validates the feasibility of attack-aware security function chain reordering, and we propose additional extensions to eliminate the remaining deficiencies.

  @article{electronics13173357, abstract = {Cyberattacks have become more frequent and more violent in recent years. To date, defensive infrastructure has been relatively static, and security functions are usually placed in a common order that does not depend on the current situation. We propose the concept of attack-aware Security Service Function Chain reordering. The idea is to change the order of security functions depending on the malicious traffic observed. We present the basic idea, evaluate the impact of the function chain order, and introduce a framework for function chain reordering. Our evaluation shows that the order often has a significant impact on the performance of the security function chain and that there is no single order that outperforms all other orders in every situation. The proposed proof-of-concept framework successfully validates the feasibility of attack-aware security function chain reordering, and we propose additional extensions to eliminate the remaining deficiencies.}, author = {Iffländer, Lukas and Beierlieb, Lukas and Kounev, Samuel}, journal = {Electronics}, keywords = {t_journalmagazine}, number = 17, title = {Attack-Aware Security Function Chaining}, volume = 13, year = 2024 }

  %0 Journal Article %1 electronics13173357 %A Iffländer, Lukas %A Beierlieb, Lukas %A Kounev, Samuel %D 2024 %J Electronics %N 17 %R 10.3390/electronics13173357 %T Attack-Aware Security Function Chaining %U https://www.mdpi.com/2079-9292/13/17/3357 %V 13 %X Cyberattacks have become more frequent and more violent in recent years. To date, defensive infrastructure has been relatively static, and security functions are usually placed in a common order that does not depend on the current situation. We propose the concept of attack-aware Security Service Function Chain reordering. The idea is to change the order of security functions depending on the malicious traffic observed. We present the basic idea, evaluate the impact of the function chain order, and introduce a framework for function chain reordering. Our evaluation shows that the order often has a significant impact on the performance of the security function chain and that there is no single order that outperforms all other orders in every situation. The proposed proof-of-concept framework successfully validates the feasibility of attack-aware security function chain reordering, and we propose additional extensions to eliminate the remaining deficiencies.
• 
  An Empirical Study on the Impact of Selected Host Configuration Parameters on Container Start Times. M. Straesser; N. Erhard; S. Kounev; (2024).

  In print.
  • [ BibTeX ]
  • [ EndNote ]
  • [ Download ]
  @misc{StraesserSSP2024, author = {Straesser, Martin and Erhard, Nicholas and Kounev, Samuel}, booktitle = {Softwaretechnik-Trends Band 44, Heft 4}, keywords = {t_workshop}, note = {In print.}, publisher = {Gesellschaft für Informatik e.V.}, series = {Softwaretechnik-Trends}, title = {An Empirical Study on the Impact of Selected Host Configuration Parameters on Container Start Times}, year = 2024 }

  %0 Generic %1 StraesserSSP2024 %A Straesser, Martin %A Erhard, Nicholas %A Kounev, Samuel %B Softwaretechnik-Trends Band 44, Heft 4 %D 2024 %I Gesellschaft für Informatik e.V. %T An Empirical Study on the Impact of Selected Host Configuration Parameters on Container Start Times
• 
  Benchmarking of Secure Group Communication schemes with Focus on IoT. T. Prantl; A. Bauer; S. Engel; L. Horn; C. Krupitzer; L. Iffl"ander; S. Kounev; in Discover Data (2024). 2(1)
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  @article{PrBaEnHoKrIfKo_Discover_Data_2024, author = {Prantl, Thomas and Bauer, André and Engel, Simon and Horn, Lukas and Krupitzer, Christian and Iffl"{a}nder, Lukas and Kounev, Samuel}, journal = {Discover Data}, keywords = {t_journalmagazine}, month = {05}, number = 1, publisher = {Springer Science and Business Media LLC}, title = {Benchmarking of Secure Group Communication schemes with Focus on IoT}, volume = 2, year = 2024 }

  %0 Journal Article %1 PrBaEnHoKrIfKo_Discover_Data_2024 %A Prantl, Thomas %A Bauer, André %A Engel, Simon %A Horn, Lukas %A Krupitzer, Christian %A Iffl"ander, Lukas %A Kounev, Samuel %D 2024 %I Springer Science and Business Media LLC %J Discover Data %N 1 %T Benchmarking of Secure Group Communication schemes with Focus on IoT %U http://dx.doi.org/10.1007/s44248-024-00010-6 %V 2
• 
  Security Analysis of a Decentralized, Revocable and Verifiable Attribute-Based Encryption Scheme. T. Prantl; M. Lauer; L. Horn; S. Engel; D. Dingel; S. Kounev; A. Bauer; C. Krupitzer; in Proceedings of the 19th International Conference on Availability, Reliability and Security (2024).
  • [ BibTeX ]
  • [ EndNote ]
  @inproceedings{ARES_2024_ABE, author = {Prantl, Thomas and Lauer, Marco and Horn, Lukas and Engel, Simon and Dingel, David and Kounev, Samuel and Bauer, André and Krupitzer, Christian}, booktitle = {Proceedings of the 19th International Conference on Availability, Reliability and Security}, keywords = {descartes}, publisher = {ACM}, series = {ARES 2024}, title = {Security Analysis of a Decentralized, Revocable and Verifiable Attribute-Based Encryption Scheme}, year = 2024 }

  %0 Conference Paper %1 ARES_2024_ABE %A Prantl, Thomas %A Lauer, Marco %A Horn, Lukas %A Engel, Simon %A Dingel, David %A Kounev, Samuel %A Bauer, André %A Krupitzer, Christian %B Proceedings of the 19th International Conference on Availability, Reliability and Security %D 2024 %I ACM %T Security Analysis of a Decentralized, Revocable and Verifiable Attribute-Based Encryption Scheme
• 
  Simulating Microservice-based Architectures for Resilience Assessment Enriched by Authentic Container Orchestration. S. Frank; M. Straesser; L. Wagner; P. Haas; A. Hakamian; S. Kounev; A. Van Hoorn; in Software Engineering 2024 (2024).
  • [ BibTeX ]
  • [ EndNote ]
  • [ Download ]
  @incollection{Frank2024Simulating, address = {Bonn}, author = {Frank, Sebastian and Straesser, Martin and Wagner, Lion and Haas, Patrick and Hakamian, Alireza and Kounev, Samuel and Van Hoorn, André}, booktitle = {Software Engineering 2024}, keywords = {container_orchestration}, publisher = {Gesellschaft für Informatik e.V.}, title = {Simulating Microservice-based Architectures for Resilience Assessment Enriched by Authentic Container Orchestration}, year = 2024 }

  %0 Book Section %1 Frank2024Simulating %A Frank, Sebastian %A Straesser, Martin %A Wagner, Lion %A Haas, Patrick %A Hakamian, Alireza %A Kounev, Samuel %A Van Hoorn, André %B Software Engineering 2024 %C Bonn %D 2024 %I Gesellschaft für Informatik e.V. %T Simulating Microservice-based Architectures for Resilience Assessment Enriched by Authentic Container Orchestration
• 
  A Data-Driven Model for Range Sensors. F. Spiess; N. Strobel; T. Kaupp; S. Kounev; in International Journal of Semantic Computing (2024). 1–18.
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  In this paper, an analysis of the precision of range sensors is presented. Light Detection and Ranging (LIDAR) data from three different sensors (HLS-LFCD-LDS, SICK TIM561, and Kinect V2), stereo data from the Realsense D435, and structured light data from both Kinect V1 for Xbox and the Xtion PRO Live were analyzed regarding the influence of range, incident angle to the surface, and surface material. In addition, a comparison with standard deviation models based on vendor-provided specifications was performed. We found that the vendor specifications are in general not specific enough to facilitate accurate sensor simulations. Therefore, we developed a data-driven model for range precision. Our model can be used to create realistic sensor simulations and to develop robot navigation algorithms weighing sensor range readings based on the precision.

  @article{doi:10.1142/S1793351X24300012, abstract = {In this paper, an analysis of the precision of range sensors is presented. Light Detection and Ranging (LIDAR) data from three different sensors (HLS-LFCD-LDS, SICK TIM561, and Kinect V2), stereo data from the Realsense D435, and structured light data from both Kinect V1 for Xbox and the Xtion PRO Live were analyzed regarding the influence of range, incident angle to the surface, and surface material. In addition, a comparison with standard deviation models based on vendor-provided specifications was performed. We found that the vendor specifications are in general not specific enough to facilitate accurate sensor simulations. Therefore, we developed a data-driven model for range precision. Our model can be used to create realistic sensor simulations and to develop robot navigation algorithms weighing sensor range readings based on the precision.}, author = {Spiess, Florian and Strobel, Norbert and Kaupp, Tobias and Kounev, Samuel}, journal = {International Journal of Semantic Computing}, keywords = {t_journalmagazine}, month = {02}, pages = {1-18}, title = {A Data-Driven Model for Range Sensors}, year = 2024 }

  %0 Journal Article %1 doi:10.1142/S1793351X24300012 %A Spiess, Florian %A Strobel, Norbert %A Kaupp, Tobias %A Kounev, Samuel %D 2024 %J International Journal of Semantic Computing %P 1-18 %T A Data-Driven Model for Range Sensors %U https://doi.org/10.1142/S1793351X24300012 %X In this paper, an analysis of the precision of range sensors is presented. Light Detection and Ranging (LIDAR) data from three different sensors (HLS-LFCD-LDS, SICK TIM561, and Kinect V2), stereo data from the Realsense D435, and structured light data from both Kinect V1 for Xbox and the Xtion PRO Live were analyzed regarding the influence of range, incident angle to the surface, and surface material. In addition, a comparison with standard deviation models based on vendor-provided specifications was performed. We found that the vendor specifications are in general not specific enough to facilitate accurate sensor simulations. Therefore, we developed a data-driven model for range precision. Our model can be used to create realistic sensor simulations and to develop robot navigation algorithms weighing sensor range readings based on the precision.
• 
  Patient-Centered Chronic Wound Care Mobile Apps: Systematic Identification, Analysis, and Assessment. T. Dege; B. Glatzel; V. Borst; F. Grän; S. Goller; C. Glatzel; M. Goebeler; A. Schmieder; in JMIR mHealth and uHealth (2024). 12
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  • [ DOI ]
  Background: The prevalence of chronic wounds is predicted to increase within the aging populations in industrialized countries. Patients experience significant distress due to pain, wound secretions, and the resulting immobilization. As the number of wounds continues to rise, their adequate care becomes increasingly costly in terms of health care resources worldwide. eHealth support systems are being increasingly integrated into patient care. However, to date, no systematic analysis of such apps for chronic wounds has been published. Objective: The aims of this study were to systematically identify and subjectively assess publicly available German- or English-language mobile apps for patients with chronic wounds, with quality assessments performed by both patients and physicians. Methods: Two reviewers independently conducted a systematic search and assessment of German- or English-language mobile apps for patients with chronic wounds that were available in the Google Play Store and Apple App Store from April 2022 to May 2022. In total, 3 apps met the inclusion and exclusion criteria and were reviewed independently by 10 physicians using the German Mobile App Rating Scale (MARS) and the System Usability Scale (SUS). The app with the highest mean MARS score was subsequently reviewed by 11 patients with chronic wounds using the German user version of the MARS (uMARS) and the SUS. Additionally, Affinity for Technology Interaction (ATI) scale scores were collected from both patients and physicians. Results: This study assessed mobile apps for patients with chronic wounds that were selected from a pool of 118 identified apps. Of the 73 apps available in both app stores, 10 were patient oriented. After excluding apps with advertisements or costs, 3 apps were evaluated by 10 physicians. Mean MARS scores ranged from 2.64 (SD 0.65) to 3.88 (SD 0.65) out of 5, and mean SUS scores ranged from 50.75 (SD 27) to 80.5 (SD 17.7) out of 100. WUND APP received the highest mean MARS score (mean 3.88, SD 0.65 out of 5) among physicians. Hence, it was subsequently assessed by 11 patients and achieved a similar rating (uMARS score: mean 3.89, SD 0.4 out of 5). Technical affinity, as measured with the ATI scale, was slightly lower in patients (score: mean 3.62, SD 1.35 out of 6) compared to physicians (score: mean 3.88, SD 1.03 out 6). Conclusions: The quality ratings from physicians and patients were comparable and indicated mediocre app quality. Technical affinity, as assessed by using the ATI scale, was slightly lower for patients. Adequate apps for patients with chronic wounds remain limited, emphasizing the need for improved app development to meet patient needs. The ATI scale proved valuable for assessing technical affinity among different user groups.

  @article{dege2024patientcentered, abstract = {Background: The prevalence of chronic wounds is predicted to increase within the aging populations in industrialized countries. Patients experience significant distress due to pain, wound secretions, and the resulting immobilization. As the number of wounds continues to rise, their adequate care becomes increasingly costly in terms of health care resources worldwide. eHealth support systems are being increasingly integrated into patient care. However, to date, no systematic analysis of such apps for chronic wounds has been published. Objective: The aims of this study were to systematically identify and subjectively assess publicly available German- or English-language mobile apps for patients with chronic wounds, with quality assessments performed by both patients and physicians. Methods: Two reviewers independently conducted a systematic search and assessment of German- or English-language mobile apps for patients with chronic wounds that were available in the Google Play Store and Apple App Store from April 2022 to May 2022. In total, 3 apps met the inclusion and exclusion criteria and were reviewed independently by 10 physicians using the German Mobile App Rating Scale (MARS) and the System Usability Scale (SUS). The app with the highest mean MARS score was subsequently reviewed by 11 patients with chronic wounds using the German user version of the MARS (uMARS) and the SUS. Additionally, Affinity for Technology Interaction (ATI) scale scores were collected from both patients and physicians. Results: This study assessed mobile apps for patients with chronic wounds that were selected from a pool of 118 identified apps. Of the 73 apps available in both app stores, 10 were patient oriented. After excluding apps with advertisements or costs, 3 apps were evaluated by 10 physicians. Mean MARS scores ranged from 2.64 (SD 0.65) to 3.88 (SD 0.65) out of 5, and mean SUS scores ranged from 50.75 (SD 27) to 80.5 (SD 17.7) out of 100. WUND APP received the highest mean MARS score (mean 3.88, SD 0.65 out of 5) among physicians. Hence, it was subsequently assessed by 11 patients and achieved a similar rating (uMARS score: mean 3.89, SD 0.4 out of 5). Technical affinity, as measured with the ATI scale, was slightly lower in patients (score: mean 3.62, SD 1.35 out of 6) compared to physicians (score: mean 3.88, SD 1.03 out 6). Conclusions: The quality ratings from physicians and patients were comparable and indicated mediocre app quality. Technical affinity, as assessed by using the ATI scale, was slightly lower for patients. Adequate apps for patients with chronic wounds remain limited, emphasizing the need for improved app development to meet patient needs. The ATI scale proved valuable for assessing technical affinity among different user groups.}, author = {Dege, Tassilo and Glatzel, Bernadette and Borst, Vanessa and Grän, Franziska and Goller, Simon and Glatzel, Caroline and Goebeler, Matthias and Schmieder, Astrid}, journal = {JMIR mHealth and uHealth}, keywords = {t_journalmagazine}, month = {03}, title = {Patient-Centered Chronic Wound Care Mobile Apps: Systematic Identification, Analysis, and Assessment}, volume = 12, year = 2024 }

  %0 Journal Article %1 dege2024patientcentered %A Dege, Tassilo %A Glatzel, Bernadette %A Borst, Vanessa %A Grän, Franziska %A Goller, Simon %A Glatzel, Caroline %A Goebeler, Matthias %A Schmieder, Astrid %D 2024 %J JMIR mHealth and uHealth %R 10.2196/51592 %T Patient-Centered Chronic Wound Care Mobile Apps: Systematic Identification, Analysis, and Assessment %U https://doi.org/10.2196/51592 %V 12 %X Background: The prevalence of chronic wounds is predicted to increase within the aging populations in industrialized countries. Patients experience significant distress due to pain, wound secretions, and the resulting immobilization. As the number of wounds continues to rise, their adequate care becomes increasingly costly in terms of health care resources worldwide. eHealth support systems are being increasingly integrated into patient care. However, to date, no systematic analysis of such apps for chronic wounds has been published. Objective: The aims of this study were to systematically identify and subjectively assess publicly available German- or English-language mobile apps for patients with chronic wounds, with quality assessments performed by both patients and physicians. Methods: Two reviewers independently conducted a systematic search and assessment of German- or English-language mobile apps for patients with chronic wounds that were available in the Google Play Store and Apple App Store from April 2022 to May 2022. In total, 3 apps met the inclusion and exclusion criteria and were reviewed independently by 10 physicians using the German Mobile App Rating Scale (MARS) and the System Usability Scale (SUS). The app with the highest mean MARS score was subsequently reviewed by 11 patients with chronic wounds using the German user version of the MARS (uMARS) and the SUS. Additionally, Affinity for Technology Interaction (ATI) scale scores were collected from both patients and physicians. Results: This study assessed mobile apps for patients with chronic wounds that were selected from a pool of 118 identified apps. Of the 73 apps available in both app stores, 10 were patient oriented. After excluding apps with advertisements or costs, 3 apps were evaluated by 10 physicians. Mean MARS scores ranged from 2.64 (SD 0.65) to 3.88 (SD 0.65) out of 5, and mean SUS scores ranged from 50.75 (SD 27) to 80.5 (SD 17.7) out of 100. WUND APP received the highest mean MARS score (mean 3.88, SD 0.65 out of 5) among physicians. Hence, it was subsequently assessed by 11 patients and achieved a similar rating (uMARS score: mean 3.89, SD 0.4 out of 5). Technical affinity, as measured with the ATI scale, was slightly lower in patients (score: mean 3.62, SD 1.35 out of 6) compared to physicians (score: mean 3.88, SD 1.03 out 6). Conclusions: The quality ratings from physicians and patients were comparable and indicated mediocre app quality. Technical affinity, as assessed by using the ATI scale, was slightly lower for patients. Adequate apps for patients with chronic wounds remain limited, emphasizing the need for improved app development to meet patient needs. The ATI scale proved valuable for assessing technical affinity among different user groups.
• 
  Evaluation is key: a survey on evaluation measures for synthetic time series. M. Stenger; R. Leppich; I. Foster; S. Kounev; A. Bauer; in Journal of Big Data (2024). 11 66.
  • [ BibTeX ]
  • [ EndNote ]
  @article{Stenger2024, author = {Stenger, Michael and Leppich, Robert and Foster, Ian and Kounev, Samuel and Bauer, Andr{\'e}}, journal = {Journal of Big Data}, keywords = {t_journalmagazine}, month = {05}, pages = 66, title = {Evaluation is key: a survey on evaluation measures for synthetic time series}, volume = 11, year = 2024 }

  %0 Journal Article %1 Stenger2024 %A Stenger, Michael %A Leppich, Robert %A Foster, Ian %A Kounev, Samuel %A Bauer, André %D 2024 %J Journal of Big Data %P 66 %T Evaluation is key: a survey on evaluation measures for synthetic time series %V 11
• 
  Comprehensive Exploration of Synthetic Data Generation: A Survey. A. Bauer; S. and Trapp; M. and Stenger; R. and Leppich; S. and Kounev; M. and Leznik; K. and Chard; I. and Foster; in arXiv preprint (2024). 103.

  https://doi.org/10.48550/arXiv.2401.02524
  • [ BibTeX ]
  • [ EndNote ]
  @article{bauer2024comprehensive, author = {Bauer, André and and Trapp, Simon and and Stenger, Michael and and Leppich, Robert and and Kounev, Samuel and and Leznik, Mark and and Chard, Kyle and and Foster, Ian}, journal = {arXiv preprint}, keywords = {t_journalmagazine}, note = {https://doi.org/10.48550/arXiv.2401.02524}, pages = 103, title = {Comprehensive Exploration of Synthetic Data Generation: A Survey}, year = 2024 }

  %0 Journal Article %1 bauer2024comprehensive %A Bauer, André %A and Trapp, Simon %A and Stenger, Michael %A and Leppich, Robert %A and Kounev, Samuel %A and Leznik, Mark %A and Chard, Kyle %A and Foster, Ian %D 2024 %J arXiv preprint %P 103 %T Comprehensive Exploration of Synthetic Data Generation: A Survey

• 
  Challenges and Future Directions in Efficiency Benchmarking (Vision Paper). M. Meissner; K.-D. Lange; S. Sharma; J. Arnold; A. Cragin; P. Galizia; M. Petrich; B. Zhang; S. Kounev; in Companion of the 2023 ACM/SPEC International Conference on Performance Engineering (2023). 51–55.
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  SPEC benchmarks are crucial contributors behind the improvement of server efficiency since 2007, given their role in making the power consumption and efficiency of servers transparent for government regulators, customers, and the manufacturers themselves.As the IT landscape experiences radical transformations, efficiency benchmarks need to be updated accordingly to generate results relevant to government regulators, manufacturers, and customers. In this paper, we outline current challenges efficiency benchmark developers are tackling and highlight recent technological developments the next generation of efficiency benchmarks should take into account.

  @inproceedings{10.1145/3578245.3585034, abstract = {SPEC benchmarks are crucial contributors behind the improvement of server efficiency since 2007, given their role in making the power consumption and efficiency of servers transparent for government regulators, customers, and the manufacturers themselves.As the IT landscape experiences radical transformations, efficiency benchmarks need to be updated accordingly to generate results relevant to government regulators, manufacturers, and customers. In this paper, we outline current challenges efficiency benchmark developers are tackling and highlight recent technological developments the next generation of efficiency benchmarks should take into account.}, address = {New York, NY, USA}, author = {Meissner, Maximilian and Lange, Klaus-Dieter and Sharma, Sanjay and Arnold, Jeremy and Cragin, Aaron and Galizia, Patrick and Petrich, Mike and Zhang, Bin and Kounev, Samuel}, booktitle = {Companion of the 2023 ACM/SPEC International Conference on Performance Engineering}, keywords = {descartes}, pages = {51–55}, publisher = {Association for Computing Machinery}, series = {ICPE '23 Companion}, title = {Challenges and Future Directions in Efficiency Benchmarking (Vision Paper)}, year = 2023 }

  %0 Conference Paper %1 10.1145/3578245.3585034 %A Meissner, Maximilian %A Lange, Klaus-Dieter %A Sharma, Sanjay %A Arnold, Jeremy %A Cragin, Aaron %A Galizia, Patrick %A Petrich, Mike %A Zhang, Bin %A Kounev, Samuel %B Companion of the 2023 ACM/SPEC International Conference on Performance Engineering %C New York, NY, USA %D 2023 %I Association for Computing Machinery %P 51–55 %T Challenges and Future Directions in Efficiency Benchmarking (Vision Paper) %U https://doi.org/10.1145/3578245.3585034 %X SPEC benchmarks are crucial contributors behind the improvement of server efficiency since 2007, given their role in making the power consumption and efficiency of servers transparent for government regulators, customers, and the manufacturers themselves.As the IT landscape experiences radical transformations, efficiency benchmarks need to be updated accordingly to generate results relevant to government regulators, manufacturers, and customers. In this paper, we outline current challenges efficiency benchmark developers are tackling and highlight recent technological developments the next generation of efficiency benchmarks should take into account.
• 
  BLOCSIE - Benchmark for LOCalization in a Simulated Industrial Environment. F. Spiess; D. Bluemm; N. Strobel; T. Kaupp; S. Kounev; in 2023 21st International Conference on Advanced Robotics (ICAR) (2023). 577–584.
  • [ BibTeX ]
  • [ EndNote ]
  @inproceedings{10406777, author = {Spiess, Florian and Bluemm, Daniel and Strobel, Norbert and Kaupp, Tobias and Kounev, Samuel}, booktitle = {2023 21st International Conference on Advanced Robotics (ICAR)}, keywords = {descartes}, pages = {577-584}, title = {BLOCSIE - Benchmark for LOCalization in a Simulated Industrial Environment}, year = 2023 }

  %0 Conference Paper %1 10406777 %A Spiess, Florian %A Bluemm, Daniel %A Strobel, Norbert %A Kaupp, Tobias %A Kounev, Samuel %B 2023 21st International Conference on Advanced Robotics (ICAR) %D 2023 %P 577-584 %T BLOCSIE - Benchmark for LOCalization in a Simulated Industrial Environment
• 
  Autoscaler Evaluation and Configuration: A Practitioner’s Guideline. M. Straesser; S. Eismann; J. von Kistowski; A. Bauer; S. Kounev; in Proceedings of the 2023 ACM/SPEC International Conference on Performance Engineering (2023). 31–41.
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  • [ DOI ]
  • [ Download ]
  Autoscalers are indispensable parts of modern cloud deployments and determine the service quality and cost of a cloud application in dynamic workloads. The configuration of an autoscaler strongly influences its performance and is also one of the biggest challenges and showstoppers for the practical applicability of many research autoscalers. Many proposed cloud experiment methodologies can only be partially applied in practice, and many autoscaling papers use custom evaluation methods and metrics. This paper presents a practical guideline for obtaining meaningful and interpretable results on autoscaler performance with reasonable overhead. We provide step-by-step instructions for defining realistic usage behaviors and traffic patterns. We divide the analysis of autoscaler performance into a qualitative antipattern-based analysis and a quantitative analysis. To demonstrate the applicability of our guideline, we conduct several experiments with a microservice of our industry partner in a realistic test environment.

  @inproceedings{straesser2023guideline, abstract = {Autoscalers are indispensable parts of modern cloud deployments and determine the service quality and cost of a cloud application in dynamic workloads. The configuration of an autoscaler strongly influences its performance and is also one of the biggest challenges and showstoppers for the practical applicability of many research autoscalers. Many proposed cloud experiment methodologies can only be partially applied in practice, and many autoscaling papers use custom evaluation methods and metrics. This paper presents a practical guideline for obtaining meaningful and interpretable results on autoscaler performance with reasonable overhead. We provide step-by-step instructions for defining realistic usage behaviors and traffic patterns. We divide the analysis of autoscaler performance into a qualitative antipattern-based analysis and a quantitative analysis. To demonstrate the applicability of our guideline, we conduct several experiments with a microservice of our industry partner in a realistic test environment.}, address = {New York, NY, USA}, author = {Straesser, Martin and Eismann, Simon and von Kistowski, J\'{o}akim and Bauer, Andr\'{e} and Kounev, Samuel}, booktitle = {Proceedings of the 2023 ACM/SPEC International Conference on Performance Engineering}, keywords = {methodology}, pages = {31-41}, publisher = {Association for Computing Machinery}, series = {ICPE '23}, title = {Autoscaler Evaluation and Configuration: A Practitioner's Guideline}, year = 2023 }

  %0 Conference Paper %1 straesser2023guideline %A Straesser, Martin %A Eismann, Simon %A von Kistowski, Jóakim %A Bauer, André %A Kounev, Samuel %B Proceedings of the 2023 ACM/SPEC International Conference on Performance Engineering %C New York, NY, USA %D 2023 %I Association for Computing Machinery %P 31-41 %R 10.1145/3578244.3583721 %T Autoscaler Evaluation and Configuration: A Practitioner's Guideline %U https://doi.org/10.1145/3578244.3583721 %X Autoscalers are indispensable parts of modern cloud deployments and determine the service quality and cost of a cloud application in dynamic workloads. The configuration of an autoscaler strongly influences its performance and is also one of the biggest challenges and showstoppers for the practical applicability of many research autoscalers. Many proposed cloud experiment methodologies can only be partially applied in practice, and many autoscaling papers use custom evaluation methods and metrics. This paper presents a practical guideline for obtaining meaningful and interpretable results on autoscaler performance with reasonable overhead. We provide step-by-step instructions for defining realistic usage behaviors and traffic patterns. We divide the analysis of autoscaler performance into a qualitative antipattern-based analysis and a quantitative analysis. To demonstrate the applicability of our guideline, we conduct several experiments with a microservice of our industry partner in a realistic test environment. %@ 9798400700682
• 
  Performance Engineering of Serverless Applications and Platforms. S. Eismann; Thesis; Universität Würzburg. (2023).
  • [ BibTeX ]
  • [ EndNote ]
  • [ Download ]
  @phdthesis{Eismann2023, author = {Eismann, Simon}, keywords = {descartes}, school = {Universit{\"a}t W{\"u}rzburg}, title = {Performance Engineering of Serverless Applications and Platforms}, type = {doctoralthesis}, year = 2023 }

  %0 Thesis %1 Eismann2023 %A Eismann, Simon %D 2023 %T Performance Engineering of Serverless Applications and Platforms
• 
  Kubernetes-in-the-Loop: Enriching Microservice Simulation Through Authentic Container Orchestration. M. Straesser; P. Haas; S. Frank; A. Hakamian; A. Van Hoorn; S. Kounev; in Performance Evaluation Methodologies and Tools (2023).

  In print.
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  • [ Download ]
  Microservices deployed and managed by container orchestration frameworks like Kubernetes are the bases of modern cloud applications. In microservice performance modeling and prediction, simulations provide a lightweight alternative to experimental analysis, which requires dedicated infrastructure and a laborious setup. However, existing simulators cannot run realistic scenarios, as performance-critical orchestration mechanisms (like scheduling or autoscaling) are manually modeled and can consequently not be represented in their full complexity and configuration space. This work combines a state-of-the-art simulation for microservice performance with Kubernetes container orchestration. Hereby, we include the original implementation of Kubernetes artifacts enabling realistic scenarios and testing of orchestration policies with low overhead. In two experiments with Kubernetes' kube-scheduler and cluster-autoscaler, we demonstrate that our framework can correctly handle different configurations of these orchestration mechanisms boosting both the simulation's use cases and authenticity.

  @inproceedings{straesser2023kubernetesintheloop, abstract = {Microservices deployed and managed by container orchestration frameworks like Kubernetes are the bases of modern cloud applications. In microservice performance modeling and prediction, simulations provide a lightweight alternative to experimental analysis, which requires dedicated infrastructure and a laborious setup. However, existing simulators cannot run realistic scenarios, as performance-critical orchestration mechanisms (like scheduling or autoscaling) are manually modeled and can consequently not be represented in their full complexity and configuration space. This work combines a state-of-the-art simulation for microservice performance with Kubernetes container orchestration. Hereby, we include the original implementation of Kubernetes artifacts enabling realistic scenarios and testing of orchestration policies with low overhead. In two experiments with Kubernetes' kube-scheduler and cluster-autoscaler, we demonstrate that our framework can correctly handle different configurations of these orchestration mechanisms boosting both the simulation's use cases and authenticity.}, author = {Straesser, Martin and Haas, Patrick and Frank, Sebastian and Hakamian, Alireza and Van Hoorn, André and Kounev, Samuel}, booktitle = {Performance Evaluation Methodologies and Tools}, keywords = {discrete_event_simulation}, note = {In print.}, title = {Kubernetes-in-the-Loop: Enriching Microservice Simulation Through Authentic Container Orchestration}, year = 2023 }

  %0 Conference Paper %1 straesser2023kubernetesintheloop %A Straesser, Martin %A Haas, Patrick %A Frank, Sebastian %A Hakamian, Alireza %A Van Hoorn, André %A Kounev, Samuel %B Performance Evaluation Methodologies and Tools %D 2023 %T Kubernetes-in-the-Loop: Enriching Microservice Simulation Through Authentic Container Orchestration %X Microservices deployed and managed by container orchestration frameworks like Kubernetes are the bases of modern cloud applications. In microservice performance modeling and prediction, simulations provide a lightweight alternative to experimental analysis, which requires dedicated infrastructure and a laborious setup. However, existing simulators cannot run realistic scenarios, as performance-critical orchestration mechanisms (like scheduling or autoscaling) are manually modeled and can consequently not be represented in their full complexity and configuration space. This work combines a state-of-the-art simulation for microservice performance with Kubernetes container orchestration. Hereby, we include the original implementation of Kubernetes artifacts enabling realistic scenarios and testing of orchestration policies with low overhead. In two experiments with Kubernetes' kube-scheduler and cluster-autoscaler, we demonstrate that our framework can correctly handle different configurations of these orchestration mechanisms boosting both the simulation's use cases and authenticity.
• 
  ExDe: Design space exploration of scheduler architectures and mechanisms for serverless data-processing. S. Talluri; N. Herbst; C. Abad; T. De Matteis; A. Iosup; in Future Generation Computer Systems (2023).

  https://www.sciencedirect.com/science/article/pii/S0167739X23004211
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  Serverless computing is increasingly used for data-processing applications in both science and business domains. At the core of serverless data-processing systems is the scheduler, which ensures dynamic decisions about task and data placement. Due to the variety of user, cluster, and workload properties, the design space for high-performance and cost-effective scheduling architectures and mechanisms is vast. The large design space is difficult to explore and characterize. To help the system designer disentangle this complexity, we present ExDe, a framework to systematically explore the design space of scheduling architectures and mechanisms. The framework includes a conceptual model and a simulator to assist in design space exploration. We use the framework, and real-world workloads, to characterize the performance of three scheduling architectures and two mechanisms. Our framework is open-source software available on Zenodo.

  @article{TALLURI2023, abstract = {Serverless computing is increasingly used for data-processing applications in both science and business domains. At the core of serverless data-processing systems is the scheduler, which ensures dynamic decisions about task and data placement. Due to the variety of user, cluster, and workload properties, the design space for high-performance and cost-effective scheduling architectures and mechanisms is vast. The large design space is difficult to explore and characterize. To help the system designer disentangle this complexity, we present ExDe, a framework to systematically explore the design space of scheduling architectures and mechanisms. The framework includes a conceptual model and a simulator to assist in design space exploration. We use the framework, and real-world workloads, to characterize the performance of three scheduling architectures and two mechanisms. Our framework is open-source software available on Zenodo.}, author = {Talluri, Sacheendra and Herbst, Nikolas and Abad, Cristina and {De Matteis}, Tiziano and Iosup, Alexandru}, journal = {Future Generation Computer Systems}, keywords = {t_journalmagazine}, note = {https://www.sciencedirect.com/science/article/pii/S0167739X23004211}, title = {ExDe: Design space exploration of scheduler architectures and mechanisms for serverless data-processing}, year = 2023 }

  %0 Journal Article %1 TALLURI2023 %A Talluri, Sacheendra %A Herbst, Nikolas %A Abad, Cristina %A De Matteis, Tiziano %A Iosup, Alexandru %D 2023 %J Future Generation Computer Systems %T ExDe: Design space exploration of scheduler architectures and mechanisms for serverless data-processing %U https://www.sciencedirect.com/science/article/pii/S0167739X23004211 %X Serverless computing is increasingly used for data-processing applications in both science and business domains. At the core of serverless data-processing systems is the scheduler, which ensures dynamic decisions about task and data placement. Due to the variety of user, cluster, and workload properties, the design space for high-performance and cost-effective scheduling architectures and mechanisms is vast. The large design space is difficult to explore and characterize. To help the system designer disentangle this complexity, we present ExDe, a framework to systematically explore the design space of scheduling architectures and mechanisms. The framework includes a conceptual model and a simulator to assist in design space exploration. We use the framework, and real-world workloads, to characterize the performance of three scheduling architectures and two mechanisms. Our framework is open-source software available on Zenodo.
• 
  Performance Impact Analysis of Homomorphic Encryption: A Case Study Using Linear Regression as an Example. T. Prantl; S. Engel; L. Horn; D. Kaiser; L. Iffländer; A. Bauer; C. Krupitzer; S. Kounev; in Information Security Practice and Experience, W. Meng, Z. Yan, V. Piuri (Hrsg.) (2023). 284–298.
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  In recent years, the trend has increasingly been to store and process data in the cloud. However, this is based on the premise that cloud providers treat the data in a trustworthy manner. One way of using the data in the cloud without the provider having access to it is homomorphic encryption. However, since this encryption has only recently become practicable, analysis of its for practical applications is still in its infancy. Therefore, we investigate the performance of homomorphic encryption using a real-world application, namely linear regression. Our main finding is that although the homomorphic computation of linear regression is in the range of minutes and thus slower than in the non-homomorphic case, linear regression can be computed homomorphic and is therefore suitable for use cases where data security is the top priority.

  @inproceedings{PrEnHoDeIfBaKrKo_ISPEC_De_Bello, abstract = {In recent years, the trend has increasingly been to store and process data in the cloud. However, this is based on the premise that cloud providers treat the data in a trustworthy manner. One way of using the data in the cloud without the provider having access to it is homomorphic encryption. However, since this encryption has only recently become practicable, analysis of its for practical applications is still in its infancy. Therefore, we investigate the performance of homomorphic encryption using a real-world application, namely linear regression. Our main finding is that although the homomorphic computation of linear regression is in the range of minutes and thus slower than in the non-homomorphic case, linear regression can be computed homomorphic and is therefore suitable for use cases where data security is the top priority.}, address = {Singapore}, author = {Prantl, Thomas and Engel, Simon and Horn, Lukas and Kaiser, Dennis and Iffl\"ander, Lukas and Bauer, Andr\'e and Krupitzer, Christian and Kounev, Samuel}, booktitle = {Information Security Practice and Experience}, editor = {Meng, Weizhi and Yan, Zheng and Piuri, Vincenzo}, keywords = {t_proceedings}, pages = {284–298}, publisher = {Springer Nature Singapore}, title = {Performance Impact Analysis of Homomorphic Encryption: A Case Study Using Linear Regression as an Example}, year = 2023 }

  %0 Conference Paper %1 PrEnHoDeIfBaKrKo_ISPEC_De_Bello %A Prantl, Thomas %A Engel, Simon %A Horn, Lukas %A Kaiser, Dennis %A Iffländer, Lukas %A Bauer, André %A Krupitzer, Christian %A Kounev, Samuel %B Information Security Practice and Experience %C Singapore %D 2023 %E Meng, Weizhi %E Yan, Zheng %E Piuri, Vincenzo %I Springer Nature Singapore %P 284--298 %T Performance Impact Analysis of Homomorphic Encryption: A Case Study Using Linear Regression as an Example %X In recent years, the trend has increasingly been to store and process data in the cloud. However, this is based on the premise that cloud providers treat the data in a trustworthy manner. One way of using the data in the cloud without the provider having access to it is homomorphic encryption. However, since this encryption has only recently become practicable, analysis of its for practical applications is still in its infancy. Therefore, we investigate the performance of homomorphic encryption using a real-world application, namely linear regression. Our main finding is that although the homomorphic computation of linear regression is in the range of minutes and thus slower than in the non-homomorphic case, linear regression can be computed homomorphic and is therefore suitable for use cases where data security is the top priority. %@ 978-981-99-7032-2
• 
  Searching for the Ground Truth: Assessing the Similarity of Benchmarking Runs. A. Bauer; M. Straesser; M. Leznik; L. Beierlieb; M. Hadry; N. Hudson; K. Chard; S. Kounev; I. Foster; in Companion of the 2023 ACM/SPEC International Conference on Performance Engineering (2023). 95–99.
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  • [ Download ]
  Stable and repeatable measurements are essential for comparing the performance of different systems or applications, and benchmarks are used to ensure accuracy and replication. However, if the corresponding measurements are not stable and repeatable, wrong conclusions can be drawn. To facilitate the task of determining whether the measurements are similar, we used a data set of 586 micro-benchmarks to (i) analyze the data set itself, (ii) examine our previous approach, and (iii) propose and evaluate a heuristic. To evaluate the different approaches, we perform a peer review to assess the dissimilarity of the benchmark runs. Our results show that this task is challenging even for humans and that our heuristic exhibits a sensitivity of 92%.

  @inproceedings{10.1145/3578245.3584693, abstract = {Stable and repeatable measurements are essential for comparing the performance of different systems or applications, and benchmarks are used to ensure accuracy and replication. However, if the corresponding measurements are not stable and repeatable, wrong conclusions can be drawn. To facilitate the task of determining whether the measurements are similar, we used a data set of 586 micro-benchmarks to (i) analyze the data set itself, (ii) examine our previous approach, and (iii) propose and evaluate a heuristic. To evaluate the different approaches, we perform a peer review to assess the dissimilarity of the benchmark runs. Our results show that this task is challenging even for humans and that our heuristic exhibits a sensitivity of 92%.}, address = {New York, NY, USA}, author = {Bauer, Andr\'{e} and Straesser, Martin and Leznik, Mark and Beierlieb, Lukas and Hadry, Marius and Hudson, Nathaniel and Chard, Kyle and Kounev, Samuel and Foster, Ian}, booktitle = {Companion of the 2023 ACM/SPEC International Conference on Performance Engineering}, keywords = {distance_measures}, pages = {95–99}, publisher = {Association for Computing Machinery}, series = {ICPE '23 Companion}, title = {Searching for the Ground Truth: Assessing the Similarity of Benchmarking Runs}, year = 2023 }

  %0 Conference Paper %1 10.1145/3578245.3584693 %A Bauer, André %A Straesser, Martin %A Leznik, Mark %A Beierlieb, Lukas %A Hadry, Marius %A Hudson, Nathaniel %A Chard, Kyle %A Kounev, Samuel %A Foster, Ian %B Companion of the 2023 ACM/SPEC International Conference on Performance Engineering %C New York, NY, USA %D 2023 %I Association for Computing Machinery %P 95–99 %T Searching for the Ground Truth: Assessing the Similarity of Benchmarking Runs %U https://doi.org/10.1145/3578245.3584693 %X Stable and repeatable measurements are essential for comparing the performance of different systems or applications, and benchmarks are used to ensure accuracy and replication. However, if the corresponding measurements are not stable and repeatable, wrong conclusions can be drawn. To facilitate the task of determining whether the measurements are similar, we used a data set of 586 micro-benchmarks to (i) analyze the data set itself, (ii) examine our previous approach, and (iii) propose and evaluate a heuristic. To evaluate the different approaches, we perform a peer review to assess the dissimilarity of the benchmark runs. Our results show that this task is challenging even for humans and that our heuristic exhibits a sensitivity of 92%.
• 
  Towards a Cryptography Encyclopedia: A Survey on Attribute-Based Encryption. T. Prantl; T. Zeck; L. Horn; L. Iffländer; A. Bauer; A. Dmitrienko; C. Krupitzer; S. Kounev; in Journal of Surveillance, Security and Safety (2023).
  • [ BibTeX ]
  • [ EndNote ]
  • [ DOI ]
  @article{PrZeHoIfBaDmKrKo_ABESurvey, author = {Prantl, Thomas and Zeck, Timo and Horn, Lukas and Iffl\"ander, Lukas and Bauer, Andr\'e and Dmitrienko, Alexandra and Krupitzer, Christian and Kounev, Samuel}, journal = {Journal of Surveillance, Security and Safety}, keywords = {t_journalmagazine}, title = {Towards a Cryptography Encyclopedia: A Survey on Attribute-Based Encryption}, year = 2023 }

  %0 Journal Article %1 PrZeHoIfBaDmKrKo_ABESurvey %A Prantl, Thomas %A Zeck, Timo %A Horn, Lukas %A Iffländer, Lukas %A Bauer, André %A Dmitrienko, Alexandra %A Krupitzer, Christian %A Kounev, Samuel %D 2023 %J Journal of Surveillance, Security and Safety %R http://dx.doi.org/10.20517/jsss.2023.30 %T Towards a Cryptography Encyclopedia: A Survey on Attribute-Based Encryption
• 
  Power to the Applications: The Vision of Continuous Decentralized Autoscaling. M. Straesser; S. Geißler; T. Hoßfeld; S. Kounev; in 2023 IEEE/ACM 23rd International Symposium on Cluster, Cloud and Internet Computing Workshops (CCGridW) (2023). 281–283.
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  • [ DOI ]
  • [ Download ]
  @inproceedings{straesser2023decentral, author = {Straesser, Martin and Geißler, Stefan and Hoßfeld, Tobias and Kounev, Samuel}, booktitle = {2023 IEEE/ACM 23rd International Symposium on Cluster, Cloud and Internet Computing Workshops (CCGridW)}, keywords = {t_poster}, pages = {281-283}, publisher = {IEEE}, title = {Power to the Applications: The Vision of Continuous Decentralized Autoscaling}, year = 2023 }

  %0 Conference Paper %1 straesser2023decentral %A Straesser, Martin %A Geißler, Stefan %A Hoßfeld, Tobias %A Kounev, Samuel %B 2023 IEEE/ACM 23rd International Symposium on Cluster, Cloud and Internet Computing Workshops (CCGridW) %D 2023 %I IEEE %P 281-283 %R 10.1109/CCGridW59191.2023.00058 %T Power to the Applications: The Vision of Continuous Decentralized Autoscaling %U https://doi.org/10.1109/CCGridW59191.2023.00058
• 
  Deep Neural Network Regression for Normalized Digital Surface Model Generation with Sentinel-2 Imagery. K. Müller; R. Leppich; C. Geiß; V. Borst; P. A. Pelizari; S. Kounev; in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing (2023). 1–14.
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  In recent history, normalized digital surface models (nDSMs) have been constantly gaining importance as a means to solve large-scale geographic problems. High-resolution surface models are precious, as they can provide detailed information for a specific area. However, measurements with a high resolution are time-consuming and costly. Only a few approaches exist to create high-resolution normalized digital surface models for extensive areas. This paper explores approaches to extract high-resolution nDSMs from low-resolution Sentinel-2 data, allowing us to derive large-scale models. We thereby utilize the advantages of Sentinel 2 being open access, having global coverage, and providing steady updates through a high repetition rate. Several deep-learning models are trained to overcome the gap in producing high-resolution surface maps from low-resolution input data. With U-Net as a base architecture, we extend the capabilities of our model by integrating tailored multiscale encoders with differently sized kernels in the convolution as well as conformed self-attention inside the skip connection gates. Using pixel-wise regression, our U-Net base models can achieve a mean height error of approximately two meters. Moreover, through our enhancements to the model architecture, we reduce the model error by more than seven percent.

  @article{10189905, abstract = {In recent history, normalized digital surface models (nDSMs) have been constantly gaining importance as a means to solve large-scale geographic problems. High-resolution surface models are precious, as they can provide detailed information for a specific area. However, measurements with a high resolution are time-consuming and costly. Only a few approaches exist to create high-resolution normalized digital surface models for extensive areas. This paper explores approaches to extract high-resolution nDSMs from low-resolution Sentinel-2 data, allowing us to derive large-scale models. We thereby utilize the advantages of Sentinel 2 being open access, having global coverage, and providing steady updates through a high repetition rate. Several deep-learning models are trained to overcome the gap in producing high-resolution surface maps from low-resolution input data. With U-Net as a base architecture, we extend the capabilities of our model by integrating tailored multiscale encoders with differently sized kernels in the convolution as well as conformed self-attention inside the skip connection gates. Using pixel-wise regression, our U-Net base models can achieve a mean height error of approximately two meters. Moreover, through our enhancements to the model architecture, we reduce the model error by more than seven percent.}, author = {Müller, Konstantin and Leppich, Robert and Geiß, Christian and Borst, Vanessa and Pelizari, Patrick Aravena and Kounev, Samuel}, journal = {IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing}, keywords = {t_journalmagazine}, pages = {1-14}, title = {Deep Neural Network Regression for Normalized Digital Surface Model Generation with Sentinel-2 Imagery}, year = 2023 }

  %0 Journal Article %1 10189905 %A Müller, Konstantin %A Leppich, Robert %A Geiß, Christian %A Borst, Vanessa %A Pelizari, Patrick Aravena %A Kounev, Samuel %D 2023 %J IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing %P 1-14 %T Deep Neural Network Regression for Normalized Digital Surface Model Generation with Sentinel-2 Imagery %X In recent history, normalized digital surface models (nDSMs) have been constantly gaining importance as a means to solve large-scale geographic problems. High-resolution surface models are precious, as they can provide detailed information for a specific area. However, measurements with a high resolution are time-consuming and costly. Only a few approaches exist to create high-resolution normalized digital surface models for extensive areas. This paper explores approaches to extract high-resolution nDSMs from low-resolution Sentinel-2 data, allowing us to derive large-scale models. We thereby utilize the advantages of Sentinel 2 being open access, having global coverage, and providing steady updates through a high repetition rate. Several deep-learning models are trained to overcome the gap in producing high-resolution surface maps from low-resolution input data. With U-Net as a base architecture, we extend the capabilities of our model by integrating tailored multiscale encoders with differently sized kernels in the convolution as well as conformed self-attention inside the skip connection gates. Using pixel-wise regression, our U-Net base models can achieve a mean height error of approximately two meters. Moreover, through our enhancements to the model architecture, we reduce the model error by more than seven percent.
• 
  A literature review of IoT and CPS—What they are, and what they are not. V. Lesch; M. Züfle; A. Bauer; L. Iffländer; C. Krupitzer; S. Kounev; in Journal of Systems and Software (2023). 111631.
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  • [ Download ]
  Today, we are confronted with many concepts such as Cyber–Physical-Systems (CPS), Internet of Things (IoT), Industry 4.0, Industrial Internet, Ubiquitous Computing, Pervasive Computing and many more. Some researchers use all of these terms interchangeably, while others interpret them in ways that contradict each other. The inconsistent and interchangeable usage of these terms creates the impression that authors abuse them as buzzwords to attract attention. Hence, the question arises: Is the existence of all these terms justified? In this paper, we first look at the origin of the terms. Then, we focus on Internet of Things (IoT) and Cyber-Physical-Systems (CPS) as those terms are more often used as the others and further often seen as underlying technologies. We presentthe results of a literature review, including academic, industry and gray literature, with the objective to identify and discuss several clusters of similar statements on both terms. Building on this, we present definitions for IoT and CPS that reflect the core intuition of the terms as found in the literature review while providing a clear demarcation of the two terms. Then, we illustrate the applicability of our findings on several use cases. Finally, we discuss the relation to the other topics closely related to adaptive systems, namely Industry 4.0, Industrial Internet, Ubiquitous Computing, and Pervasive Computing.

  @article{lesch2023literature, abstract = {Today, we are confronted with many concepts such as Cyber–Physical-Systems (CPS), Internet of Things (IoT), Industry 4.0, Industrial Internet, Ubiquitous Computing, Pervasive Computing and many more. Some researchers use all of these terms interchangeably, while others interpret them in ways that contradict each other. The inconsistent and interchangeable usage of these terms creates the impression that authors abuse them as buzzwords to attract attention. Hence, the question arises: Is the existence of all these terms justified? In this paper, we first look at the origin of the terms. Then, we focus on Internet of Things (IoT) and Cyber-Physical-Systems (CPS) as those terms are more often used as the others and further often seen as underlying technologies. We presentthe results of a literature review, including academic, industry and gray literature, with the objective to identify and discuss several clusters of similar statements on both terms. Building on this, we present definitions for IoT and CPS that reflect the core intuition of the terms as found in the literature review while providing a clear demarcation of the two terms. Then, we illustrate the applicability of our findings on several use cases. Finally, we discuss the relation to the other topics closely related to adaptive systems, namely Industry 4.0, Industrial Internet, Ubiquitous Computing, and Pervasive Computing.}, author = {Lesch, Veronika and Z{\"u}fle, Marwin and Bauer, Andr{\'e} and Iffl{\"a}nder, Lukas and Krupitzer, Christian and Kounev, Samuel}, journal = {Journal of Systems and Software}, keywords = {t_journalmagazine}, pages = 111631, publisher = {Elsevier}, title = {A literature review of IoT and CPS—What they are, and what they are not}, year = 2023 }

  %0 Journal Article %1 lesch2023literature %A Lesch, Veronika %A Züfle, Marwin %A Bauer, André %A Iffländer, Lukas %A Krupitzer, Christian %A Kounev, Samuel %D 2023 %I Elsevier %J Journal of Systems and Software %P 111631 %T A literature review of IoT and CPS—What they are, and what they are not %U https://www.sciencedirect.com/science/article/pii/S0164121223000262 %X Today, we are confronted with many concepts such as Cyber–Physical-Systems (CPS), Internet of Things (IoT), Industry 4.0, Industrial Internet, Ubiquitous Computing, Pervasive Computing and many more. Some researchers use all of these terms interchangeably, while others interpret them in ways that contradict each other. The inconsistent and interchangeable usage of these terms creates the impression that authors abuse them as buzzwords to attract attention. Hence, the question arises: Is the existence of all these terms justified? In this paper, we first look at the origin of the terms. Then, we focus on Internet of Things (IoT) and Cyber-Physical-Systems (CPS) as those terms are more often used as the others and further often seen as underlying technologies. We presentthe results of a literature review, including academic, industry and gray literature, with the objective to identify and discuss several clusters of similar statements on both terms. Building on this, we present definitions for IoT and CPS that reflect the core intuition of the terms as found in the literature review while providing a clear demarcation of the two terms. Then, we illustrate the applicability of our findings on several use cases. Finally, we discuss the relation to the other topics closely related to adaptive systems, namely Industry 4.0, Industrial Internet, Ubiquitous Computing, and Pervasive Computing.
• 
  Recommendation of Secure Group Communication Schemes using Multi Objective Optimization. T. Prantl; A. Bauer; L. Iffländer; C. Krupitzer; S. Kounev; in International Journal of Information Security (2023).
  • [ BibTeX ]
  • [ EndNote ]
  @article{PrBaIfKrKo_IJoIS_SGC_Pareto, author = {Prantl, Thomas and Bauer, André and Iffländer, Lukas and Krupitzer, Christian and Kounev, Samuel}, journal = {International Journal of Information Security}, keywords = {t_journalmagazine}, title = {Recommendation of Secure Group Communication Schemes using Multi Objective Optimization}, year = 2023 }

  %0 Journal Article %1 PrBaIfKrKo_IJoIS_SGC_Pareto %A Prantl, Thomas %A Bauer, André %A Iffländer, Lukas %A Krupitzer, Christian %A Kounev, Samuel %D 2023 %J International Journal of Information Security %T Recommendation of Secure Group Communication Schemes using Multi Objective Optimization
• 
  An Empirical Study of Container Image Configurations and Their Impact on Start Times. M. Straesser; A. Bauer; R. Leppich; N. Herbst; K. Chard; I. Foster; S. Kounev; in 2023 IEEE/ACM 23rd International Symposium on Cluster, Cloud and Internet Computing (CCGrid) (2023). 94–105.
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  • [ DOI ]
  • [ Download ]
  @inproceedings{straesser2023starttime, author = {Straesser, Martin and Bauer, André and Leppich, Robert and Herbst, Nikolas and Chard, Kyle and Foster, Ian and Kounev, Samuel}, booktitle = {2023 IEEE/ACM 23rd International Symposium on Cluster, Cloud and Internet Computing (CCGrid)}, keywords = {empirical_study}, pages = {94-105}, publisher = {IEEE}, title = {An Empirical Study of Container Image Configurations and Their Impact on Start Times}, year = 2023 }

  %0 Conference Paper %1 straesser2023starttime %A Straesser, Martin %A Bauer, André %A Leppich, Robert %A Herbst, Nikolas %A Chard, Kyle %A Foster, Ian %A Kounev, Samuel %B 2023 IEEE/ACM 23rd International Symposium on Cluster, Cloud and Internet Computing (CCGrid) %D 2023 %I IEEE %P 94-105 %R 10.1109/CCGrid57682.2023.00019 %T An Empirical Study of Container Image Configurations and Their Impact on Start Times %U https://doi.org/10.1109/CCGrid57682.2023.00019
• 
  Segmentierung und Verlaufskontrolle chronischer Wunden durch künstliche Intelligenz mithilfe einer mobilen App (WUNDERKINT Studie). V. Borst; T. Dege; F. Grän; S. Hamrouni; D. Michel; V. Hager; M. Goebeler; R. Leppich; S. Kounev; A. Schmieder; in Allergologie. JDDG: Journal der Deutschen Dermatologischen Gesellschaft (2023). (Bd. 21) 28–177.

  Poster Abstract (No. P322, pp. 175-176)
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  • [ Download ]
  @incollection{borst_ddg23_v2, author = {Borst, Vanessa and Dege, Tassilo and Grän, Franziska and Hamrouni, Sandra and Michel, Daniel and Hager, Valerie and Goebeler, Matthias and Leppich, Robert and Kounev, Samuel and Schmieder, Astrid}, booktitle = {Allergologie. JDDG: Journal der Deutschen Dermatologischen Gesellschaft}, keywords = {t_poster}, month = {04}, note = {Poster Abstract (No. P322, pp. 175-176)}, number = {S1}, pages = {28-177}, publisher = {John Wiley & Sons Ltd.}, title = {Segmentierung und Verlaufskontrolle chronischer Wunden durch künstliche Intelligenz mithilfe einer mobilen App (WUNDERKINT Studie)}, volume = 21, year = 2023 }

  %0 Book Section %1 borst_ddg23_v2 %A Borst, Vanessa %A Dege, Tassilo %A Grän, Franziska %A Hamrouni, Sandra %A Michel, Daniel %A Hager, Valerie %A Goebeler, Matthias %A Leppich, Robert %A Kounev, Samuel %A Schmieder, Astrid %B Allergologie. JDDG: Journal der Deutschen Dermatologischen Gesellschaft %D 2023 %I John Wiley & Sons Ltd. %N S1 %P 28-177 %T Segmentierung und Verlaufskontrolle chronischer Wunden durch künstliche Intelligenz mithilfe einer mobilen App (WUNDERKINT Studie) %U https://doi.org/10.1111/ddg.15079_g %V 21
• 
  A Systematic Approach for Benchmarking of Container Orchestration Frameworks. M. Straesser; J. Mathiasch; A. Bauer; S. Kounev; in Proceedings of the 2023 ACM/SPEC International Conference on Performance Engineering (2023). 187–198.
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  • [ DOI ]
  • [ Download ]
  Container orchestration frameworks play a critical role in modern cloud computing paradigms such as cloud-native or serverless computing. They significantly impact the quality and cost of service deployment as they manage many performance-critical tasks such as container provisioning, scheduling, scaling, and networking. Consequently, a comprehensive performance assessment of container orchestration frameworks is essential. However, until now, there is no benchmarking approach that covers the many different tasks implemented in such platforms and supports evaluating different technology stacks. In this paper, we present a systematic approach that enables benchmarking of container orchestrators. Based on a definition of container orchestration, we define the core requirements and benchmarking scope for such platforms. Each requirement is then linked to metrics and measurement methods, and a benchmark architecture is proposed. With COFFEE, we introduce a benchmarking tool supporting the definition of complex test campaigns for container orchestration frameworks. We demonstrate the potential of our approach with case studies of the frameworks Kubernetes and Nomad in a self-hosted environment and on the Google Cloud Platform. The presented case studies focus on container startup times, crash recovery, rolling updates, and more.

  @inproceedings{straesser2023orchestration, abstract = {Container orchestration frameworks play a critical role in modern cloud computing paradigms such as cloud-native or serverless computing. They significantly impact the quality and cost of service deployment as they manage many performance-critical tasks such as container provisioning, scheduling, scaling, and networking. Consequently, a comprehensive performance assessment of container orchestration frameworks is essential. However, until now, there is no benchmarking approach that covers the many different tasks implemented in such platforms and supports evaluating different technology stacks. In this paper, we present a systematic approach that enables benchmarking of container orchestrators. Based on a definition of container orchestration, we define the core requirements and benchmarking scope for such platforms. Each requirement is then linked to metrics and measurement methods, and a benchmark architecture is proposed. With COFFEE, we introduce a benchmarking tool supporting the definition of complex test campaigns for container orchestration frameworks. We demonstrate the potential of our approach with case studies of the frameworks Kubernetes and Nomad in a self-hosted environment and on the Google Cloud Platform. The presented case studies focus on container startup times, crash recovery, rolling updates, and more.}, address = {New York, NY, USA}, author = {Straesser, Martin and Mathiasch, Jonas and Bauer, Andr\'{e} and Kounev, Samuel}, booktitle = {Proceedings of the 2023 ACM/SPEC International Conference on Performance Engineering}, keywords = {container_orchestration}, pages = {187-198}, publisher = {Association for Computing Machinery}, series = {ICPE '23}, title = {A Systematic Approach for Benchmarking of Container Orchestration Frameworks}, year = 2023 }

  %0 Conference Paper %1 straesser2023orchestration %A Straesser, Martin %A Mathiasch, Jonas %A Bauer, André %A Kounev, Samuel %B Proceedings of the 2023 ACM/SPEC International Conference on Performance Engineering %C New York, NY, USA %D 2023 %I Association for Computing Machinery %P 187-198 %R 10.1145/3578244.3583726 %T A Systematic Approach for Benchmarking of Container Orchestration Frameworks %U https://doi.org/10.1145/3578244.3583726 %X Container orchestration frameworks play a critical role in modern cloud computing paradigms such as cloud-native or serverless computing. They significantly impact the quality and cost of service deployment as they manage many performance-critical tasks such as container provisioning, scheduling, scaling, and networking. Consequently, a comprehensive performance assessment of container orchestration frameworks is essential. However, until now, there is no benchmarking approach that covers the many different tasks implemented in such platforms and supports evaluating different technology stacks. In this paper, we present a systematic approach that enables benchmarking of container orchestrators. Based on a definition of container orchestration, we define the core requirements and benchmarking scope for such platforms. Each requirement is then linked to metrics and measurement methods, and a benchmark architecture is proposed. With COFFEE, we introduce a benchmarking tool supporting the definition of complex test campaigns for container orchestration frameworks. We demonstrate the potential of our approach with case studies of the frameworks Kubernetes and Nomad in a self-hosted environment and on the Google Cloud Platform. The presented case studies focus on container startup times, crash recovery, rolling updates, and more. %@ 9798400700682
• 
  De Bello Homomorphico: Investigation of the extensibility of the OpenFHE library with basic mathematical functions by means of common approaches using the example of the CKKS cryptosystem. T. Prantl; L. Horn; S. Engel; L. Iffländer; L. Beierlieb; C. Krupitzer; A. Bauer; M. Sakarvadia; I. Foster; S. Kounev; in International Journal of Information Security (2023).
  • [ BibTeX ]
  • [ EndNote ]
  • [ DOI ]
  @article{PrHoEnIfBeKrBaSaFoKo_IJoIS_SGC_Pareto, author = {Prantl, Thomas and Horn, Lukas and Engel, Simon and Iffl\"ander, Lukas and Beierlieb, Lukas and Krupitzer, Christian and Bauer, Andr\'e and Sakarvadia, Mansi and Foster, Ian and Kounev, Samuel}, journal = {International Journal of Information Security}, keywords = {t_journalmagazine}, month = 11, title = {De Bello Homomorphico: Investigation of the extensibility of the OpenFHE library with basic mathematical functions by means of common approaches using the example of the CKKS cryptosystem}, year = 2023 }

  %0 Journal Article %1 PrHoEnIfBeKrBaSaFoKo_IJoIS_SGC_Pareto %A Prantl, Thomas %A Horn, Lukas %A Engel, Simon %A Iffländer, Lukas %A Beierlieb, Lukas %A Krupitzer, Christian %A Bauer, André %A Sakarvadia, Mansi %A Foster, Ian %A Kounev, Samuel %D 2023 %J International Journal of Information Security %R https://doi.org/10.1007/s10207-023-00781-0 %T De Bello Homomorphico: Investigation of the extensibility of the OpenFHE library with basic mathematical functions by means of common approaches using the example of the CKKS cryptosystem
• 
  Challenges in the development of the EO Exploitation Platform terrabyte. J. Eberle; M. Schwinger; J. Zeidler; in Big Data from Space, P. Soille, S. Lumnitz, S. Albani (Hrsg.) (2023). 97–100.
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  The development of platforms for Earth Observation (EO) data analyses is increasing as the volume of EO data continues to grow. National and international organizations need to provide their users with a platform with data access to multi-source EO data as well as computational resources. In addition to storage and computational resources, user-friendly tools and web services must be provided to allow users to easily explore the data available on the platform and perform data processing and analysis at scale. This paper describes the challenges and architectural choices of the German Aerospace Center's platform `terrabyte` and provides recommendations for data and platform providers.

  @inproceedings{dlr199763, abstract = {The development of platforms for Earth Observation (EO) data analyses is increasing as the volume of EO data continues to grow. National and international organizations need to provide their users with a platform with data access to multi-source EO data as well as computational resources. In addition to storage and computational resources, user-friendly tools and web services must be provided to allow users to easily explore the data available on the platform and perform data processing and analysis at scale. This paper describes the challenges and architectural choices of the German Aerospace Center's platform `terrabyte` and provides recommendations for data and platform providers.}, author = {Eberle, Jonas and Schwinger, Maximilian and Zeidler, Julian}, booktitle = {Big Data from Space}, editor = {Soille, Pierre and Lumnitz, Stefanie and Albani, Sergio}, keywords = {t_interdisciplinary}, month = 11, pages = {97–100}, publisher = {Publications Office of the European Union}, title = {Challenges in the development of the EO Exploitation Platform terrabyte}, year = 2023 }

  %0 Conference Paper %1 dlr199763 %A Eberle, Jonas %A Schwinger, Maximilian %A Zeidler, Julian %B Big Data from Space %D 2023 %E Soille, Pierre %E Lumnitz, Stefanie %E Albani, Sergio %I Publications Office of the European Union %P 97--100 %T Challenges in the development of the EO Exploitation Platform terrabyte %U https://elib.dlr.de/199763/ %X The development of platforms for Earth Observation (EO) data analyses is increasing as the volume of EO data continues to grow. National and international organizations need to provide their users with a platform with data access to multi-source EO data as well as computational resources. In addition to storage and computational resources, user-friendly tools and web services must be provided to allow users to easily explore the data available on the platform and perform data processing and analysis at scale. This paper describes the challenges and architectural choices of the German Aerospace Center's platform `terrabyte` and provides recommendations for data and platform providers.
• 
  Self-Aware Optimization of Adaptation Planning Strategies. V. Lesch; M. Hadry; C. Krupitzer; S. Kounev; in ACM Transactions on Autonomous and Adaptive Systems (2023). 18(3)
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  • [ DOI ]
  In today’s world, circumstances, processes, and requirements for software systems are becoming increasingly complex. In order to operate properly in such dynamic environments, software systems must adapt to these changes, which has led to the research area of Self-Adaptive Systems (SAS). Platooning is one example of adaptive systems in Intelligent Transportation Systems, which is the ability of vehicles to travel with close inter-vehicle distances. This technology leads to an increase in road throughput and safety, which directly addresses the increased infrastructure needs due to increased traffic on the roads. However, the No-Free-Lunch theorem states that the performance of one adaptation planning strategy is not necessarily transferable to other problems. Moreover, especially in the field of SAS, the selection of the most appropriate strategy depends on the current situation of the system. In this paper, we address the problem of self-aware optimization of adaptation planning strategies by designing a framework that includes situation detection, strategy selection, and parameter optimization of the selected strategies. We apply our approach on the case study platooning coordination and evaluate the performance of the proposed framework.

  @article{lesch2022selfaware, abstract = {In today’s world, circumstances, processes, and requirements for software systems are becoming increasingly complex. In order to operate properly in such dynamic environments, software systems must adapt to these changes, which has led to the research area of Self-Adaptive Systems (SAS). Platooning is one example of adaptive systems in Intelligent Transportation Systems, which is the ability of vehicles to travel with close inter-vehicle distances. This technology leads to an increase in road throughput and safety, which directly addresses the increased infrastructure needs due to increased traffic on the roads. However, the No-Free-Lunch theorem states that the performance of one adaptation planning strategy is not necessarily transferable to other problems. Moreover, especially in the field of SAS, the selection of the most appropriate strategy depends on the current situation of the system. In this paper, we address the problem of self-aware optimization of adaptation planning strategies by designing a framework that includes situation detection, strategy selection, and parameter optimization of the selected strategies. We apply our approach on the case study platooning coordination and evaluate the performance of the proposed framework.}, author = {Lesch, Veronika and Hadry, Marius and Krupitzer, Christian and Kounev, Samuel}, journal = {ACM Transactions on Autonomous and Adaptive Systems}, keywords = {self-awareness}, month = {09}, number = 3, title = {Self-Aware Optimization of Adaptation Planning Strategies}, volume = 18, year = 2023 }

  %0 Journal Article %1 lesch2022selfaware %A Lesch, Veronika %A Hadry, Marius %A Krupitzer, Christian %A Kounev, Samuel %D 2023 %J ACM Transactions on Autonomous and Adaptive Systems %N 3 %R 10.1145/3568680 %T Self-Aware Optimization of Adaptation Planning Strategies %U https://doi.org/10.1145/3568680 %V 18 %X In today’s world, circumstances, processes, and requirements for software systems are becoming increasingly complex. In order to operate properly in such dynamic environments, software systems must adapt to these changes, which has led to the research area of Self-Adaptive Systems (SAS). Platooning is one example of adaptive systems in Intelligent Transportation Systems, which is the ability of vehicles to travel with close inter-vehicle distances. This technology leads to an increase in road throughput and safety, which directly addresses the increased infrastructure needs due to increased traffic on the roads. However, the No-Free-Lunch theorem states that the performance of one adaptation planning strategy is not necessarily transferable to other problems. Moreover, especially in the field of SAS, the selection of the most appropriate strategy depends on the current situation of the system. In this paper, we address the problem of self-aware optimization of adaptation planning strategies by designing a framework that includes situation detection, strategy selection, and parameter optimization of the selected strategies. We apply our approach on the case study platooning coordination and evaluate the performance of the proposed framework.
• 
  Serverless Computing: What It Is, and What It Is Not?. S. Kounev; N. Herbst; C. L. Abad; A. Iosup; I. Foster; P. Shenoy; O. Rana; A. A. Chien; in Commun. ACM (2023). 66(9) 80–92.
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  • [ Download ]
  Dispelling the confusion around serverless computing by capturing its essential and conceptual characteristics.

  @article{10.1145/3587249, abstract = {Dispelling the confusion around serverless computing by capturing its essential and conceptual characteristics.}, address = {New York, NY, USA}, author = {Kounev, Samuel and Herbst, Nikolas and Abad, Cristina L. and Iosup, Alexandru and Foster, Ian and Shenoy, Prashant and Rana, Omer and Chien, Andrew A.}, journal = {Commun. ACM}, keywords = {t_journalmagazine}, month = {08}, number = 9, pages = {80–92}, publisher = {Association for Computing Machinery}, title = {Serverless Computing: What It Is, and What It Is Not?}, volume = 66, year = 2023 }

  %0 Journal Article %1 10.1145/3587249 %A Kounev, Samuel %A Herbst, Nikolas %A Abad, Cristina L. %A Iosup, Alexandru %A Foster, Ian %A Shenoy, Prashant %A Rana, Omer %A Chien, Andrew A. %C New York, NY, USA %D 2023 %I Association for Computing Machinery %J Commun. ACM %N 9 %P 80–92 %T Serverless Computing: What It Is, and What It Is Not? %U https://doi.org/10.1145/3587249 %V 66 %X Dispelling the confusion around serverless computing by capturing its essential and conceptual characteristics.
• 
  MVNOCoreSim: A Digital Twin for Virtualized IoT-centric Mobile Core Networks. S. Geissler; F. Wamser; W. Bauer; S. Gebert; S. Kounev; T. Hossfeld; in IEEE Internet of Things (2023). 10(15) 13974–13987.
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  • [ DOI ]
  The rapid growth of connected devices has led to the implementation of IoT-centric platforms designed to provide connectivity for machine-to-machine type communication. Specifically, mobile virtual network operators (MVNOs) provide global service for IoT use cases by leveraging roaming in readily deployed physical networks. This global deployment of connected devices poses a significant challenge regarding the operation of centralized core networks with respect to dimensioning, scaling as well as system survivability in case of signaling incidents. Overload control mechanisms for IoT mobile networks offer a proactive solution for mitigating excessive signaling traffic from IoT devices in mobile core networks. However, global scaling and a heterogeneous composition of devices present network operators with additional challenges. To address these challenges, this work presents a detailed, protocol level simulation framework of a real-world IoT MVNO core network. We present both models for the expected IoT signaling load and the processing of signaling messages based on measurements in a live, production environment as well as a dedicated testbed. Finally, we present a case study on various overload mechanisms and identify critical performance characteristics to compare their performance. The results of this study categorize overload control mechanisms and shed light on the necessity for MVNOs to deal with the upcoming IoT traffic by defining appropriate overload control mechanisms in mobile core networks to ensure network survivability under unforeseen conditions.

  @article{geissler2023mvnocoresim, abstract = {The rapid growth of connected devices has led to the implementation of IoT-centric platforms designed to provide connectivity for machine-to-machine type communication. Specifically, mobile virtual network operators (MVNOs) provide global service for IoT use cases by leveraging roaming in readily deployed physical networks. This global deployment of connected devices poses a significant challenge regarding the operation of centralized core networks with respect to dimensioning, scaling as well as system survivability in case of signaling incidents. Overload control mechanisms for IoT mobile networks offer a proactive solution for mitigating excessive signaling traffic from IoT devices in mobile core networks. However, global scaling and a heterogeneous composition of devices present network operators with additional challenges. To address these challenges, this work presents a detailed, protocol level simulation framework of a real-world IoT MVNO core network. We present both models for the expected IoT signaling load and the processing of signaling messages based on measurements in a live, production environment as well as a dedicated testbed. Finally, we present a case study on various overload mechanisms and identify critical performance characteristics to compare their performance. The results of this study categorize overload control mechanisms and shed light on the necessity for MVNOs to deal with the upcoming IoT traffic by defining appropriate overload control mechanisms in mobile core networks to ensure network survivability under unforeseen conditions.}, author = {Geissler, Stefan and Wamser, Florian and Bauer, Wolfgang and Gebert, Steffen and Kounev, Samuel and Hossfeld, Tobias}, journal = {IEEE Internet of Things}, keywords = {t_journalmagazine}, month = {08}, number = 15, pages = {13974-13987}, title = {MVNOCoreSim: A Digital Twin for Virtualized IoT-centric Mobile Core Networks}, volume = 10, year = 2023 }

  %0 Journal Article %1 geissler2023mvnocoresim %A Geissler, Stefan %A Wamser, Florian %A Bauer, Wolfgang %A Gebert, Steffen %A Kounev, Samuel %A Hossfeld, Tobias %D 2023 %J IEEE Internet of Things %N 15 %P 13974-13987 %R 10.1109/JIOT.2023.3263258 %T MVNOCoreSim: A Digital Twin for Virtualized IoT-centric Mobile Core Networks %U https://ieeexplore.ieee.org/document/10089151 %V 10 %X The rapid growth of connected devices has led to the implementation of IoT-centric platforms designed to provide connectivity for machine-to-machine type communication. Specifically, mobile virtual network operators (MVNOs) provide global service for IoT use cases by leveraging roaming in readily deployed physical networks. This global deployment of connected devices poses a significant challenge regarding the operation of centralized core networks with respect to dimensioning, scaling as well as system survivability in case of signaling incidents. Overload control mechanisms for IoT mobile networks offer a proactive solution for mitigating excessive signaling traffic from IoT devices in mobile core networks. However, global scaling and a heterogeneous composition of devices present network operators with additional challenges. To address these challenges, this work presents a detailed, protocol level simulation framework of a real-world IoT MVNO core network. We present both models for the expected IoT signaling load and the processing of signaling messages based on measurements in a live, production environment as well as a dedicated testbed. Finally, we present a case study on various overload mechanisms and identify critical performance characteristics to compare their performance. The results of this study categorize overload control mechanisms and shed light on the necessity for MVNOs to deal with the upcoming IoT traffic by defining appropriate overload control mechanisms in mobile core networks to ensure network survivability under unforeseen conditions.
• 
  SPEC Research Group Newsletter, Issue 12. S. Kounev; A. van Hoorn; M. Straesser; A. Bauer; (2023, April).

  Published by Standard Performance Evaluation Corporation (SPEC)
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  • [ Download ]
  @misc{SPEC-RG-NEWSLETTER-12, author = {Kounev, Samuel and van Hoorn, Andre and Straesser, Martin and Bauer, Andr{é}}, keywords = {SPEC}, month = {04}, note = {Published by Standard Performance Evaluation Corporation (SPEC)}, title = {SPEC Research Group Newsletter, Issue 12}, year = 2023 }

  %0 Generic %1 SPEC-RG-NEWSLETTER-12 %A Kounev, Samuel %A van Hoorn, Andre %A Straesser, Martin %A Bauer, André %D 2023 %T SPEC Research Group Newsletter, Issue 12 %U https://research.spec.org/newsletter/
• 
  Optimizing storage assignment, order picking, and their interaction in mezzanine warehouses. V. Lesch; P. B. Müller; M. Krämer; M. Hadry; S. Kounev; C. Krupitzer; in Applied intelligence (2023). 25.
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  • [ DOI ]
  • [ Download ]
  @article{lesch2023optimizing, author = {Lesch, Veronika and Müller, Patrick B.M. and Krämer, Moritz and Hadry, Marius and Kounev, Samuel and Krupitzer, Christian}, journal = {Applied intelligence}, keywords = {t_journalmagazine}, month = {02}, pages = 25, title = {Optimizing storage assignment, order picking, and their interaction in mezzanine warehouses}, year = 2023 }

  %0 Journal Article %1 lesch2023optimizing %A Lesch, Veronika %A Müller, Patrick B.M. %A Krämer, Moritz %A Hadry, Marius %A Kounev, Samuel %A Krupitzer, Christian %D 2023 %J Applied intelligence %P 25 %R 10.1007/s10489-022-04443-x %T Optimizing storage assignment, order picking, and their interaction in mezzanine warehouses %U https://doi.org/10.1007/s10489-022-04443-x
• 
  A Trace-driven Performance Evaluation of Hash-based Task Placement Algorithms for Cache-enabled Serverless Computing. S. Talluri; N. Herbst; C. Abad; A. Trivedi; A. Iosup; in 2023 ACM International Conference on Computing Frontiers (CF ’23) (2023).
  • [ BibTeX ]
  • [ EndNote ]
  • [ Download ]
  @inproceedings{2023-cf-hash-task-placement, author = {Talluri, Sacheendra and Herbst, Nikolas and Abad, Cristina and Trivedi, Animesh and Iosup, Alexandru}, booktitle = {2023 ACM International Conference on Computing Frontiers (CF '23)}, keywords = {sys:relevantfor:se-group}, title = {A Trace-driven Performance Evaluation of Hash-based Task Placement Algorithms for Cache-enabled Serverless Computing}, year = 2023 }

  %0 Conference Paper %1 2023-cf-hash-task-placement %A Talluri, Sacheendra %A Herbst, Nikolas %A Abad, Cristina %A Trivedi, Animesh %A Iosup, Alexandru %B 2023 ACM International Conference on Computing Frontiers (CF '23) %D 2023 %T A Trace-driven Performance Evaluation of Hash-based Task Placement Algorithms for Cache-enabled Serverless Computing
• 
  Association between Postoperative Atrial Fibrillation Recurrences and Interatrial Block by the Time of Open-Heart Surgery. S. Leiler; J. Kalisnik; R. Bernik; A. Bauer; V. Günzler; P. Sluet; S. Kounev; T. Fischlein; in The Thoracic and Cardiovascular Surgeon (2023). 71(S 01) DGTHG-V130.
  • [ BibTeX ]
  • [ EndNote ]
  @article{leiler2023association, author = {Leiler, S and Kalisnik, JM and Bernik, R and Bauer, A and G{\"u}nzler, V and Sluet, P and Kounev, S and Fischlein, T}, journal = {The Thoracic and Cardiovascular Surgeon}, keywords = {t_journalmagazine}, number = {S 01}, pages = {DGTHG–V130}, publisher = {Georg Thieme Verlag KG}, title = {Association between Postoperative Atrial Fibrillation Recurrences and Interatrial Block by the Time of Open-Heart Surgery}, volume = 71, year = 2023 }

  %0 Journal Article %1 leiler2023association %A Leiler, S %A Kalisnik, JM %A Bernik, R %A Bauer, A %A Günzler, V %A Sluet, P %A Kounev, S %A Fischlein, T %D 2023 %I Georg Thieme Verlag KG %J The Thoracic and Cardiovascular Surgeon %N S 01 %P DGTHG--V130 %T Association between Postoperative Atrial Fibrillation Recurrences and Interatrial Block by the Time of Open-Heart Surgery %V 71
• 
  Telescope: An Automated Hybrid Forecasting Approach on a Level-Playing Field. A. Bauer; M. Leznik; M. Stenger; R. Leppich; N. Herbst; S. Kounev; I. Foster; (2023).
  • [ BibTeX ]
  • [ EndNote ]
  • [ Download ]
  @misc{bauer2023telescope, author = {Bauer, André and Leznik, Mark and Stenger, Michael and Leppich, Robert and Herbst, Nikolas and Kounev, Samuel and Foster, Ian}, keywords = {t_journalmagazine}, title = {Telescope: An Automated Hybrid Forecasting Approach on a Level-Playing Field}, year = 2023 }

  %0 Generic %1 bauer2023telescope %A Bauer, André %A Leznik, Mark %A Stenger, Michael %A Leppich, Robert %A Herbst, Nikolas %A Kounev, Samuel %A Foster, Ian %D 2023 %T Telescope: An Automated Hybrid Forecasting Approach on a Level-Playing Field

• 
  The State of Serverless Applications: Collection, Characterization, and Community Consensus. S. Eismann; J. Scheuner; E. van Eyk; M. Schwinger; J. Grohmann; N. Herbst; C. Abad; A. Iosup; in Transactions on Software Engineering (2022). 48(10) 4152–4166.
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  • [ DOI ]
  • [ Download ]
  Over the last five years, all major cloud platform providers have increased their serverless offerings. Many early adopters report significant benefits for serverless-based over traditional applications, and many companies are considering moving to serverless themselves. However, currently there exist only few, scattered, and sometimes even conflicting reports on when serverless applications are well suited and what the best practices for their implementation are. We address this problem in the present study about the state of serverless applications. We collect descriptions of 89 serverless applications from open-source projects, academic literature, industrial literature, and domain-specific feedback. We analyze 16 characteristics that describe why and when successful adopters are using serverless applications, and how they are building them. We further compare the results of our characterization study to 10 existing, mostly industrial, studies and datasets; this allows us to identify points of consensus across multiple studies, investigate points of disagreement, and overall confirm the validity of our results. The results of this study can help managers to decide if they should adopt serverless technology, engineers to learn about current practices of building serverless applications, and researchers and platform providers to better understand the current landscape of serverless applications.

  @article{eismann2021state, abstract = {Over the last five years, all major cloud platform providers have increased their serverless offerings. Many early adopters report significant benefits for serverless-based over traditional applications, and many companies are considering moving to serverless themselves. However, currently there exist only few, scattered, and sometimes even conflicting reports on when serverless applications are well suited and what the best practices for their implementation are. We address this problem in the present study about the state of serverless applications. We collect descriptions of 89 serverless applications from open-source projects, academic literature, industrial literature, and domain-specific feedback. We analyze 16 characteristics that describe why and when successful adopters are using serverless applications, and how they are building them. We further compare the results of our characterization study to 10 existing, mostly industrial, studies and datasets; this allows us to identify points of consensus across multiple studies, investigate points of disagreement, and overall confirm the validity of our results. The results of this study can help managers to decide if they should adopt serverless technology, engineers to learn about current practices of building serverless applications, and researchers and platform providers to better understand the current landscape of serverless applications.}, author = {Eismann, Simon and Scheuner, Joel and van Eyk, Erwin and Schwinger, Maximilian and Grohmann, Johannes and Herbst, Nikolas and Abad, Cristina and Iosup, Alexandru}, journal = {Transactions on Software Engineering}, keywords = {t_journalmagazine}, number = 10, pages = {4152- 4166}, title = {The State of Serverless Applications: Collection, Characterization, and Community Consensus}, volume = 48, year = 2022 }

  %0 Journal Article %1 eismann2021state %A Eismann, Simon %A Scheuner, Joel %A van Eyk, Erwin %A Schwinger, Maximilian %A Grohmann, Johannes %A Herbst, Nikolas %A Abad, Cristina %A Iosup, Alexandru %D 2022 %J Transactions on Software Engineering %N 10 %P 4152- 4166 %R {10.1109/TSE.2021.3113940} %T The State of Serverless Applications: Collection, Characterization, and Community Consensus %U /brokenurl#https://doi.org/10.1109/TSE.2021.3113940 %V 48 %X Over the last five years, all major cloud platform providers have increased their serverless offerings. Many early adopters report significant benefits for serverless-based over traditional applications, and many companies are considering moving to serverless themselves. However, currently there exist only few, scattered, and sometimes even conflicting reports on when serverless applications are well suited and what the best practices for their implementation are. We address this problem in the present study about the state of serverless applications. We collect descriptions of 89 serverless applications from open-source projects, academic literature, industrial literature, and domain-specific feedback. We analyze 16 characteristics that describe why and when successful adopters are using serverless applications, and how they are building them. We further compare the results of our characterization study to 10 existing, mostly industrial, studies and datasets; this allows us to identify points of consensus across multiple studies, investigate points of disagreement, and overall confirm the validity of our results. The results of this study can help managers to decide if they should adopt serverless technology, engineers to learn about current practices of building serverless applications, and researchers and platform providers to better understand the current landscape of serverless applications.
• 
  Why Is It Not Solved Yet? Challenges for Production-Ready Autoscaling. M. Straesser; J. Grohmann; J. von Kistowski; S. Eismann; A. Bauer; S. Kounev; in Proceedings of the 2022 ACM/SPEC on International Conference on Performance Engineering (2022). 105–115.
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  • [ Download ]
  Autoscaling is a task of major importance in the cloud computing domain as it directly affects both operating costs and customer experience. Although there has been active research in this area for over ten years now, there is still a significant gap between the proposed methods in the literature and the deployed autoscalers in practice. Hence, many research autoscalers do not find their way into production deployments. This paper describes six core challenges that arise in production systems that are still not solved by most research autoscalers. We illustrate these problems through experiments in a realistic cloud environment with a real-world multi-service business application and show that commonly used autoscalers have various shortcomings. In addition, we analyze the behavior of overloaded services and show that these can be problematic for existing autoscalers. Generally, we analyze that these challenges are only insufficiently addressed in the literature and conclude that future scaling approaches should focus on the needs of production systems.

  @inproceedings{10.1145/3489525.3511680, abstract = {Autoscaling is a task of major importance in the cloud computing domain as it directly affects both operating costs and customer experience. Although there has been active research in this area for over ten years now, there is still a significant gap between the proposed methods in the literature and the deployed autoscalers in practice. Hence, many research autoscalers do not find their way into production deployments. This paper describes six core challenges that arise in production systems that are still not solved by most research autoscalers. We illustrate these problems through experiments in a realistic cloud environment with a real-world multi-service business application and show that commonly used autoscalers have various shortcomings. In addition, we analyze the behavior of overloaded services and show that these can be problematic for existing autoscalers. Generally, we analyze that these challenges are only insufficiently addressed in the literature and conclude that future scaling approaches should focus on the needs of production systems.}, address = {New York, NY, USA}, author = {Straesser, Martin and Grohmann, Johannes and von Kistowski, J\'{o}akim and Eismann, Simon and Bauer, Andr\'{e} and Kounev, Samuel}, booktitle = {Proceedings of the 2022 ACM/SPEC on International Conference on Performance Engineering}, keywords = {microservices}, pages = {105–115}, publisher = {Association for Computing Machinery}, series = {ICPE '22}, title = {Why Is It Not Solved Yet? Challenges for Production-Ready Autoscaling}, year = 2022 }

  %0 Conference Paper %1 10.1145/3489525.3511680 %A Straesser, Martin %A Grohmann, Johannes %A von Kistowski, Jóakim %A Eismann, Simon %A Bauer, André %A Kounev, Samuel %B Proceedings of the 2022 ACM/SPEC on International Conference on Performance Engineering %C New York, NY, USA %D 2022 %I Association for Computing Machinery %P 105–115 %T Why Is It Not Solved Yet? Challenges for Production-Ready Autoscaling %U https://doi.org/10.1145/3489525.3511680 %X Autoscaling is a task of major importance in the cloud computing domain as it directly affects both operating costs and customer experience. Although there has been active research in this area for over ten years now, there is still a significant gap between the proposed methods in the literature and the deployed autoscalers in practice. Hence, many research autoscalers do not find their way into production deployments. This paper describes six core challenges that arise in production systems that are still not solved by most research autoscalers. We illustrate these problems through experiments in a realistic cloud environment with a real-world multi-service business application and show that commonly used autoscalers have various shortcomings. In addition, we analyze the behavior of overloaded services and show that these can be problematic for existing autoscalers. Generally, we analyze that these challenges are only insufficiently addressed in the literature and conclude that future scaling approaches should focus on the needs of production systems.
• 
  Investigating the Predictability of QoS Metrics in Cellular Networks. S. Herrnleben; J. Grohmann; V. Lesch; T. Prantl; F. Metzger; T. Hoßfeld; S. Kounev; in 2022 IEEE/ACM 30th International Symposium on Quality of Service (IWQoS) (2022). 1–10.
  • [ BibTeX ]
  • [ EndNote ]
  @inproceedings{HeGrLePrMeHoKo-2022-IWQoS-QoS-Prediction-Cellular-Networks, author = {Herrnleben, Stefan and Grohmann, Johannes and Lesch, Veronika and Prantl, Thomas and Metzger, Florian and Hoßfeld, Tobias and Kounev, Samuel}, booktitle = {2022 IEEE/ACM 30th International Symposium on Quality of Service (IWQoS)}, keywords = {descartes}, pages = {1-10}, title = {{Investigating the Predictability of QoS Metrics in Cellular Networks}}, year = 2022 }

  %0 Conference Paper %1 HeGrLePrMeHoKo-2022-IWQoS-QoS-Prediction-Cellular-Networks %A Herrnleben, Stefan %A Grohmann, Johannes %A Lesch, Veronika %A Prantl, Thomas %A Metzger, Florian %A Hoßfeld, Tobias %A Kounev, Samuel %B 2022 IEEE/ACM 30th International Symposium on Quality of Service (IWQoS) %D 2022 %P 1-10 %T Investigating the Predictability of QoS Metrics in Cellular Networks
• 
  Towards a Cryptography Benchmark: A View on Attribute Based Encryption Schemes. T. Prantl; T. Zeck; L. Iffländer; L. Beierlieb; A. Dmitrenko; C. Krupitzer; S. Kounev; in 2022 5th Conference on Cloud and Internet of Things (CIoT) (2022).
  • [ BibTeX ]
  • [ EndNote ]
  @inproceedings{PrZeIfBeDmKrKo2022-CIoT-ABEBenchmark, author = {Prantl, Thomas and Zeck, Timo and Iffländer, Lukas and Beierlieb, Lukas and Dmitrenko, Alexandra and Krupitzer, Christian and Kounev, Samuel}, booktitle = {2022 5th Conference on Cloud and Internet of Things (CIoT)}, keywords = {descartes}, organization = {IEEE}, title = {Towards a Cryptography Benchmark: A View on Attribute Based Encryption Schemes}, year = 2022 }

  %0 Conference Paper %1 PrZeIfBeDmKrKo2022-CIoT-ABEBenchmark %A Prantl, Thomas %A Zeck, Timo %A Iffländer, Lukas %A Beierlieb, Lukas %A Dmitrenko, Alexandra %A Krupitzer, Christian %A Kounev, Samuel %B 2022 5th Conference on Cloud and Internet of Things (CIoT) %D 2022 %T Towards a Cryptography Benchmark: A View on Attribute Based Encryption Schemes
• 
  Retrospektive Analyse ausgewählter Belastungs-und Beanspruchungsparameter einer professionellen Fußball-mannschaft vor und während coronabedingter Kontakt-beschränkungen in der Spielsaison 2019/20. P. Kunz; P. Düking; R. Leppich; J. Lachmann; B. Sperlich; in Leipziger Sportwissenschaftliche Beiträge Jahrgang 63 (2022 Heft 1 (2022). 75.
  • [ BibTeX ]
  • [ EndNote ]
  @article{kunz2022retrospektive, author = {Kunz, Philipp and D{\"u}king, Peter and Leppich, Robert and Lachmann, Jonas and Sperlich, Billy}, journal = {Leipziger Sportwissenschaftliche Beitr{\"a}ge Jahrgang 63 (2022 Heft 1}, keywords = {t_interdisciplinary}, pages = 75, publisher = {Lehmanns Media}, title = {Retrospektive Analyse ausgew{\"a}hlter Belastungs-und Beanspruchungsparameter einer professionellen Fu{\ss}ball-mannschaft vor und w{\"a}hrend coronabedingter Kontakt-beschr{\"a}nkungen in der Spielsaison 2019/20}, year = 2022 }

  %0 Journal Article %1 kunz2022retrospektive %A Kunz, Philipp %A Düking, Peter %A Leppich, Robert %A Lachmann, Jonas %A Sperlich, Billy %D 2022 %I Lehmanns Media %J Leipziger Sportwissenschaftliche Beiträge Jahrgang 63 (2022 Heft 1 %P 75 %T Retrospektive Analyse ausgewählter Belastungs-und Beanspruchungsparameter einer professionellen Fußball-mannschaft vor und während coronabedingter Kontakt-beschränkungen in der Spielsaison 2019/20
• 
  Ransomware Detection in Databases through Dynamic Analysis of Query Sequences. C. Sendner; L. Iffländer; S. Schindler; M. Jobst; A. Dmitrienko; S. Kounev; in 2022 IEEE Conference on Communications and Network Security (CNS) (2022).
  • [ BibTeX ]
  • [ EndNote ]
  @conference{sendner2022ransomware, author = {Sendner, Christoph and Iffländer, Lukas and Schindler, Sebastian and Jobst, Michael and Dmitrienko, Alexandra and Kounev, Samuel}, booktitle = {2022 IEEE Conference on Communications and Network Security (CNS)}, keywords = {sss-group}, title = {Ransomware Detection in Databases through Dynamic Analysis of Query Sequences}, year = 2022 }

  %0 Generic %1 sendner2022ransomware %A Sendner, Christoph %A Iffländer, Lukas %A Schindler, Sebastian %A Jobst, Michael %A Dmitrienko, Alexandra %A Kounev, Samuel %B 2022 IEEE Conference on Communications and Network Security (CNS) %D 2022 %T Ransomware Detection in Databases through Dynamic Analysis of Query Sequences
• 
  ICPE ’22: ACM/SPEC International Conference on Performance Engineering, Bejing, China, April 9 - 13, 2022, Companion Volume D. Feng; S. Becker; N. Herbst; P. Leitner; (D. Feng; S. Becker; N. Herbst; P. Leitner, Hrsg.) (2022). ACM.
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  @proceedings{DBLP:conf/wosp/2022c, author = {Feng, Dan and Becker, Steffen and Herbst, Nikolas and Leitner, Philipp}, editor = {Feng, Dan and Becker, Steffen and Herbst, Nikolas and Leitner, Philipp}, keywords = {t_proceedings}, publisher = {{ACM}}, title = {{ICPE} '22: {ACM/SPEC} International Conference on Performance Engineering, Bejing, China, April 9 - 13, 2022, Companion Volume}, year = 2022 }

  %0 Conference Proceedings %1 DBLP:conf/wosp/2022c %A Feng, Dan %A Becker, Steffen %A Herbst, Nikolas %A Leitner, Philipp %D 2022 %E Feng, Dan %E Becker, Steffen %E Herbst, Nikolas %E Leitner, Philipp %I ACM %T ICPE '22: ACM/SPEC International Conference on Performance Engineering, Bejing, China, April 9 - 13, 2022, Companion Volume %U https://doi.org/10.1145/3491204
• 
  Artificial Intelligence-Based Early Detection Of Acute Kidney Injury After Cardiac Surgery. J. M. Kalisnik; A. Bauer; F. A. Vogt; F. J. Stickl; J. Zibert; M. Fittkau; T. Bertsch; S. Kounev; T. Fischlein; in European Journal of Cardio-Thoracic Surgery (2022).

  Joint first authorship; To be published soon
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  Objectives: This study aims to improve early detection of cardiac surgery-associated acute kidney injury using artificial intelligence-based algorithms. Methods: Data from consecutive patients undergoing cardiac surgery between 2008 and 2018 in our institution served as the source for artificial intelligence-based modeling. Cardiac surgery-associated acute kidney injury was defined according to the Kidney Disease Improving Global Outcomes criteria. Different machine learning algorithms were trained and validated to detect cardiac surgery-associated acute kidney injury within 12 hours after surgery. Demographic characteristics, comorbidities, preoperative cardiac status, intra- and postoperative variables including creatinine and hemoglobin values were retrieved for analysis. Results: From 7507 patients analyzed, 1699 patients (22.6 %) developed cardiac surgery-associated acute kidney injury. The ultimate detection model, 'Detect-A(K)I', recognizes cardiac surgery-associated acute kidney injury within 12 hours with an area under the curve of 88.0 %, sensitivity of 78.0 %, specificity of 78.9 %, and accuracy of 82.1 %. The optimal parameter set includes serial changes of creatinine and hemoglobin, operative emergency, bleeding-associated variables, cardiac ischemic time and cardiac function-associated variables, age, diuretics and active infection, chronic obstructive lung and peripheral vascular disease. Conclusion: The 'Detect-A(K)I' model successfully detects cardiac surgery-associated acute kidney injury within 12 hours after surgery with the best discriminatory characteristics reported so far.

  @article{kalisnik2022artificial, abstract = {Objectives: This study aims to improve early detection of cardiac surgery-associated acute kidney injury using artificial intelligence-based algorithms. Methods: Data from consecutive patients undergoing cardiac surgery between 2008 and 2018 in our institution served as the source for artificial intelligence-based modeling. Cardiac surgery-associated acute kidney injury was defined according to the Kidney Disease Improving Global Outcomes criteria. Different machine learning algorithms were trained and validated to detect cardiac surgery-associated acute kidney injury within 12 hours after surgery. Demographic characteristics, comorbidities, preoperative cardiac status, intra- and postoperative variables including creatinine and hemoglobin values were retrieved for analysis. Results: From 7507 patients analyzed, 1699 patients (22.6 %) developed cardiac surgery-associated acute kidney injury. The ultimate detection model, 'Detect-A(K)I', recognizes cardiac surgery-associated acute kidney injury within 12 hours with an area under the curve of 88.0 %, sensitivity of 78.0 %, specificity of 78.9 %, and accuracy of 82.1 %. The optimal parameter set includes serial changes of creatinine and hemoglobin, operative emergency, bleeding-associated variables, cardiac ischemic time and cardiac function-associated variables, age, diuretics and active infection, chronic obstructive lung and peripheral vascular disease. Conclusion: The 'Detect-A(K)I' model successfully detects cardiac surgery-associated acute kidney injury within 12 hours after surgery with the best discriminatory characteristics reported so far.}, author = {Kalisnik, Jurij Matija and Bauer, Andr{é} and Vogt, Ferdinand Aurel and Stickl, Franziska Josephine and Zibert, Janez and Fittkau, Matthias and Bertsch, Thomas and Kounev, Samuel and Fischlein, Theodor}, journal = {European Journal of Cardio-Thoracic Surgery}, keywords = {t_journalmagazine}, note = {Joint first authorship; To be published soon}, title = {Artificial Intelligence-Based Early Detection Of Acute Kidney Injury After Cardiac Surgery}, year = 2022 }

  %0 Journal Article %1 kalisnik2022artificial %A Kalisnik, Jurij Matija %A Bauer, André %A Vogt, Ferdinand Aurel %A Stickl, Franziska Josephine %A Zibert, Janez %A Fittkau, Matthias %A Bertsch, Thomas %A Kounev, Samuel %A Fischlein, Theodor %D 2022 %J European Journal of Cardio-Thoracic Surgery %T Artificial Intelligence-Based Early Detection Of Acute Kidney Injury After Cardiac Surgery %X Objectives: This study aims to improve early detection of cardiac surgery-associated acute kidney injury using artificial intelligence-based algorithms. Methods: Data from consecutive patients undergoing cardiac surgery between 2008 and 2018 in our institution served as the source for artificial intelligence-based modeling. Cardiac surgery-associated acute kidney injury was defined according to the Kidney Disease Improving Global Outcomes criteria. Different machine learning algorithms were trained and validated to detect cardiac surgery-associated acute kidney injury within 12 hours after surgery. Demographic characteristics, comorbidities, preoperative cardiac status, intra- and postoperative variables including creatinine and hemoglobin values were retrieved for analysis. Results: From 7507 patients analyzed, 1699 patients (22.6 %) developed cardiac surgery-associated acute kidney injury. The ultimate detection model, 'Detect-A(K)I', recognizes cardiac surgery-associated acute kidney injury within 12 hours with an area under the curve of 88.0 %, sensitivity of 78.0 %, specificity of 78.9 %, and accuracy of 82.1 %. The optimal parameter set includes serial changes of creatinine and hemoglobin, operative emergency, bleeding-associated variables, cardiac ischemic time and cardiac function-associated variables, age, diuretics and active infection, chronic obstructive lung and peripheral vascular disease. Conclusion: The 'Detect-A(K)I' model successfully detects cardiac surgery-associated acute kidney injury within 12 hours after surgery with the best discriminatory characteristics reported so far.
• 
  Same, Same, but Dissimilar: Exploring Measurements for Workload Time-Series Similarity. M. Leznik; J. Grohmann; N. Kliche; A. Bauer; D. Seybold; S. Eismann; S. Kounev; J. Domaschka; in Proceedings of the 2022 ACM/SPEC on International Conference on Performance Engineering (2022). 89–96.
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  • [ Download ]
  Benchmarking is a core element in the toolbox of most systems researchers and is used for analyzing, comparing, and validating complex systems. In the quest for reliable benchmark results, a consensus has formed that a significant experiment must be based on multiple runs. To interpret these runs, mean and standard deviation are often used. In case of experiments where each run produces a time series, applying and comparing the mean is not easily applicable and not necessarily statistically sound. Such an approach ignores the possibility of significant differences between runs with a similar average. In order to verify this hypothesis, we conducted a survey of 1,112 publications of selected performance engineering and systems conferences canvassing open data sets from performance experiments. The identified 3 data sets purely rely on average and standard deviation. Therefore, we propose a novel analysis approach based on similarity analysis to enhance the reliability of performance evaluations. Our approach evaluates 12 (dis-)similarity measures with respect to their applicability in analysing performance measurements and identifies four suitable similarity measures. We validate our approach by demonstrating the increase in reliability for the data sets found in the survey.

  @inproceedings{leznik2022dissimilar, abstract = {Benchmarking is a core element in the toolbox of most systems researchers and is used for analyzing, comparing, and validating complex systems. In the quest for reliable benchmark results, a consensus has formed that a significant experiment must be based on multiple runs. To interpret these runs, mean and standard deviation are often used. In case of experiments where each run produces a time series, applying and comparing the mean is not easily applicable and not necessarily statistically sound. Such an approach ignores the possibility of significant differences between runs with a similar average. In order to verify this hypothesis, we conducted a survey of 1,112 publications of selected performance engineering and systems conferences canvassing open data sets from performance experiments. The identified 3 data sets purely rely on average and standard deviation. Therefore, we propose a novel analysis approach based on similarity analysis to enhance the reliability of performance evaluations. Our approach evaluates 12 (dis-)similarity measures with respect to their applicability in analysing performance measurements and identifies four suitable similarity measures. We validate our approach by demonstrating the increase in reliability for the data sets found in the survey.}, address = {New York, NY, USA}, author = {Leznik, Mark and Grohmann, Johannes and Kliche, Nina and Bauer, Andr\'{e} and Seybold, Daniel and Eismann, Simon and Kounev, Samuel and Domaschka, J\"{o}rg}, booktitle = {Proceedings of the 2022 ACM/SPEC on International Conference on Performance Engineering}, keywords = {analysis}, pages = {89–96}, publisher = {Association for Computing Machinery}, series = {ICPE '22}, title = {Same, Same, but Dissimilar: Exploring Measurements for Workload Time-Series Similarity}, year = 2022 }

  %0 Conference Paper %1 leznik2022dissimilar %A Leznik, Mark %A Grohmann, Johannes %A Kliche, Nina %A Bauer, André %A Seybold, Daniel %A Eismann, Simon %A Kounev, Samuel %A Domaschka, Jörg %B Proceedings of the 2022 ACM/SPEC on International Conference on Performance Engineering %C New York, NY, USA %D 2022 %I Association for Computing Machinery %P 89–96 %T Same, Same, but Dissimilar: Exploring Measurements for Workload Time-Series Similarity %U https://doi.org/10.1145/3489525.3511699 %X Benchmarking is a core element in the toolbox of most systems researchers and is used for analyzing, comparing, and validating complex systems. In the quest for reliable benchmark results, a consensus has formed that a significant experiment must be based on multiple runs. To interpret these runs, mean and standard deviation are often used. In case of experiments where each run produces a time series, applying and comparing the mean is not easily applicable and not necessarily statistically sound. Such an approach ignores the possibility of significant differences between runs with a similar average. In order to verify this hypothesis, we conducted a survey of 1,112 publications of selected performance engineering and systems conferences canvassing open data sets from performance experiments. The identified 3 data sets purely rely on average and standard deviation. Therefore, we propose a novel analysis approach based on similarity analysis to enhance the reliability of performance evaluations. Our approach evaluates 12 (dis-)similarity measures with respect to their applicability in analysing performance measurements and identifies four suitable similarity measures. We validate our approach by demonstrating the increase in reliability for the data sets found in the survey.
• 
  A Survey on Secure Group Communication Schemes with Focus on IoT Communication. T. Prantl; T. Zeck; A. Bauer; P. Ten; D. Prantl; A. E. Ben Yahya; L. Iffländer; A. Dmitrienko; C. Krupitzer; S. Kounev; in IEEE Access (2022).

  Accepted but not yet published
  • [ BibTeX ]
  • [ EndNote ]
  @article{PrZeBaTePrYaIfDmKrKo_IEEEAccess_SGCSurvey, author = {Prantl, Thomas and Zeck, Timo and Bauer, André and Ten, Peter and Prantl, Dominik and Ben Yahya, Ala Eddine and Iffländer, Lukas and Dmitrienko, Alexandra and Krupitzer, Christian and Kounev, Samuel}, journal = {IEEE Access}, keywords = {t_journalmagazine}, note = {Accepted but not yet published}, publisher = {IEEE}, title = {A Survey on Secure Group Communication Schemes with Focus on IoT Communication}, year = 2022 }

  %0 Journal Article %1 PrZeBaTePrYaIfDmKrKo_IEEEAccess_SGCSurvey %A Prantl, Thomas %A Zeck, Timo %A Bauer, André %A Ten, Peter %A Prantl, Dominik %A Ben Yahya, Ala Eddine %A Iffländer, Lukas %A Dmitrienko, Alexandra %A Krupitzer, Christian %A Kounev, Samuel %D 2022 %I IEEE %J IEEE Access %T A Survey on Secure Group Communication Schemes with Focus on IoT Communication
• 
  ICPE ’22: ACM/SPEC International Conference on Performance Engineering, Bejing, China, April 9 - 13, 2022 D. Feng; S. Becker; N. Herbst; P. Leitner; (D. Feng; S. Becker; N. Herbst; P. Leitner, Hrsg.) (2022). ACM.
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  @proceedings{DBLP:conf/wosp/2022, author = {Feng, Dan and Becker, Steffen and Herbst, Nikolas and Leitner, Philipp}, editor = {Feng, Dan and Becker, Steffen and Herbst, Nikolas and Leitner, Philipp}, keywords = {t_proceedings}, publisher = {{ACM}}, title = {{ICPE} '22: {ACM/SPEC} International Conference on Performance Engineering, Bejing, China, April 9 - 13, 2022}, year = 2022 }

  %0 Conference Proceedings %1 DBLP:conf/wosp/2022 %A Feng, Dan %A Becker, Steffen %A Herbst, Nikolas %A Leitner, Philipp %D 2022 %E Feng, Dan %E Becker, Steffen %E Herbst, Nikolas %E Leitner, Philipp %I ACM %T ICPE '22: ACM/SPEC International Conference on Performance Engineering, Bejing, China, April 9 - 13, 2022 %U https://doi.org/10.1145/3489525
• 
  A data-driven Sensor Model for LIDAR Range Measurements used for Mobile Robot Navigation. F. Spiess; N. Strobel; T. Kaupp; S. Kounev; in Proceedings of the IEEE IRC 2022 Conference (2022).
  • [ BibTeX ]
  • [ EndNote ]
  @conference{spiess2022datadriven, author = {Spiess, Florian and Strobel, Norbert and Kaupp, Tobias and Kounev, Samuel}, booktitle = {Proceedings of the IEEE IRC 2022 Conference}, keywords = {t_interdisciplinary}, title = {A data-driven Sensor Model for LIDAR Range Measurements used for Mobile Robot Navigation}, year = 2022 }

  %0 Generic %1 spiess2022datadriven %A Spiess, Florian %A Strobel, Norbert %A Kaupp, Tobias %A Kounev, Samuel %B Proceedings of the IEEE IRC 2022 Conference %D 2022 %T A data-driven Sensor Model for LIDAR Range Measurements used for Mobile Robot Navigation
• 
  MiSim: A Simulator for Resilience Assessment of Microservice-based Architectures. S. Frank; L. Wagner; A. Hakamian; M. Straesser; A. van Hoorn; in 2022 IEEE 22nd International Conference on Software Quality, Reliability and Security (QRS) (2022). 1014–1025.
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  • [ DOI ]
  Increased resilience compared to monolithic architectures is both one of the key promises of microservice-based architectures and a big challenge, e.g., due to the systems’ distributed nature. Resilience assessment through simulation requires fewer resources than the measurement-based techniques used in practice. However, there is no existing simulation approach that is suitable for a holistic resilience assessment of microservices comprised of (i) representative fault injections, (ii) common resilience mechanisms, and (iii) time-varying workloads. This paper presents MiSim — an extensible simulator for resilience assessment of microservice-based architectures. It overcomes the stated limitations of related work. MiSim fits resilience engineering practices by supporting scenario-based experiments and requiring only lightweight input models. We demonstrate how MiSim simulates (1) common resilience mechanisms — i.e., circuit breaker, connection limiter, retry, load balancer, and autoscaler — and (2) fault injections — i.e., instance/service killing and latency injections. In addition, we use TeaStore, a reference microservice-based architecture, aiming to reproduce scaling behavior from an experiment by using simulation. Our results show that MiSim allows for quantitative insights into microservice-based systems’ complex transient behavior by providing up to 25 metrics.

  @inproceedings{FrankWagnerHakamianStraesserVanHoorn2022MiSim, abstract = {Increased resilience compared to monolithic architectures is both one of the key promises of microservice-based architectures and a big challenge, e.g., due to the systems’ distributed nature. Resilience assessment through simulation requires fewer resources than the measurement-based techniques used in practice. However, there is no existing simulation approach that is suitable for a holistic resilience assessment of microservices comprised of (i) representative fault injections, (ii) common resilience mechanisms, and (iii) time-varying workloads. This paper presents MiSim — an extensible simulator for resilience assessment of microservice-based architectures. It overcomes the stated limitations of related work. MiSim fits resilience engineering practices by supporting scenario-based experiments and requiring only lightweight input models. We demonstrate how MiSim simulates (1) common resilience mechanisms — i.e., circuit breaker, connection limiter, retry, load balancer, and autoscaler — and (2) fault injections — i.e., instance/service killing and latency injections. In addition, we use TeaStore, a reference microservice-based architecture, aiming to reproduce scaling behavior from an experiment by using simulation. Our results show that MiSim allows for quantitative insights into microservice-based systems’ complex transient behavior by providing up to 25 metrics.}, author = {Frank, Sebastian and Wagner, Lion and Hakamian, Alireza and Straesser, Martin and van Hoorn, Andre}, booktitle = {2022 IEEE 22nd International Conference on Software Quality, Reliability and Security (QRS)}, keywords = {resilience}, pages = {1014-1025}, publisher = {IEEE}, title = {MiSim: A Simulator for Resilience Assessment of Microservice-based Architectures}, year = 2022 }

  %0 Conference Paper %1 FrankWagnerHakamianStraesserVanHoorn2022MiSim %A Frank, Sebastian %A Wagner, Lion %A Hakamian, Alireza %A Straesser, Martin %A van Hoorn, Andre %B 2022 IEEE 22nd International Conference on Software Quality, Reliability and Security (QRS) %D 2022 %I IEEE %P 1014-1025 %R 10.1109/QRS57517.2022.00105 %T MiSim: A Simulator for Resilience Assessment of Microservice-based Architectures %U https://doi.org/10.1109/QRS57517.2022.00105 %X Increased resilience compared to monolithic architectures is both one of the key promises of microservice-based architectures and a big challenge, e.g., due to the systems’ distributed nature. Resilience assessment through simulation requires fewer resources than the measurement-based techniques used in practice. However, there is no existing simulation approach that is suitable for a holistic resilience assessment of microservices comprised of (i) representative fault injections, (ii) common resilience mechanisms, and (iii) time-varying workloads. This paper presents MiSim — an extensible simulator for resilience assessment of microservice-based architectures. It overcomes the stated limitations of related work. MiSim fits resilience engineering practices by supporting scenario-based experiments and requiring only lightweight input models. We demonstrate how MiSim simulates (1) common resilience mechanisms — i.e., circuit breaker, connection limiter, retry, load balancer, and autoscaler — and (2) fault injections — i.e., instance/service killing and latency injections. In addition, we use TeaStore, a reference microservice-based architecture, aiming to reproduce scaling behavior from an experiment by using simulation. Our results show that MiSim allows for quantitative insights into microservice-based systems’ complex transient behavior by providing up to 25 metrics.
• 
  Accuracy and Systematic Biases of Heart Rate Measurements by Consumer-Grade Fitness Trackers in Postoperative Patients: Prospective Clinical Trial. P. Helmer; S. Hottenrott; P. Rodemers; R. Leppich; M. Helwich; R. Pryss; P. Kranke; P. Meybohm; B. E. Winkler; M. Sammeth; in Journal of Medical Internet Research (2022). 24(12) e42359.
  • [ BibTeX ]
  • [ EndNote ]
  @article{helmer2022accuracy, author = {Helmer, Philipp and Hottenrott, Sebastian and Rodemers, Philipp and Leppich, Robert and Helwich, Maja and Pryss, R{\"u}diger and Kranke, Peter and Meybohm, Patrick and Winkler, Bernd E and Sammeth, Michael}, journal = {Journal of Medical Internet Research}, keywords = {t_journalmagazine}, number = 12, pages = {e42359}, publisher = {JMIR Publications Toronto, Canada}, title = {Accuracy and Systematic Biases of Heart Rate Measurements by Consumer-Grade Fitness Trackers in Postoperative Patients: Prospective Clinical Trial}, volume = 24, year = 2022 }

  %0 Journal Article %1 helmer2022accuracy %A Helmer, Philipp %A Hottenrott, Sebastian %A Rodemers, Philipp %A Leppich, Robert %A Helwich, Maja %A Pryss, Rüdiger %A Kranke, Peter %A Meybohm, Patrick %A Winkler, Bernd E %A Sammeth, Michael %D 2022 %I JMIR Publications Toronto, Canada %J Journal of Medical Internet Research %N 12 %P e42359 %T Accuracy and Systematic Biases of Heart Rate Measurements by Consumer-Grade Fitness Trackers in Postoperative Patients: Prospective Clinical Trial %V 24
• 
  Identification of clinically distinct and prognostically important phenogroups in patients with acute heart failure by a machine learning approach. J. J. Albert; R. Leppich; V. Borst; F. Sahiti; N. Scholz; V. Cejka; C. Morbach; G. Ertl; C. Angermann; S. Frantz; others; in EUROPEAN JOURNAL OF HEART FAILURE (2022). (Bd. 24) 179–179.
  • [ BibTeX ]
  • [ EndNote ]
  @inproceedings{albert2022identification, author = {Albert, J Judith and Leppich, R and Borst, V and Sahiti, F and Scholz, N and Cejka, V and Morbach, C and Ertl, G and Angermann, C and Frantz, S and others}, booktitle = {EUROPEAN JOURNAL OF HEART FAILURE}, keywords = {t_interdisciplinary}, organization = {WILEY 111 RIVER ST, HOBOKEN 07030-5774, NJ USA}, pages = {179–179}, title = {Identification of clinically distinct and prognostically important phenogroups in patients with acute heart failure by a machine learning approach}, volume = 24, year = 2022 }

  %0 Conference Paper %1 albert2022identification %A Albert, J Judith %A Leppich, R %A Borst, V %A Sahiti, F %A Scholz, N %A Cejka, V %A Morbach, C %A Ertl, G %A Angermann, C %A Frantz, S %A others, %B EUROPEAN JOURNAL OF HEART FAILURE %D 2022 %P 179--179 %T Identification of clinically distinct and prognostically important phenogroups in patients with acute heart failure by a machine learning approach %V 24
• 
  CortexVR: Immersive analysis and training of cognitive executive functions of soccer players using virtual reality and machine learning. C. Krupitzer; J. Naber; J.-P. Stauffert; J. Mayer; J. Spielmann; P. Ehmann; N. Boci; M. Bürkle; A. Ho; C. Komorek; F. Heinickel; S. Kounev; C. Becker; M. E. Latoschik; in Frontiers in Psychology (2022). 5139.
  • [ BibTeX ]
  • [ EndNote ]
  • [ Download ]
  @article{krupitzer2022cortexvr, author = {Krupitzer, Christian and Naber, Jens and Stauffert, Jan-Philipp and Mayer, Jan and Spielmann, Jan and Ehmann, Paul and Boci, Noel and B{\"u}rkle, Maurice and Ho, Andr{\'e} and Komorek, Clemens and Heinickel, Felix and Kounev, Samuel and Becker, Christian and Latoschik, Marc Erich}, journal = {Frontiers in Psychology}, keywords = {t_journalmagazine}, pages = 5139, publisher = {Frontiers}, title = {CortexVR: Immersive analysis and training of cognitive executive functions of soccer players using virtual reality and machine learning}, year = 2022 }

  %0 Journal Article %1 krupitzer2022cortexvr %A Krupitzer, Christian %A Naber, Jens %A Stauffert, Jan-Philipp %A Mayer, Jan %A Spielmann, Jan %A Ehmann, Paul %A Boci, Noel %A Bürkle, Maurice %A Ho, André %A Komorek, Clemens %A Heinickel, Felix %A Kounev, Samuel %A Becker, Christian %A Latoschik, Marc Erich %D 2022 %I Frontiers %J Frontiers in Psychology %P 5139 %T CortexVR: Immersive analysis and training of cognitive executive functions of soccer players using virtual reality and machine learning
• 
  Retrospective Analysis of Training Intensity Distribution Based on Race Pace Versus Physiological Benchmarks in Highly Trained Sprint Kayakers. M. Matzka; R. Leppich; B. Sperlich; C. Zinner; in Sports Medicine-Open (2022). 8(1) 1–12.
  • [ BibTeX ]
  • [ EndNote ]
  @article{matzka2022retrospective, author = {Matzka, Manuel and Leppich, Robert and Sperlich, Billy and Zinner, Christoph}, journal = {Sports Medicine-Open}, keywords = {t_journalmagazine}, number = 1, pages = {1–12}, publisher = {SpringerOpen}, title = {Retrospective Analysis of Training Intensity Distribution Based on Race Pace Versus Physiological Benchmarks in Highly Trained Sprint Kayakers}, volume = 8, year = 2022 }

  %0 Journal Article %1 matzka2022retrospective %A Matzka, Manuel %A Leppich, Robert %A Sperlich, Billy %A Zinner, Christoph %D 2022 %I SpringerOpen %J Sports Medicine-Open %N 1 %P 1--12 %T Retrospective Analysis of Training Intensity Distribution Based on Race Pace Versus Physiological Benchmarks in Highly Trained Sprint Kayakers %V 8
• 
  A literature review on optimization techniques for adaptation planning in adaptive systems: State of the art and research directions. E. Henrichs; V. Lesch; M. Straesser; S. Kounev; C. Krupitzer; in Information and Software Technology (2022). 149 106940.
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  • [ Download ]
  Context: Recent developments in modern IT systems including internet of things, edge/fog computing, or cyber–physical systems support intelligent and seamless interaction between users and systems. This requires a reaction to changes in their environment or the system. Adaptive systems provide mechanisms for these reactions. Objective: To implement this functionality, several approaches for the planning of adaptations exist that rely on rules, utility functions, or advanced techniques, such as machine learning. As the adaptation space with possible options is often extensively huge, optimization techniques might support efficient determination of the adaptation space and identify the system’s optimal configuration. With this paper, we provide a systematic review of adaptation planning as the optimization target. Method: In this paper, we review which optimization techniques are applied for adaptation planning in adaptive systems using a systematic literature review approach. Results: We reviewed 115 paper in detail out of an initial search set of 9,588 papers. Our analysis reveals that learning techniques and genetic algorithms are by far dominant; in total, heuristics (anytime learning) are more frequently applied as exact algorithms. We observed that around 57% of the approaches target multi-objectiveness and around 30% integrate distributed optimization. As last dimension, we focused on situation-awareness, which is only supported by two approaches. Conclusion: In this paper, we provide an overview of the current state of the art of approaches that rely on optimization techniques for planning adaptations in adaptive systems and further derive open research challenges, in particular regarding the integration of distributed optimization and situation-awareness.

  @article{HENRICHS2022106940, abstract = {Context: Recent developments in modern IT systems including internet of things, edge/fog computing, or cyber–physical systems support intelligent and seamless interaction between users and systems. This requires a reaction to changes in their environment or the system. Adaptive systems provide mechanisms for these reactions. Objective: To implement this functionality, several approaches for the planning of adaptations exist that rely on rules, utility functions, or advanced techniques, such as machine learning. As the adaptation space with possible options is often extensively huge, optimization techniques might support efficient determination of the adaptation space and identify the system’s optimal configuration. With this paper, we provide a systematic review of adaptation planning as the optimization target. Method: In this paper, we review which optimization techniques are applied for adaptation planning in adaptive systems using a systematic literature review approach. Results: We reviewed 115 paper in detail out of an initial search set of 9,588 papers. Our analysis reveals that learning techniques and genetic algorithms are by far dominant; in total, heuristics (anytime learning) are more frequently applied as exact algorithms. We observed that around 57% of the approaches target multi-objectiveness and around 30% integrate distributed optimization. As last dimension, we focused on situation-awareness, which is only supported by two approaches. Conclusion: In this paper, we provide an overview of the current state of the art of approaches that rely on optimization techniques for planning adaptations in adaptive systems and further derive open research challenges, in particular regarding the integration of distributed optimization and situation-awareness.}, author = {Henrichs, Elia and Lesch, Veronika and Straesser, Martin and Kounev, Samuel and Krupitzer, Christian}, journal = {Information and Software Technology}, keywords = {sys:relevantfor:se-group}, pages = 106940, title = {A literature review on optimization techniques for adaptation planning in adaptive systems: State of the art and research directions}, volume = 149, year = 2022 }

  %0 Journal Article %1 HENRICHS2022106940 %A Henrichs, Elia %A Lesch, Veronika %A Straesser, Martin %A Kounev, Samuel %A Krupitzer, Christian %D 2022 %J Information and Software Technology %P 106940 %T A literature review on optimization techniques for adaptation planning in adaptive systems: State of the art and research directions %U https://www.sciencedirect.com/science/article/pii/S0950584922000891 %V 149 %X Context: Recent developments in modern IT systems including internet of things, edge/fog computing, or cyber–physical systems support intelligent and seamless interaction between users and systems. This requires a reaction to changes in their environment or the system. Adaptive systems provide mechanisms for these reactions. Objective: To implement this functionality, several approaches for the planning of adaptations exist that rely on rules, utility functions, or advanced techniques, such as machine learning. As the adaptation space with possible options is often extensively huge, optimization techniques might support efficient determination of the adaptation space and identify the system’s optimal configuration. With this paper, we provide a systematic review of adaptation planning as the optimization target. Method: In this paper, we review which optimization techniques are applied for adaptation planning in adaptive systems using a systematic literature review approach. Results: We reviewed 115 paper in detail out of an initial search set of 9,588 papers. Our analysis reveals that learning techniques and genetic algorithms are by far dominant; in total, heuristics (anytime learning) are more frequently applied as exact algorithms. We observed that around 57% of the approaches target multi-objectiveness and around 30% integrate distributed optimization. As last dimension, we focused on situation-awareness, which is only supported by two approaches. Conclusion: In this paper, we provide an overview of the current state of the art of approaches that rely on optimization techniques for planning adaptations in adaptive systems and further derive open research challenges, in particular regarding the integration of distributed optimization and situation-awareness.
• 
  SPEC Research - Introducing the Predictive Data Analytics Working Group. A. Bauer; M. Leznik; D. Seybold; I. Trubin; B. Erb; J. Domaschka; P. Jamshidi; in Companion of the 2022 ACM/SPEC International Conference on Performance Engineering (2022).
  • [ BibTeX ]
  • [ EndNote ]
  @conference{bauer2022research, author = {Bauer, André and Leznik, Mark and Seybold, Daniel and Trubin, Igor and Erb, Benjamin and Domaschka, Jörg and Jamshidi, Pooyan}, booktitle = {Companion of the 2022 ACM/SPEC International Conference on Performance Engineering}, keywords = {spec}, month = {04}, series = {ICPE '22}, title = {SPEC Research - Introducing the Predictive Data Analytics Working Group}, year = 2022 }

  %0 Generic %1 bauer2022research %A Bauer, André %A Leznik, Mark %A Seybold, Daniel %A Trubin, Igor %A Erb, Benjamin %A Domaschka, Jörg %A Jamshidi, Pooyan %B Companion of the 2022 ACM/SPEC International Conference on Performance Engineering %D 2022 %T SPEC Research - Introducing the Predictive Data Analytics Working Group
• 
  A case study on the stability of performance tests for serverless applications. S. Eismann; D. Costa; L. Liao; C.-P. Bezemer; W. Shang; A. van Hoorn; S. Kounev; in Journal of Systems and Software (JSS) (2022). 189
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  • [ Download ]
  Context: While in serverless computing, application resource management and operational concerns are generally delegated to the cloud provider, ensuring that serverless applications meet their performance requirements is still a responsibility of the developers. Performance testing is a commonly used performance assessment practice; however, it traditionally requires visibility of the resource environment. Objective: In this study, we investigate whether performance tests of serverless applications are stable, that is, if their results are reproducible, and what implications the serverless paradigm has for performance tests. Method: We conduct a case study where we collect two datasets of performance test results: (a) repetitions of performance tests for varying memory size and load intensities and (b) three repetitions of the same performance test every day for ten months. Results: We find that performance tests of serverless applications are comparatively stable if conducted on the same day. However, we also observe short-term performance variations and frequent long-term performance changes. Conclusion: Performance tests for serverless applications can be stable; however, the serverless model impacts the planning, execution, and analysis of performance tests.

  @article{eismann2022study, abstract = {Context: While in serverless computing, application resource management and operational concerns are generally delegated to the cloud provider, ensuring that serverless applications meet their performance requirements is still a responsibility of the developers. Performance testing is a commonly used performance assessment practice; however, it traditionally requires visibility of the resource environment. Objective: In this study, we investigate whether performance tests of serverless applications are stable, that is, if their results are reproducible, and what implications the serverless paradigm has for performance tests. Method: We conduct a case study where we collect two datasets of performance test results: (a) repetitions of performance tests for varying memory size and load intensities and (b) three repetitions of the same performance test every day for ten months. Results: We find that performance tests of serverless applications are comparatively stable if conducted on the same day. However, we also observe short-term performance variations and frequent long-term performance changes. Conclusion: Performance tests for serverless applications can be stable; however, the serverless model impacts the planning, execution, and analysis of performance tests.}, author = {Eismann, Simon and Costa, Diego and Liao, Lizhi and Bezemer, Cor-Paul and Shang, Weiyi and van Hoorn, André and Kounev, Samuel}, journal = {Journal of Systems and Software (JSS)}, keywords = {t_journalmagazine}, title = {A case study on the stability of performance tests for serverless applications}, volume = 189, year = 2022 }

  %0 Journal Article %1 eismann2022study %A Eismann, Simon %A Costa, Diego %A Liao, Lizhi %A Bezemer, Cor-Paul %A Shang, Weiyi %A van Hoorn, André %A Kounev, Samuel %D 2022 %J Journal of Systems and Software (JSS) %T A case study on the stability of performance tests for serverless applications %U https://www.sciencedirect.com/science/article/abs/pii/S0164121222000498 %V 189 %X Context: While in serverless computing, application resource management and operational concerns are generally delegated to the cloud provider, ensuring that serverless applications meet their performance requirements is still a responsibility of the developers. Performance testing is a commonly used performance assessment practice; however, it traditionally requires visibility of the resource environment. Objective: In this study, we investigate whether performance tests of serverless applications are stable, that is, if their results are reproducible, and what implications the serverless paradigm has for performance tests. Method: We conduct a case study where we collect two datasets of performance test results: (a) repetitions of performance tests for varying memory size and load intensities and (b) three repetitions of the same performance test every day for ten months. Results: We find that performance tests of serverless applications are comparatively stable if conducted on the same day. However, we also observe short-term performance variations and frequent long-term performance changes. Conclusion: Performance tests for serverless applications can be stable; however, the serverless model impacts the planning, execution, and analysis of performance tests.
• 
  Automated Triage of Performance Change Points Using Time Series Analysis and Machine Learning. A. Bauer; M. Straesser; L. Beierlieb; M. Meissner; S. Kounev; in Proceedings of the 2022 ACM/SPEC on International Conference on Performance Engineering (2022).
  • [ BibTeX ]
  • [ EndNote ]
  • [ Download ]
  @conference{bauer2022automated, author = {Bauer, André and Straesser, Martin and Beierlieb, Lukas and Meissner, Maximilian and Kounev, Samuel}, booktitle = {Proceedings of the 2022 ACM/SPEC on International Conference on Performance Engineering}, keywords = {machine_learning}, month = {04}, publisher = {ACM}, title = {Automated Triage of Performance Change Points Using Time Series Analysis and Machine Learning}, year = 2022 }

  %0 Generic %1 bauer2022automated %A Bauer, André %A Straesser, Martin %A Beierlieb, Lukas %A Meissner, Maximilian %A Kounev, Samuel %B Proceedings of the 2022 ACM/SPEC on International Conference on Performance Engineering %D 2022 %I ACM %T Automated Triage of Performance Change Points Using Time Series Analysis and Machine Learning
• 
  SPEC Research Group Newsletter, Issue 11. S. Kounev; A. van Hoorn; M. Straesser; A. Bauer; (2022, April).

  Published by Standard Performance Evaluation Corporation (SPEC)
  • [ BibTeX ]
  • [ EndNote ]
  • [ Download ]
  @misc{SPEC-RG-NEWSLETTER-11, author = {Kounev, Samuel and van Hoorn, Andre and Straesser, Martin and Bauer, Andr{é}}, keywords = {SPEC}, month = {04}, note = {Published by Standard Performance Evaluation Corporation (SPEC)}, title = {SPEC Research Group Newsletter, Issue 11}, year = 2022 }

  %0 Generic %1 SPEC-RG-NEWSLETTER-11 %A Kounev, Samuel %A van Hoorn, Andre %A Straesser, Martin %A Bauer, André %D 2022 %T SPEC Research Group Newsletter, Issue 11
• 
  FADE: Towards Flexible and Adaptive Distance Estimation Considering Obstacles. M. Hadry; V. Lesch; S. Kounev; in Companion of the 13th ACM/SPEC International Conference on Performance Engineering (ICPE 2022) (2022).
  • [ BibTeX ]
  • [ EndNote ]
  • [ Download ]
  @inproceedings{hadry2022towards, author = {Hadry, Marius and Lesch, Veronika and Kounev, Samuel}, booktitle = {Companion of the 13th ACM/SPEC International Conference on Performance Engineering (ICPE 2022)}, keywords = {cyber-physical_systems}, month = {04}, publisher = {ACM}, title = {FADE: Towards Flexible and Adaptive Distance Estimation Considering Obstacles}, year = 2022 }

  %0 Conference Paper %1 hadry2022towards %A Hadry, Marius %A Lesch, Veronika %A Kounev, Samuel %B Companion of the 13th ACM/SPEC International Conference on Performance Engineering (ICPE 2022) %D 2022 %I ACM %T FADE: Towards Flexible and Adaptive Distance Estimation Considering Obstacles
• 
  Measurement, Modeling, and Emulation of Power Consumption of Distributed Systems. N. Schmitt; (2022, Juni).
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  @phdthesis{Schmitt_2022, author = {Schmitt, Norbert}, keywords = {power}, month = {06}, title = {Measurement, Modeling, and Emulation of Power Consumption of Distributed Systems}, year = 2022 }

  %0 Thesis %1 Schmitt_2022 %A Schmitt, Norbert %D 2022 %T Measurement, Modeling, and Emulation of Power Consumption of Distributed Systems %U https://opus.bibliothek.uni-wuerzburg.de/frontdoor/index/index/start/2/rows/10/sortfield/score/sortorder/desc/searchtype/simple/query/Norbert+Schmitt/yearfq/2022/docId/27658
• 
  SPEC Research - Introducing the Predictive Data Analytics Working Group. A. Bauer; M. Leznik; D. Seybold; I. Trubin; B. Erb; J. Domaschka; P. Jamshidi; in Companion of the 2022 ACM/SPEC on International Conference on Performance Engineering (2022).
  • [ BibTeX ]
  • [ EndNote ]
  • [ Download ]
  @conference{noauthororeditor, author = {Bauer, André and Leznik, Mark and Seybold, Daniel and Trubin, Igor and Erb, Benjamin and Domaschka, Jörg and Jamshidi, Pooyan}, booktitle = {Companion of the 2022 ACM/SPEC on International Conference on Performance Engineering}, keywords = {spec}, month = {04}, title = {SPEC Research - Introducing the Predictive Data Analytics Working Group}, year = 2022 }

  %0 Generic %1 noauthororeditor %A Bauer, André %A Leznik, Mark %A Seybold, Daniel %A Trubin, Igor %A Erb, Benjamin %A Domaschka, Jörg %A Jamshidi, Pooyan %B Companion of the 2022 ACM/SPEC on International Conference on Performance Engineering %D 2022 %T SPEC Research - Introducing the Predictive Data Analytics Working Group
• 
  Self-Aware Optimization of Cyber-Physical Systems in Intelligent Transportation and Logistics Systems. V. Lesch; Thesis; Universität Würzburg. (2022, April).
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  @phdthesis{Le2022-Dissertation, author = {Lesch, Veronika}, keywords = {internet_of_things}, month = {04}, school = {Universität Würzburg}, title = {Self-Aware Optimization of Cyber-Physical Systems in Intelligent Transportation and Logistics Systems}, type = {Dissertation}, year = 2022 }

  %0 Thesis %1 Le2022-Dissertation %A Lesch, Veronika %D 2022 %T Self-Aware Optimization of Cyber-Physical Systems in Intelligent Transportation and Logistics Systems %U https://doi.org/10.25972/OPUS-27228
• 
  Change Point Detection for MongoDB Time Series Performance Regression. M. Leznik; M. S. Iqbal; I. A. Trubin; A. Lochner; P. Jamshidi; A. Bauer; in Proceedings of the 2022 ACM/SPEC on International Conference on Performance Engineering (2022).
  • [ BibTeX ]
  • [ EndNote ]
  @conference{leznik2022change, author = {Leznik, Mark and Iqbal, Md Shahriar and Trubin, Igor A. and Lochner, Arne and Jamshidi, Pooyan and Bauer, André}, booktitle = {Proceedings of the 2022 ACM/SPEC on International Conference on Performance Engineering}, keywords = {performance}, month = {04}, publisher = {ACM}, title = {Change Point Detection for MongoDB Time Series Performance Regression}, year = 2022 }

  %0 Generic %1 leznik2022change %A Leznik, Mark %A Iqbal, Md Shahriar %A Trubin, Igor A. %A Lochner, Arne %A Jamshidi, Pooyan %A Bauer, André %B Proceedings of the 2022 ACM/SPEC on International Conference on Performance Engineering %D 2022 %I ACM %T Change Point Detection for MongoDB Time Series Performance Regression
• 
  Experience and Guidelines for Sorting Algorithm Choices and Their Energy Efficiency. M. Meissner; S. Kamthania; N. Rawtani; J. Bucek; K.-D. Lange; S. Kounev; in Companion of the 2022 ACM/SPEC International Conference on Performance Engineering (2022).
  • [ BibTeX ]
  • [ EndNote ]
  @inproceedings{meissner2022experience, address = {New York, NY, USA}, author = {Meissner, Maximilian and Kamthania, Supriya and Rawtani, Nishant and Bucek, James and Lange, Klaus-Dieter and Kounev, Samuel}, booktitle = {Companion of the 2022 ACM/SPEC International Conference on Performance Engineering}, keywords = {t_workshop}, month = {04}, publisher = {ACM}, title = {Experience and Guidelines for Sorting Algorithm Choices and Their Energy Efficiency}, year = 2022 }

  %0 Conference Paper %1 meissner2022experience %A Meissner, Maximilian %A Kamthania, Supriya %A Rawtani, Nishant %A Bucek, James %A Lange, Klaus-Dieter %A Kounev, Samuel %B Companion of the 2022 ACM/SPEC International Conference on Performance Engineering %C New York, NY, USA %D 2022 %I ACM %T Experience and Guidelines for Sorting Algorithm Choices and Their Energy Efficiency
• 
  Model Learning for Performance Prediction of Cloud-native Microservice Applications. J. Grohmann; Thesis; Universität Würzburg. (2022, März).

  Distinction
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  • [ Download ]
  One consequence of the recent coronavirus pandemic is increased demand and use of online services around the globe. At the same time, performance requirements for modern technologies are becoming more stringent as users become accustomed to higher standards. These increased performance and availability requirements, coupled with the unpredictable usage growth, are driving an increasing proportion of applications to run on public cloud platforms as they promise better scalability and reliability. With data centers already responsible for about one percent of the world's power consumption, optimizing resource usage is of paramount importance. Simultaneously, meeting the increasing and changing resource and performance requirements is only possible by optimizing resource management without introducing additional overhead. This requires the research and development of new modeling approaches to understand the behavior of running applications with minimal information. However, the emergence of modern software paradigms makes it increasingly difficult to derive such models and renders previous performance modeling techniques infeasible. Modern cloud applications are often deployed as a collection of fine-grained and interconnected components called microservices. Microservice architectures offer massive benefits but also have broad implications for the performance characteristics of the respective systems. In addition, the microservices paradigm is typically paired with a DevOps culture, resulting in frequent application and deployment changes. Such applications are often referred to as cloud-native applications. In summary, the increasing use of ever-changing cloud-hosted microservice applications introduces a number of unique challenges for modeling the performance of modern applications. These include the amount, type, and structure of monitoring data, frequent behavioral changes, or infrastructure variabilities. This violates common assumptions of the state of the art and opens a research gap for our work. In this thesis, we present five techniques for automated learning of performance models for cloud-native software systems. We achieve this by combining machine learning with traditional performance modeling techniques. Unlike previous work, our focus is on cloud-hosted and continuously evolving microservice architectures, so-called cloud-native applications. Therefore, our contributions aim to solve the above challenges to deliver automated performance models with minimal computational overhead and no manual intervention. Depending on the cloud computing model, privacy agreements, or monitoring capabilities of each platform, we identify different scenarios where performance modeling, prediction, and optimization techniques can provide great benefits. Specifically, the contributions of this thesis are as follows: Monitorless: Application-agnostic prediction of performance degradations. To manage application performance with only platform-level monitoring, we propose Monitorless, the first truly application-independent approach to detecting performance degradation. We use machine learning to bridge the gap between platform-level monitoring and application-specific measurements, eliminating the need for application-level monitoring. Monitorless creates a single and holistic resource saturation model that can be used for heterogeneous and untrained applications. Results show that Monitorless infers resource-based performance degradation with 97% accuracy. Moreover, it can achieve similar performance to typical autoscaling solutions, despite using less monitoring information. SuanMing: Predicting performance degradation using tracing. We introduce SuanMing to mitigate performance issues before they impact the user experience. This contribution is applied in scenarios where tracing tools enable application-level monitoring. SuanMing predicts explainable causes of expected performance degradations and prevents performance degradations before they occur. Evaluation results show that SuanMing can predict and pinpoint future performance degradations with an accuracy of over 90%. SARDE: Continuous and autonomous estimation of resource demands. We present SARDE to learn application models for highly variable application deployments. This contribution focuses on the continuous estimation of application resource demands, a key parameter of performance models. SARDE represents an autonomous ensemble estimation technique. It dynamically and continuously optimizes, selects, and executes an ensemble of approaches to estimate resource demands in response to changes in the application or its environment. Through continuous online adaptation, SARDE efficiently achieves an average resource demand estimation error of 15.96% in our evaluation. DepIC: Learning parametric dependencies from monitoring data. DepIC utilizes feature selection techniques in combination with an ensemble regression approach to automatically identify and characterize parametric dependencies. Although parametric dependencies can massively improve the accuracy of performance models, DepIC is the first approach to automatically learn such parametric dependencies from passive monitoring data streams. Our evaluation shows that DepIC achieves 91.7% precision in identifying dependencies and reduces the characterization prediction error by 30% compared to the best individual approach. Baloo: Modeling the configuration space of databases. To study the impact of different configurations within distributed DBMSs, we introduce Baloo. Our last contribution models the configuration space of databases considering measurement variabilities in the cloud. More specifically, Baloo dynamically estimates the required benchmarking measurements and automatically builds a configuration space model of a given DBMS. Our evaluation of Baloo on a dataset consisting of 900 configuration points shows that the framework achieves a prediction error of less than 11% while saving up to 80% of the measurement effort. Although the contributions themselves are orthogonally aligned, taken together they provide a holistic approach to performance management of modern cloud-native microservice applications. Our contributions are a significant step forward as they specifically target novel and cloud-native software development and operation paradigms, surpassing the capabilities and limitations of previous approaches. In addition, the research presented in this paper also has a significant impact on the industry, as the contributions were developed in collaboration with research teams from Nokia Bell Labs, Huawei, and Google. Overall, our solutions open up new possibilities for managing and optimizing cloud applications and improve cost and energy efficiency.

  @phdthesis{Gr2022-Dissertation, abstract = {One consequence of the recent coronavirus pandemic is increased demand and use of online services around the globe. At the same time, performance requirements for modern technologies are becoming more stringent as users become accustomed to higher standards. These increased performance and availability requirements, coupled with the unpredictable usage growth, are driving an increasing proportion of applications to run on public cloud platforms as they promise better scalability and reliability. With data centers already responsible for about one percent of the world's power consumption, optimizing resource usage is of paramount importance. Simultaneously, meeting the increasing and changing resource and performance requirements is only possible by optimizing resource management without introducing additional overhead. This requires the research and development of new modeling approaches to understand the behavior of running applications with minimal information. However, the emergence of modern software paradigms makes it increasingly difficult to derive such models and renders previous performance modeling techniques infeasible. Modern cloud applications are often deployed as a collection of fine-grained and interconnected components called microservices. Microservice architectures offer massive benefits but also have broad implications for the performance characteristics of the respective systems. In addition, the microservices paradigm is typically paired with a DevOps culture, resulting in frequent application and deployment changes. Such applications are often referred to as cloud-native applications. In summary, the increasing use of ever-changing cloud-hosted microservice applications introduces a number of unique challenges for modeling the performance of modern applications. These include the amount, type, and structure of monitoring data, frequent behavioral changes, or infrastructure variabilities. This violates common assumptions of the state of the art and opens a research gap for our work. In this thesis, we present five techniques for automated learning of performance models for cloud-native software systems. We achieve this by combining machine learning with traditional performance modeling techniques. Unlike previous work, our focus is on cloud-hosted and continuously evolving microservice architectures, so-called cloud-native applications. Therefore, our contributions aim to solve the above challenges to deliver automated performance models with minimal computational overhead and no manual intervention. Depending on the cloud computing model, privacy agreements, or monitoring capabilities of each platform, we identify different scenarios where performance modeling, prediction, and optimization techniques can provide great benefits. Specifically, the contributions of this thesis are as follows: Monitorless: Application-agnostic prediction of performance degradations. To manage application performance with only platform-level monitoring, we propose Monitorless, the first truly application-independent approach to detecting performance degradation. We use machine learning to bridge the gap between platform-level monitoring and application-specific measurements, eliminating the need for application-level monitoring. Monitorless creates a single and holistic resource saturation model that can be used for heterogeneous and untrained applications. Results show that Monitorless infers resource-based performance degradation with 97% accuracy. Moreover, it can achieve similar performance to typical autoscaling solutions, despite using less monitoring information. SuanMing: Predicting performance degradation using tracing. We introduce SuanMing to mitigate performance issues before they impact the user experience. This contribution is applied in scenarios where tracing tools enable application-level monitoring. SuanMing predicts explainable causes of expected performance degradations and prevents performance degradations before they occur. Evaluation results show that SuanMing can predict and pinpoint future performance degradations with an accuracy of over 90%. SARDE: Continuous and autonomous estimation of resource demands. We present SARDE to learn application models for highly variable application deployments. This contribution focuses on the continuous estimation of application resource demands, a key parameter of performance models. SARDE represents an autonomous ensemble estimation technique. It dynamically and continuously optimizes, selects, and executes an ensemble of approaches to estimate resource demands in response to changes in the application or its environment. Through continuous online adaptation, SARDE efficiently achieves an average resource demand estimation error of 15.96% in our evaluation. DepIC: Learning parametric dependencies from monitoring data. DepIC utilizes feature selection techniques in combination with an ensemble regression approach to automatically identify and characterize parametric dependencies. Although parametric dependencies can massively improve the accuracy of performance models, DepIC is the first approach to automatically learn such parametric dependencies from passive monitoring data streams. Our evaluation shows that DepIC achieves 91.7% precision in identifying dependencies and reduces the characterization prediction error by 30% compared to the best individual approach. Baloo: Modeling the configuration space of databases. To study the impact of different configurations within distributed DBMSs, we introduce Baloo. Our last contribution models the configuration space of databases considering measurement variabilities in the cloud. More specifically, Baloo dynamically estimates the required benchmarking measurements and automatically builds a configuration space model of a given DBMS. Our evaluation of Baloo on a dataset consisting of 900 configuration points shows that the framework achieves a prediction error of less than 11% while saving up to 80% of the measurement effort. Although the contributions themselves are orthogonally aligned, taken together they provide a holistic approach to performance management of modern cloud-native microservice applications. Our contributions are a significant step forward as they specifically target novel and cloud-native software development and operation paradigms, surpassing the capabilities and limitations of previous approaches. In addition, the research presented in this paper also has a significant impact on the industry, as the contributions were developed in collaboration with research teams from Nokia Bell Labs, Huawei, and Google. Overall, our solutions open up new possibilities for managing and optimizing cloud applications and improve cost and energy efficiency.}, author = {Grohmann, Johannes}, keywords = {performance}, month = {03}, note = {Distinction}, school = {Universität Würzburg}, title = {Model Learning for Performance Prediction of Cloud-native Microservice Applications}, type = {Dissertation}, year = 2022 }

  %0 Thesis %1 Gr2022-Dissertation %A Grohmann, Johannes %D 2022 %T Model Learning for Performance Prediction of Cloud-native Microservice Applications %U https://opus.bibliothek.uni-wuerzburg.de/frontdoor/index/index/docId/26160 %X One consequence of the recent coronavirus pandemic is increased demand and use of online services around the globe. At the same time, performance requirements for modern technologies are becoming more stringent as users become accustomed to higher standards. These increased performance and availability requirements, coupled with the unpredictable usage growth, are driving an increasing proportion of applications to run on public cloud platforms as they promise better scalability and reliability. With data centers already responsible for about one percent of the world's power consumption, optimizing resource usage is of paramount importance. Simultaneously, meeting the increasing and changing resource and performance requirements is only possible by optimizing resource management without introducing additional overhead. This requires the research and development of new modeling approaches to understand the behavior of running applications with minimal information. However, the emergence of modern software paradigms makes it increasingly difficult to derive such models and renders previous performance modeling techniques infeasible. Modern cloud applications are often deployed as a collection of fine-grained and interconnected components called microservices. Microservice architectures offer massive benefits but also have broad implications for the performance characteristics of the respective systems. In addition, the microservices paradigm is typically paired with a DevOps culture, resulting in frequent application and deployment changes. Such applications are often referred to as cloud-native applications. In summary, the increasing use of ever-changing cloud-hosted microservice applications introduces a number of unique challenges for modeling the performance of modern applications. These include the amount, type, and structure of monitoring data, frequent behavioral changes, or infrastructure variabilities. This violates common assumptions of the state of the art and opens a research gap for our work. In this thesis, we present five techniques for automated learning of performance models for cloud-native software systems. We achieve this by combining machine learning with traditional performance modeling techniques. Unlike previous work, our focus is on cloud-hosted and continuously evolving microservice architectures, so-called cloud-native applications. Therefore, our contributions aim to solve the above challenges to deliver automated performance models with minimal computational overhead and no manual intervention. Depending on the cloud computing model, privacy agreements, or monitoring capabilities of each platform, we identify different scenarios where performance modeling, prediction, and optimization techniques can provide great benefits. Specifically, the contributions of this thesis are as follows: Monitorless: Application-agnostic prediction of performance degradations. To manage application performance with only platform-level monitoring, we propose Monitorless, the first truly application-independent approach to detecting performance degradation. We use machine learning to bridge the gap between platform-level monitoring and application-specific measurements, eliminating the need for application-level monitoring. Monitorless creates a single and holistic resource saturation model that can be used for heterogeneous and untrained applications. Results show that Monitorless infers resource-based performance degradation with 97% accuracy. Moreover, it can achieve similar performance to typical autoscaling solutions, despite using less monitoring information. SuanMing: Predicting performance degradation using tracing. We introduce SuanMing to mitigate performance issues before they impact the user experience. This contribution is applied in scenarios where tracing tools enable application-level monitoring. SuanMing predicts explainable causes of expected performance degradations and prevents performance degradations before they occur. Evaluation results show that SuanMing can predict and pinpoint future performance degradations with an accuracy of over 90%. SARDE: Continuous and autonomous estimation of resource demands. We present SARDE to learn application models for highly variable application deployments. This contribution focuses on the continuous estimation of application resource demands, a key parameter of performance models. SARDE represents an autonomous ensemble estimation technique. It dynamically and continuously optimizes, selects, and executes an ensemble of approaches to estimate resource demands in response to changes in the application or its environment. Through continuous online adaptation, SARDE efficiently achieves an average resource demand estimation error of 15.96% in our evaluation. DepIC: Learning parametric dependencies from monitoring data. DepIC utilizes feature selection techniques in combination with an ensemble regression approach to automatically identify and characterize parametric dependencies. Although parametric dependencies can massively improve the accuracy of performance models, DepIC is the first approach to automatically learn such parametric dependencies from passive monitoring data streams. Our evaluation shows that DepIC achieves 91.7% precision in identifying dependencies and reduces the characterization prediction error by 30% compared to the best individual approach. Baloo: Modeling the configuration space of databases. To study the impact of different configurations within distributed DBMSs, we introduce Baloo. Our last contribution models the configuration space of databases considering measurement variabilities in the cloud. More specifically, Baloo dynamically estimates the required benchmarking measurements and automatically builds a configuration space model of a given DBMS. Our evaluation of Baloo on a dataset consisting of 900 configuration points shows that the framework achieves a prediction error of less than 11% while saving up to 80% of the measurement effort. Although the contributions themselves are orthogonally aligned, taken together they provide a holistic approach to performance management of modern cloud-native microservice applications. Our contributions are a significant step forward as they specifically target novel and cloud-native software development and operation paradigms, surpassing the capabilities and limitations of previous approaches. In addition, the research presented in this paper also has a significant impact on the industry, as the contributions were developed in collaboration with research teams from Nokia Bell Labs, Huawei, and Google. Overall, our solutions open up new possibilities for managing and optimizing cloud applications and improve cost and energy efficiency.
• 
  An Experience Report on the Suitability of a Distributed Group Encryption Scheme for an IoT Use Case. T. Prantl; S. Engel; A. Bauer; A. E. Ben Yahya; S. Herrnleben; L. Iffländer; A. Dmitrienko; S. Kounev; in 2022 IEEE 95th Vehicular Technology Conference (VTC2022) (2022).
  • [ BibTeX ]
  • [ EndNote ]
  @inproceedings{PrEnBaAlHeIfDmKo2022-IoT/CPS-DistributedGroupEncryption, author = {Prantl, Thomas and Engel, Simon and Bauer, Andre and Ben Yahya, Ala Eddine and Herrnleben, Stefan and Iffländer, Lukas and Dmitrienko, Alexandra and Kounev, Samuel}, booktitle = {2022 IEEE 95th Vehicular Technology Conference (VTC2022)}, keywords = {t_workshop}, organization = {IEEE}, title = {An Experience Report on the Suitability of a Distributed Group Encryption Scheme for an IoT Use Case}, year = 2022 }

  %0 Conference Paper %1 PrEnBaAlHeIfDmKo2022-IoT/CPS-DistributedGroupEncryption %A Prantl, Thomas %A Engel, Simon %A Bauer, Andre %A Ben Yahya, Ala Eddine %A Herrnleben, Stefan %A Iffländer, Lukas %A Dmitrienko, Alexandra %A Kounev, Samuel %B 2022 IEEE 95th Vehicular Technology Conference (VTC2022) %D 2022 %T An Experience Report on the Suitability of a Distributed Group Encryption Scheme for an IoT Use Case
• 
  The Relationship Between the Distribution of Training Intensity and Performance of Kayak and Canoe Sprinters: A Retrospective Observational Analysis of One Season of Competition. M. Matzka; R. Leppich; H.-C. Holmberg; B. Sperlich; C. Zinner; in Frontiers in Sports and Active Living (2022). 3 788108.
  • [ BibTeX ]
  • [ EndNote ]
  @article{matzka2022relationship, author = {Matzka, Manuel and Leppich, Robert and Holmberg, Hans-Christer and Sperlich, Billy and Zinner, Christoph}, journal = {Frontiers in Sports and Active Living}, keywords = {t_journalmagazine}, pages = 788108, publisher = {Frontiers Media SA}, title = {The Relationship Between the Distribution of Training Intensity and Performance of Kayak and Canoe Sprinters: A Retrospective Observational Analysis of One Season of Competition}, volume = 3, year = 2022 }

  %0 Journal Article %1 matzka2022relationship %A Matzka, Manuel %A Leppich, Robert %A Holmberg, Hans-Christer %A Sperlich, Billy %A Zinner, Christoph %D 2022 %I Frontiers Media SA %J Frontiers in Sports and Active Living %P 788108 %T The Relationship Between the Distribution of Training Intensity and Performance of Kayak and Canoe Sprinters: A Retrospective Observational Analysis of One Season of Competition %V 3
• 
  Towards Forecasting Future Snow Cover Dynamics in the European Alps - The Potential of Long Optical Remote-Sensing Time Series. J. Koehler; A. Bauer; A. J. Dietz; C. Kuenzer; in Remote Sensing (2022). 14(18)
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  @article{rs14184461, author = {Koehler, Jonas and Bauer, André and Dietz, Andreas J. and Kuenzer, Claudia}, journal = {Remote Sensing}, keywords = {t_journalmagazine}, number = 18, title = {Towards Forecasting Future Snow Cover Dynamics in the European Alps - The Potential of Long Optical Remote-Sensing Time Series}, volume = 14, year = 2022 }

  %0 Journal Article %1 rs14184461 %A Koehler, Jonas %A Bauer, André %A Dietz, Andreas J. %A Kuenzer, Claudia %D 2022 %J Remote Sensing %N 18 %T Towards Forecasting Future Snow Cover Dynamics in the European Alps - The Potential of Long Optical Remote-Sensing Time Series %U https://www.mdpi.com/2072-4292/14/18/4461 %V 14
• 
  Edge Workload Trace Gathering and Analysis for Benchmarking. K. Toczé; N. Schmitt; U. Kargén; A. Aral; I. Brandi’c; in 2022 IEEE 6th International Conference on Fog and Edge Computing (ICFEC) (2022). 34–41.
  • [ BibTeX ]
  • [ EndNote ]
  @inproceedings{tocze2022edge, author = {Tocz{\'e}, Klervie and Schmitt, Norbert and Karg{\'e}n, Ulf and Aral, Atakan and Brandi{\'c}, Ivona}, booktitle = {2022 IEEE 6th International Conference on Fog and Edge Computing (ICFEC)}, keywords = {descartes}, organization = {IEEE}, pages = {34–41}, title = {Edge Workload Trace Gathering and Analysis for Benchmarking}, year = 2022 }

  %0 Conference Paper %1 tocze2022edge %A Toczé, Klervie %A Schmitt, Norbert %A Kargén, Ulf %A Aral, Atakan %A Brandi'c, Ivona %B 2022 IEEE 6th International Conference on Fog and Edge Computing (ICFEC) %D 2022 %P 34--41 %T Edge Workload Trace Gathering and Analysis for Benchmarking
• 
  SPEC Efficiency Benchmark Development: How to Contribute to the Future of Energy Conservation. M. Meissner; K.-D. Lange; J. Arnold; S. Sharma; R. Tipley; N. Rawtani; D. Reiner; M. Petrich; A. Cragin; in Companion of the 2022 ACM/SPEC International Conference on Performance Engineering (2022).
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  • [ Download ]
  A driving force behind the improvement of server efficiency in recent years is the use of SPEC benchmarks. They are used in mandatory government regulations, the ISO/IEC 21836:2020 standard, and product marketing, giving server manufacturers and buyers significant incentive to improve energy efficiency. To produce relevant results, benchmarks need to take into account future trends in hardware and software development, such as the introduction of new accelerators and workloads. To keep pace with the development of the fast moving IT landscape, SPEC plans to introduce a workload bounty program to encourage researchers to develop novel workloads. Submitted workloads will be considered for inclusion in future SPEC Efficiency benchmarks and rewarded. In this paper, we outline the process of energy-efficiency benchmark development. SPEC ensures the development of high-quality benchmarks for government regulations through its extensive experience and collaboration with stakeholders from industry, academia, and governments. One of the tools that emerged from this process is the Chauffeur Worklet Development Kit (WDK), which can be used by researchers to develop next-generation workloads to enhance the real-world relevance of future SPEC benchmarks, a critical element for the benchmarks to contribute to future energy conservation.

  @inproceedings{meissner2022efficiency, abstract = {A driving force behind the improvement of server efficiency in recent years is the use of SPEC benchmarks. They are used in mandatory government regulations, the ISO/IEC 21836:2020 standard, and product marketing, giving server manufacturers and buyers significant incentive to improve energy efficiency. To produce relevant results, benchmarks need to take into account future trends in hardware and software development, such as the introduction of new accelerators and workloads. To keep pace with the development of the fast moving IT landscape, SPEC plans to introduce a workload bounty program to encourage researchers to develop novel workloads. Submitted workloads will be considered for inclusion in future SPEC Efficiency benchmarks and rewarded. In this paper, we outline the process of energy-efficiency benchmark development. SPEC ensures the development of high-quality benchmarks for government regulations through its extensive experience and collaboration with stakeholders from industry, academia, and governments. One of the tools that emerged from this process is the Chauffeur Worklet Development Kit (WDK), which can be used by researchers to develop next-generation workloads to enhance the real-world relevance of future SPEC benchmarks, a critical element for the benchmarks to contribute to future energy conservation.}, address = {New York, NY, USA}, author = {Meissner, Maximilian and Lange, Klaus-Dieter and Arnold, Jeremy and Sharma, Sanjay and Tipley, Roger and Rawtani, Nishant and Reiner, David and Petrich, Mike and Cragin, Aaron}, booktitle = {Companion of the 2022 ACM/SPEC International Conference on Performance Engineering}, keywords = {spec}, month = {04}, publisher = {ACM}, title = {SPEC Efficiency Benchmark Development: How to Contribute to the Future of Energy Conservation}, year = 2022 }

  %0 Conference Paper %1 meissner2022efficiency %A Meissner, Maximilian %A Lange, Klaus-Dieter %A Arnold, Jeremy %A Sharma, Sanjay %A Tipley, Roger %A Rawtani, Nishant %A Reiner, David %A Petrich, Mike %A Cragin, Aaron %B Companion of the 2022 ACM/SPEC International Conference on Performance Engineering %C New York, NY, USA %D 2022 %I ACM %T SPEC Efficiency Benchmark Development: How to Contribute to the Future of Energy Conservation %X A driving force behind the improvement of server efficiency in recent years is the use of SPEC benchmarks. They are used in mandatory government regulations, the ISO/IEC 21836:2020 standard, and product marketing, giving server manufacturers and buyers significant incentive to improve energy efficiency. To produce relevant results, benchmarks need to take into account future trends in hardware and software development, such as the introduction of new accelerators and workloads. To keep pace with the development of the fast moving IT landscape, SPEC plans to introduce a workload bounty program to encourage researchers to develop novel workloads. Submitted workloads will be considered for inclusion in future SPEC Efficiency benchmarks and rewarded. In this paper, we outline the process of energy-efficiency benchmark development. SPEC ensures the development of high-quality benchmarks for government regulations through its extensive experience and collaboration with stakeholders from industry, academia, and governments. One of the tools that emerged from this process is the Chauffeur Worklet Development Kit (WDK), which can be used by researchers to develop next-generation workloads to enhance the real-world relevance of future SPEC benchmarks, a critical element for the benchmarks to contribute to future energy conservation.
• 
  Proactive Critical Event Prediction based on Monitoring Data with Focus on Technical Systems. M. O. Züfle; Thesis; Universität Würzburg. (2022).
  • [ BibTeX ]
  • [ EndNote ]
  • [ Download ]
  @phdthesis{Zuefle2022, author = {Z{\"u}fle, Marwin Otto}, keywords = {descartes}, school = {Universit{\"a}t W{\"u}rzburg}, title = {Proactive Critical Event Prediction based on Monitoring Data with Focus on Technical Systems}, type = {doctoralthesis}, year = 2022 }

  %0 Thesis %1 Zuefle2022 %A Züfle, Marwin Otto %D 2022 %T Proactive Critical Event Prediction based on Monitoring Data with Focus on Technical Systems

• 
  A Case Study on Optimization of Platooning Coordination V. Lesch; M. Hadry; S. Kounev; C. Krupitzer; (2021).
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  • [ Download ]
  @techreport{lesch2021studyplatooning, author = {Lesch, Veronika and Hadry, Marius and Kounev, Samuel and Krupitzer, Christian}, institution = {Universit{ä}t W{ü}rzburg and Universit{ä}t Hohenheim}, keywords = {t_techreport}, title = {A Case Study on Optimization of Platooning Coordination}, year = 2021 }

  %0 Report %1 lesch2021studyplatooning %A Lesch, Veronika %A Hadry, Marius %A Kounev, Samuel %A Krupitzer, Christian %D 2021 %T A Case Study on Optimization of Platooning Coordination %U https://arxiv.org/abs/2111.09665
• 
  An Overview on Approaches for Coordination of Platoons. V. Lesch; M. Breitbach; M. Segata; C. Becker; S. Kounev; C. Krupitzer; in IEEE Transactions on Intelligent Transportation Systems (2021).

  Early Access on IEEE Xplore
  • [ BibTeX ]
  • [ EndNote ]
  • [ Download ]
  @article{lesch2021overview, author = {Lesch, Veronika and Breitbach, Martin and Segata, Michele and Becker, Christian and Kounev, Samuel and Krupitzer, Christian}, journal = {IEEE Transactions on Intelligent Transportation Systems}, keywords = {platooning}, note = {Early Access on IEEE Xplore}, title = {An Overview on Approaches for Coordination of Platoons}, year = 2021 }

  %0 Journal Article %1 lesch2021overview %A Lesch, Veronika %A Breitbach, Martin %A Segata, Michele %A Becker, Christian %A Kounev, Samuel %A Krupitzer, Christian %D 2021 %J IEEE Transactions on Intelligent Transportation Systems %T An Overview on Approaches for Coordination of Platoons
• 
  Teaching Software Testing Using Automated Grading. L. Beierlieb; L. Iffländer; T. Schneider; T. Prantl; S. Kounev; in Proceedings of the Fifth Workshop "Automatische Bewertung von Programmieraufgaben" (ABP 2021),virtual event, October 28-29, 2021, A. Greubel, S. Strickroth, M. Striewe (Hrsg.) (2021).
  • [ BibTeX ]
  • [ EndNote ]
  @inproceedings{Beierlieb_2021_TeachingSoftwareTestingUsingAutomatedGrading, author = {Beierlieb, Lukas and Iffländer, Lukas and Schneider, Tobias and Prantl, Thomas and Kounev, Samuel}, booktitle = {Proceedings of the Fifth Workshop "Automatische Bewertung von Programmieraufgaben" (ABP 2021),virtual event, October 28-29, 2021}, editor = {Greubel, André and Strickroth, Sven and Striewe, Michael}, keywords = {sys:relevantfor:se-group}, publisher = {Gesellschaft für Informatik}, title = {Teaching Software Testing Using Automated Grading}, year = 2021 }

  %0 Conference Paper %1 Beierlieb_2021_TeachingSoftwareTestingUsingAutomatedGrading %A Beierlieb, Lukas %A Iffländer, Lukas %A Schneider, Tobias %A Prantl, Thomas %A Kounev, Samuel %B Proceedings of the Fifth Workshop "Automatische Bewertung von Programmieraufgaben" (ABP 2021),virtual event, October 28-29, 2021 %D 2021 %E Greubel, André %E Strickroth, Sven %E Striewe, Michael %I Gesellschaft für Informatik %T Teaching Software Testing Using Automated Grading
• 
  Recommendations for Data-Driven Degradation Estimation with Case Studies from Manufacturing and Dry-Bulk Shipping. N. Finke; M. Mohr; A. Lontke; M. Züfle; S. Kounev; R. Möller; in Research Challenges in Information Science (RCIS) (2021). 189–204.
  • [ BibTeX ]
  • [ EndNote ]
  @inproceedings{finke2021recommendations, author = {Finke, Nils and Mohr, Marisa and Lontke, Alexander and Z{\"u}fle, Marwin and Kounev, Samuel and M{\"o}ller, Ralf}, booktitle = {Research Challenges in Information Science (RCIS)}, keywords = {t_interdisciplinary}, organization = {Springer}, pages = {189–204}, title = {Recommendations for Data-Driven Degradation Estimation with Case Studies from Manufacturing and Dry-Bulk Shipping}, year = 2021 }

  %0 Conference Paper %1 finke2021recommendations %A Finke, Nils %A Mohr, Marisa %A Lontke, Alexander %A Züfle, Marwin %A Kounev, Samuel %A Möller, Ralf %B Research Challenges in Information Science (RCIS) %D 2021 %P 189--204 %T Recommendations for Data-Driven Degradation Estimation with Case Studies from Manufacturing and Dry-Bulk Shipping
• 
  Towards Situation-Aware Meta-Optimization of Adaptation Planning Strategies. V. Lesch; T. Noack; J. Hefter; S. Kounev; C. Krupitzer; in Proceedings of the 2nd IEEE International Conference on Autonomic Computing and Self-Organizing Systems - ACSOS 2021 (2021).

  Best Paper Award Runner Up, Full Paper Acceptance Ratio: 25%
  • [ BibTeX ]
  • [ EndNote ]
  • [ Download ]
  @inproceedings{lesch2021towards, author = {Lesch, Veronika and Noack, Tanja and Hefter, Johannes and Kounev, Samuel and Krupitzer, Christian}, booktitle = {Proceedings of the 2nd IEEE International Conference on Autonomic Computing and Self-Organizing Systems - ACSOS 2021}, keywords = {internet_of_things}, note = {Best Paper Award Runner Up, Full Paper Acceptance Ratio: 25%}, publisher = {IEEE}, title = {Towards Situation-Aware Meta-Optimization of Adaptation Planning Strategies}, year = 2021 }

  %0 Conference Paper %1 lesch2021towards %A Lesch, Veronika %A Noack, Tanja %A Hefter, Johannes %A Kounev, Samuel %A Krupitzer, Christian %B Proceedings of the 2nd IEEE International Conference on Autonomic Computing and Self-Organizing Systems - ACSOS 2021 %D 2021 %I IEEE %T Towards Situation-Aware Meta-Optimization of Adaptation Planning Strategies
• 
  Tackling the Rich Vehicle Routing Problem with Nature-Inspired Algorithms. V. Lesch; M. König; S. Kounev; A. Stein; C. Krupitzer; in Applied Intelligence (2021). 52 9476–9500.
  • [ BibTeX ]
  • [ EndNote ]
  • [ DOI ]
  @article{lesch2021tackling, author = {Lesch, Veronika and König, Maximilian and Kounev, Samuel and Stein, Anthony and Krupitzer, Christian}, journal = {Applied Intelligence}, keywords = {t_journalmagazine}, pages = {9476–9500}, title = {Tackling the Rich Vehicle Routing Problem with Nature-Inspired Algorithms}, volume = 52, year = 2021 }

  %0 Journal Article %1 lesch2021tackling %A Lesch, Veronika %A König, Maximilian %A Kounev, Samuel %A Stein, Anthony %A Krupitzer, Christian %D 2021 %J Applied Intelligence %P 9476–9500 %R https://doi.org/10.1007/s10489-021-03035-5 %T Tackling the Rich Vehicle Routing Problem with Nature-Inspired Algorithms %V 52
• 
  A Machine Learning-based Workflow for Automatic Detection of Anomalies in Machine Tools. M. Züfle; F. Moog; V. Lesch; C. Krupitzer; S. Kounev; in ISA Transactions: The Journal of Automation (2021).

  (in press)
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  Despite the increased sensor-based data collection in Industry 4.0, the practical use of this data is still in its infancy. In contrast, academic literature provides several approaches to detect machine failures but, in most cases, relies on simulations and vast amounts of training data. Since it is often not practical to collect such amounts of data in an industrial context, we propose an approach to detect the current production mode and machine degradation states on a comparably small data set. Our approach integrates domain knowledge about manufacturing systems into a highly generalizable end-to-end workflow ranging from raw data processing, phase segmentation, data resampling, and feature extraction to machine tool anomaly detection. The workflow applies unsupervised clustering techniques to identify the current production mode and supervised classification models for detecting the present degradation. A resampling strategy and classical machine learning models enable the workflow to handle small data sets and distinguish between normal and abnormal machine tool behavior. To the best of our knowledge, there exists no such end-to-end workflow in the literature that uses the entire machine signal as input to identify anomalies for individual tools. Our evaluation with data from a real multi-purpose machine shows that the proposed workflow detects anomalies with an average F1-score of almost 93%.

  @article{zuefle2021anomalydetection, abstract = {Despite the increased sensor-based data collection in Industry 4.0, the practical use of this data is still in its infancy. In contrast, academic literature provides several approaches to detect machine failures but, in most cases, relies on simulations and vast amounts of training data. Since it is often not practical to collect such amounts of data in an industrial context, we propose an approach to detect the current production mode and machine degradation states on a comparably small data set. Our approach integrates domain knowledge about manufacturing systems into a highly generalizable end-to-end workflow ranging from raw data processing, phase segmentation, data resampling, and feature extraction to machine tool anomaly detection. The workflow applies unsupervised clustering techniques to identify the current production mode and supervised classification models for detecting the present degradation. A resampling strategy and classical machine learning models enable the workflow to handle small data sets and distinguish between normal and abnormal machine tool behavior. To the best of our knowledge, there exists no such end-to-end workflow in the literature that uses the entire machine signal as input to identify anomalies for individual tools. Our evaluation with data from a real multi-purpose machine shows that the proposed workflow detects anomalies with an average F1-score of almost 93%.}, author = {Züfle, Marwin and Moog, Felix and Lesch, Veronika and Krupitzer, Christian and Kounev, Samuel}, journal = {ISA Transactions: The Journal of Automation}, keywords = {t_journalmagazine}, note = {(in press)}, title = {A Machine Learning-based Workflow for Automatic Detection of Anomalies in Machine Tools}, year = 2021 }

  %0 Journal Article %1 zuefle2021anomalydetection %A Züfle, Marwin %A Moog, Felix %A Lesch, Veronika %A Krupitzer, Christian %A Kounev, Samuel %D 2021 %J ISA Transactions: The Journal of Automation %T A Machine Learning-based Workflow for Automatic Detection of Anomalies in Machine Tools %U https://www.sciencedirect.com/science/article/pii/S0019057821003773 %X Despite the increased sensor-based data collection in Industry 4.0, the practical use of this data is still in its infancy. In contrast, academic literature provides several approaches to detect machine failures but, in most cases, relies on simulations and vast amounts of training data. Since it is often not practical to collect such amounts of data in an industrial context, we propose an approach to detect the current production mode and machine degradation states on a comparably small data set. Our approach integrates domain knowledge about manufacturing systems into a highly generalizable end-to-end workflow ranging from raw data processing, phase segmentation, data resampling, and feature extraction to machine tool anomaly detection. The workflow applies unsupervised clustering techniques to identify the current production mode and supervised classification models for detecting the present degradation. A resampling strategy and classical machine learning models enable the workflow to handle small data sets and distinguish between normal and abnormal machine tool behavior. To the best of our knowledge, there exists no such end-to-end workflow in the literature that uses the entire machine signal as input to identify anomalies for individual tools. Our evaluation with data from a real multi-purpose machine shows that the proposed workflow detects anomalies with an average F1-score of almost 93%.
• 
  Machine Learning Model Update Strategies for Hard Disk Drive Failure Prediction. M. Züfle; F. Erhard; S. Kounev; in 20th IEEE International Conference on Machine Learning and Applications (ICMLA) (2021).

  (to appear)
  • [ BibTeX ]
  • [ EndNote ]
  @inproceedings{zufle2021machine, author = {Z{\"u}fle, Marwin and Erhard, Florian and Kounev, Samuel}, booktitle = {20th IEEE International Conference on Machine Learning and Applications (ICMLA)}, keywords = {online_monitoring_and_forecasting}, note = {(to appear)}, title = {Machine Learning Model Update Strategies for Hard Disk Drive Failure Prediction}, year = 2021 }

  %0 Conference Paper %1 zufle2021machine %A Züfle, Marwin %A Erhard, Florian %A Kounev, Samuel %B 20th IEEE International Conference on Machine Learning and Applications (ICMLA) %D 2021 %T Machine Learning Model Update Strategies for Hard Disk Drive Failure Prediction
• 
  ComBench: A Benchmarking Framework for Publish/Subscribe Communication Protocols Under Network Limitations. S. Herrnleben; M. Leidinger; V. Lesch; T. Prantl; J. Grohmann; C. Krupitzer; S. Kounev; in Performance Evaluation Methodologies and Tools, Q. Zhao, L. Xia (Hrsg.) (2021). 72–92.
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  • [ DOI ]
  • [ Download ]
  Efficient and dependable communication is a highly relevant aspect for Internet of Things (IoT) systems in which tiny sensors, actuators, wearables, or other smart devices exchange messages. Various publish/subscribe protocols address the challenges of communication in IoT systems. The selection process of a suitable protocol should consider the communication behavior of the application, the protocol's performance, the resource requirements on the end device, and the network connection quality, as IoT environments often rely on wireless networks. Benchmarking is a common approach to evaluate and compare systems, considering the performance and aspects like dependability or security. In this paper, we present our IoT communication benchmarking framework ComBench for publish/subscribe protocols focusing on constrained networks with varying quality conditions. The benchmarking framework supports system designers, software engineers, and application developers to select and investigate the behavior of communication protocols. Our benchmarking framework contributes to (i) show the impact of fluctuating network quality on communication, (ii) compare multiple protocols, protocol features, and protocol implementations, and (iii) analyze scalability, robustness, and dependability of clients, networks, and brokers in different scenarios. Our case study demonstrates the applicability of our framework to support the decision for the best-suited protocol in various scenarios.

  @inproceedings{10.1007/978-3-030-92511-6_5, abstract = {Efficient and dependable communication is a highly relevant aspect for Internet of Things (IoT) systems in which tiny sensors, actuators, wearables, or other smart devices exchange messages. Various publish/subscribe protocols address the challenges of communication in IoT systems. The selection process of a suitable protocol should consider the communication behavior of the application, the protocol's performance, the resource requirements on the end device, and the network connection quality, as IoT environments often rely on wireless networks. Benchmarking is a common approach to evaluate and compare systems, considering the performance and aspects like dependability or security. In this paper, we present our IoT communication benchmarking framework ComBench for publish/subscribe protocols focusing on constrained networks with varying quality conditions. The benchmarking framework supports system designers, software engineers, and application developers to select and investigate the behavior of communication protocols. Our benchmarking framework contributes to (i) show the impact of fluctuating network quality on communication, (ii) compare multiple protocols, protocol features, and protocol implementations, and (iii) analyze scalability, robustness, and dependability of clients, networks, and brokers in different scenarios. Our case study demonstrates the applicability of our framework to support the decision for the best-suited protocol in various scenarios.}, address = {Cham}, author = {Herrnleben, Stefan and Leidinger, Maximilian and Lesch, Veronika and Prantl, Thomas and Grohmann, Johannes and Krupitzer, Christian and Kounev, Samuel}, booktitle = {Performance Evaluation Methodologies and Tools}, editor = {Zhao, Qianchuan and Xia, Li}, keywords = {networking}, pages = {72–92}, publisher = {Springer International Publishing}, title = {ComBench: A Benchmarking Framework for Publish/Subscribe Communication Protocols Under Network Limitations}, year = 2021 }

  %0 Conference Paper %1 10.1007/978-3-030-92511-6_5 %A Herrnleben, Stefan %A Leidinger, Maximilian %A Lesch, Veronika %A Prantl, Thomas %A Grohmann, Johannes %A Krupitzer, Christian %A Kounev, Samuel %B Performance Evaluation Methodologies and Tools %C Cham %D 2021 %E Zhao, Qianchuan %E Xia, Li %I Springer International Publishing %P 72--92 %R https://doi.org/10.1007/978-3-030-92511-6_5 %T ComBench: A Benchmarking Framework for Publish/Subscribe Communication Protocols Under Network Limitations %U https://link.springer.com/chapter/10.1007%2F978-3-030-92511-6_5 %X Efficient and dependable communication is a highly relevant aspect for Internet of Things (IoT) systems in which tiny sensors, actuators, wearables, or other smart devices exchange messages. Various publish/subscribe protocols address the challenges of communication in IoT systems. The selection process of a suitable protocol should consider the communication behavior of the application, the protocol's performance, the resource requirements on the end device, and the network connection quality, as IoT environments often rely on wireless networks. Benchmarking is a common approach to evaluate and compare systems, considering the performance and aspects like dependability or security. In this paper, we present our IoT communication benchmarking framework ComBench for publish/subscribe protocols focusing on constrained networks with varying quality conditions. The benchmarking framework supports system designers, software engineers, and application developers to select and investigate the behavior of communication protocols. Our benchmarking framework contributes to (i) show the impact of fluctuating network quality on communication, (ii) compare multiple protocols, protocol features, and protocol implementations, and (iii) analyze scalability, robustness, and dependability of clients, networks, and brokers in different scenarios. Our case study demonstrates the applicability of our framework to support the decision for the best-suited protocol in various scenarios.
• 
  A Case Study of Vehicle Route Optimization V. Lesch; M. König; S. Kounev; A. Stein; C. Krupitzer; (2021).
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  • [ Download ]
  @techreport{lesch2021studyvrp, author = {Lesch, Veronika and König, Maximilian and Kounev, Samuel and Stein, Anthony and Krupitzer, Christian}, institution = {Universit{ä}t W{ü}rzburg and PASS Logistics Solutions AG and Universit{ä}t Hohenheim}, keywords = {t_techreport}, title = {A Case Study of Vehicle Route Optimization}, year = 2021 }

  %0 Report %1 lesch2021studyvrp %A Lesch, Veronika %A König, Maximilian %A Kounev, Samuel %A Stein, Anthony %A Krupitzer, Christian %D 2021 %T A Case Study of Vehicle Route Optimization %U https://arxiv.org/abs/2111.09087
• 
  The integration of training and off-training activities substantially alters training volume and load analysis in elite rowers. G. Treff; R. Leppich; K. Winkert; J. M. Steinacker; B. Mayer; B. Sperlich; in Scientific reports (2021). 11(1) 1–10.
  • [ BibTeX ]
  • [ EndNote ]
  @article{treff2021integration, author = {Treff, Gunnar and Leppich, Robert and Winkert, Kay and Steinacker, J{\"u}rgen M and Mayer, Benjamin and Sperlich, Billy}, journal = {Scientific reports}, keywords = {t_journalmagazine}, number = 1, pages = {1–10}, publisher = {Nature Publishing Group}, title = {The integration of training and off-training activities substantially alters training volume and load analysis in elite rowers}, volume = 11, year = 2021 }

  %0 Journal Article %1 treff2021integration %A Treff, Gunnar %A Leppich, Robert %A Winkert, Kay %A Steinacker, Jürgen M %A Mayer, Benjamin %A Sperlich, Billy %D 2021 %I Nature Publishing Group %J Scientific reports %N 1 %P 1--10 %T The integration of training and off-training activities substantially alters training volume and load analysis in elite rowers %V 11
• 
  Automatisierte Hybride Zeitreihenprognose. A. Bauer; in Ausgezeichnete Informatikdissertationen 2020, S. Hölldobler (Hrsg.) (2021). 29–38.
  • [ BibTeX ]
  • [ EndNote ]
  @inproceedings{mci/Bauer2021, address = {Bonn}, author = {Bauer, André}, booktitle = {Ausgezeichnete Informatikdissertationen 2020}, editor = {Hölldobler, Steffen}, keywords = {telescope}, pages = {29-38}, publisher = {Gesellschaft für Informatik e.V.}, title = {Automatisierte Hybride Zeitreihenprognose}, year = 2021 }

  %0 Conference Paper %1 mci/Bauer2021 %A Bauer, André %B Ausgezeichnete Informatikdissertationen 2020 %C Bonn %D 2021 %E Hölldobler, Steffen %I Gesellschaft für Informatik e.V. %P 29-38 %T Automatisierte Hybride Zeitreihenprognose
• 
  Establishing a cardiac training group for patients with heart failure: the “HIP-in-Würzburg” study. G. Güder; J. Wilkesmann; N. Scholz; R. Leppich; P. Düking; B. Sperlich; C. Rost; S. Frantz; C. Morbach; F. Sahiti; others; in Clinical Research in Cardiology (2021). 1–10.
  • [ BibTeX ]
  • [ EndNote ]
  @article{guder2021establishing, author = {G{\"u}der, G{\"u}lmisal and Wilkesmann, Joana and Scholz, Nina and Leppich, Robert and D{\"u}king, Peter and Sperlich, Billy and Rost, Christian and Frantz, Stefan and Morbach, Caroline and Sahiti, Floran and others}, journal = {Clinical Research in Cardiology}, keywords = {t_journalmagazine}, pages = {1–10}, publisher = {Springer}, title = {Establishing a cardiac training group for patients with heart failure: the “HIP-in-W{\"u}rzburg” study}, year = 2021 }

  %0 Journal Article %1 guder2021establishing %A Güder, Gülmisal %A Wilkesmann, Joana %A Scholz, Nina %A Leppich, Robert %A Düking, Peter %A Sperlich, Billy %A Rost, Christian %A Frantz, Stefan %A Morbach, Caroline %A Sahiti, Floran %A others, %D 2021 %I Springer %J Clinical Research in Cardiology %P 1--10 %T Establishing a cardiac training group for patients with heart failure: the “HIP-in-Würzburg” study
• 
  Benchmarking of Pre- and Post-Quantum Group Encryption Schemes with Focus on IoT. T. Prantl; D. Prantl; A. Bauer; L. Iffländer; A. Dmitrenko; C. Krupitzer; S. Kounev; in 2021 IEEE 40th International Performance Computing and Communications Conference (IPCCC) (2021).
  • [ BibTeX ]
  • [ EndNote ]
  @inproceedings{PrPrBaIfDmKrKo2021-IPCCC-QuantumGroupEncryption, author = {Prantl, Thomas and Prantl, Dominik and Bauer, André and Iffländer, Lukas and Dmitrenko, Alexandra and Krupitzer, Christian and Kounev, Samuel}, booktitle = {2021 IEEE 40th International Performance Computing and Communications Conference (IPCCC)}, keywords = {sss-group}, title = {Benchmarking of Pre- and Post-Quantum Group Encryption Schemes with Focus on IoT}, year = 2021 }

  %0 Conference Paper %1 PrPrBaIfDmKrKo2021-IPCCC-QuantumGroupEncryption %A Prantl, Thomas %A Prantl, Dominik %A Bauer, André %A Iffländer, Lukas %A Dmitrenko, Alexandra %A Krupitzer, Christian %A Kounev, Samuel %B 2021 IEEE 40th International Performance Computing and Communications Conference (IPCCC) %D 2021 %T Benchmarking of Pre- and Post-Quantum Group Encryption Schemes with Focus on IoT
• 
  A Case Study on Optimization of Warehouses. V. Lesch; P. Müller; M. Krämer; S. Kounev; C. Krupitzer; in arXiv preprint arXiv:2112.12058 (2021).
  • [ BibTeX ]
  • [ EndNote ]
  @article{lesch2021case, author = {Lesch, Veronika and M{\"u}ller, Patrick and Kr{\"a}mer, Moritz and Kounev, Samuel and Krupitzer, Christian}, journal = {arXiv preprint arXiv:2112.12058}, keywords = {t_journalmagazine}, title = {A Case Study on Optimization of Warehouses}, year = 2021 }

  %0 Journal Article %1 lesch2021case %A Lesch, Veronika %A Müller, Patrick %A Krämer, Moritz %A Kounev, Samuel %A Krupitzer, Christian %D 2021 %J arXiv preprint arXiv:2112.12058 %T A Case Study on Optimization of Warehouses
• 
  Software Testing Strategies for Detecting Hypercall Handlerstextquotesingle Aging-related Bugs. L. Beierlieb; A. Avritzer; L. Ifflander; N. Antunes; A. Milenkoski; S. Kounev; in 2021 IEEE International Symposium on Software Reliability Engineering Workshops (ISSREW) (2021).
  • [ BibTeX ]
  • [ EndNote ]
  @inproceedings{Beierlieb_2021_SoftwareTestingStrategiesforDetectingHypercallHandlersAgingRelatedBugs, author = {Beierlieb, Lukas and Avritzer, Alberto and Ifflander, Lukas and Antunes, Nuno and Milenkoski, Aleksandar and Kounev, Samuel}, booktitle = {2021 {IEEE} International Symposium on Software Reliability Engineering Workshops ({ISSREW})}, keywords = {security}, publisher = {{IEEE}}, title = {Software Testing Strategies for Detecting Hypercall Handlers{\textquotesingle} Aging-related Bugs}, year = 2021 }

  %0 Conference Paper %1 Beierlieb_2021_SoftwareTestingStrategiesforDetectingHypercallHandlersAgingRelatedBugs %A Beierlieb, Lukas %A Avritzer, Alberto %A Ifflander, Lukas %A Antunes, Nuno %A Milenkoski, Aleksandar %A Kounev, Samuel %B 2021 IEEE International Symposium on Software Reliability Engineering Workshops (ISSREW) %D 2021 %I IEEE %T Software Testing Strategies for Detecting Hypercall Handlerstextquotesingle Aging-related Bugs
• 
  Automated Hybrid Time Series Forecasting: Design, Benchmarking, and Use Cases. A. Bauer; Thesis; Universität Würzburg. (2021).
  • [ BibTeX ]
  • [ EndNote ]
  @phdthesis{Bauer2021-phdthesis, author = {Bauer, Andr{\'e}}, keywords = {descartes}, school = {Universit{\"a}t W{\"u}rzburg}, title = {Automated Hybrid Time Series Forecasting: Design, Benchmarking, and Use Cases}, type = {doctoralthesis}, year = 2021 }

  %0 Thesis %1 Bauer2021-phdthesis %A Bauer, André %D 2021 %T Automated Hybrid Time Series Forecasting: Design, Benchmarking, and Use Cases
• 
  Serverless Computing (Dagstuhl Seminar 21201). C. Abad; I. T. Foster; N. Herbst; A. Iosup; in Dagstuhl Reports, (C. Abad; I. T. Foster; N. Herbst; A. Iosup, Hrsg.) (2021). 11(4) 34–93.
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  @article{abad_et_al:DagRep.11.4.34, address = {Dagstuhl, Germany}, annote = {Keywords: Cloud computing, Cloud continuum, data-driven, design patterns, DevOps, experimentation, model-driven, serverless computing, simulation, software architecture, systems management, vision}, author = {Abad, Cristina and Foster, Ian T. and Herbst, Nikolas and Iosup, Alexandru}, editor = {Abad, Cristina and Foster, Ian T. and Herbst, Nikolas and Iosup, Alexandru}, journal = {Dagstuhl Reports}, keywords = {resource_management}, number = 4, pages = {34–93}, publisher = {Schloss Dagstuhl – Leibniz-Zentrum f{\"u}r Informatik}, title = {{Serverless Computing (Dagstuhl Seminar 21201)}}, volume = 11, year = 2021 }

  %0 Journal Article %1 abad_et_al:DagRep.11.4.34 %A Abad, Cristina %A Foster, Ian T. %A Herbst, Nikolas %A Iosup, Alexandru %C Dagstuhl, Germany %D 2021 %E Abad, Cristina %E Foster, Ian T. %E Herbst, Nikolas %E Iosup, Alexandru %I Schloss Dagstuhl -- Leibniz-Zentrum für Informatik %J Dagstuhl Reports %N 4 %P 34--93 %T Serverless Computing (Dagstuhl Seminar 21201) %U https://drops.dagstuhl.de/opus/volltexte/2021/14798 %V 11 %Z Keywords: Cloud computing, Cloud continuum, data-driven, design patterns, DevOps, experimentation, model-driven, serverless computing, simulation, software architecture, systems management, vision
• 
  Auswirkungen der COVID-19-Pandemie auf Sportlerinnen und Sportler in Deutschland. C. Zinner; M. Matzka; R. Leppich; S. Kounev; H.-C. Holmberg; B. Sperlich; in 53. asp Jahrestagung (2021).
  • [ BibTeX ]
  • [ EndNote ]
  @article{zinner2021auswirkungen, author = {Zinner, Christoph and Matzka, Manuel and Leppich, Robert and Kounev, Samuel and Holmberg, Hans-Christian and Sperlich, Billy}, journal = {53. asp Jahrestagung}, keywords = {t_interdisciplinary}, title = {Auswirkungen der COVID-19-Pandemie auf Sportlerinnen und Sportler in Deutschland}, year = 2021 }

  %0 Journal Article %1 zinner2021auswirkungen %A Zinner, Christoph %A Matzka, Manuel %A Leppich, Robert %A Kounev, Samuel %A Holmberg, Hans-Christian %A Sperlich, Billy %D 2021 %J 53. asp Jahrestagung %T Auswirkungen der COVID-19-Pandemie auf Sportlerinnen und Sportler in Deutschland
• 
  A Case Study on Optimization of Warehouses V. Lesch; P. B. Müller; M. Krämer; S. Kounev; C. Krupitzer; (2021).
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  • [ Download ]
  @techreport{lesch2021study, author = {Lesch, Veronika and Müller, Patrick B.M. and Krämer, Moritz and Kounev, Samuel and Krupitzer, Christian}, keywords = {t_techreport}, title = {A Case Study on Optimization of Warehouses}, year = 2021 }

  %0 Report %1 lesch2021study %A Lesch, Veronika %A Müller, Patrick B.M. %A Krämer, Moritz %A Kounev, Samuel %A Krupitzer, Christian %D 2021 %T A Case Study on Optimization of Warehouses %U http://arxiv.org/abs/2112.12058
• 
  Sizeless: Predicting the Optimal Size of Serverless Functions. S. Eismann; L. Bui; J. Grohmann; C. Abad; N. Herbst; S. Kounev; in Proceedings of the 22nd International MIDDLEWARE Conference (2021). 248–259.

  Best Student Paper Award, ACM Artifacts Evaluated — Functional
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  • [ DOI ]
  • [ Download ]
  Serverless functions are an emerging cloud computing paradigm that is being rapidly adopted by both industry and academia. In this cloud computing model, the provider opaquely handles resource management tasks such as resource provisioning, deployment, and auto-scaling. The only resource management task that developers are still in charge of is selecting how much resources are allocated to each worker instance. However, selecting the optimal size of serverless functions is quite challenging, so developers often neglect it despite its significant cost and performance benefits. Existing approaches aiming to automate serverless functions resource sizing require dedicated performance tests, which are time-consuming to implement and maintain. In this paper, we introduce an approach to predict the optimal resource size of a serverless function using monitoring data from a single resource size. As our approach does not require dedicated performance tests, it enables cloud providers to implement resource sizing on a platform level and automate the last resource management task associated with serverless functions. We evaluate our approach on four different serverless applications on AWS, where it predicts the execution time of the other memory sizes based on monitoring data for a single memory size with an average prediction error of 15.3%. Based on these predictions, it selects the optimal memory size for 79.0% of the serverless functions and the secondbest memory size for 12.3% of the serverless functions, which results in an average speedup of 39.7% while also decreasing average costs by 2.6%.

  @inproceedings{eismann2021sizeless, abstract = {Serverless functions are an emerging cloud computing paradigm that is being rapidly adopted by both industry and academia. In this cloud computing model, the provider opaquely handles resource management tasks such as resource provisioning, deployment, and auto-scaling. The only resource management task that developers are still in charge of is selecting how much resources are allocated to each worker instance. However, selecting the optimal size of serverless functions is quite challenging, so developers often neglect it despite its significant cost and performance benefits. Existing approaches aiming to automate serverless functions resource sizing require dedicated performance tests, which are time-consuming to implement and maintain. In this paper, we introduce an approach to predict the optimal resource size of a serverless function using monitoring data from a single resource size. As our approach does not require dedicated performance tests, it enables cloud providers to implement resource sizing on a platform level and automate the last resource management task associated with serverless functions. We evaluate our approach on four different serverless applications on AWS, where it predicts the execution time of the other memory sizes based on monitoring data for a single memory size with an average prediction error of 15.3%. Based on these predictions, it selects the optimal memory size for 79.0% of the serverless functions and the secondbest memory size for 12.3% of the serverless functions, which results in an average speedup of 39.7% while also decreasing average costs by 2.6%.}, author = {Eismann, Simon and Bui, Long and Grohmann, Johannes and Abad, Cristina and Herbst, Nikolas and Kounev, Samuel}, booktitle = {Proceedings of the 22nd International MIDDLEWARE Conference}, keywords = {descartes}, note = {Best Student Paper Award, ACM Artifacts Evaluated — Functional}, pages = {248–259}, title = {Sizeless: Predicting the Optimal Size of Serverless Functions}, year = 2021 }

  %0 Conference Paper %1 eismann2021sizeless %A Eismann, Simon %A Bui, Long %A Grohmann, Johannes %A Abad, Cristina %A Herbst, Nikolas %A Kounev, Samuel %B Proceedings of the 22nd International MIDDLEWARE Conference %D 2021 %P 248–259 %R 10.1145/3464298.3493398 %T Sizeless: Predicting the Optimal Size of Serverless Functions %U https://dl.acm.org/doi/abs/10.1145/3464298.3493398 %X Serverless functions are an emerging cloud computing paradigm that is being rapidly adopted by both industry and academia. In this cloud computing model, the provider opaquely handles resource management tasks such as resource provisioning, deployment, and auto-scaling. The only resource management task that developers are still in charge of is selecting how much resources are allocated to each worker instance. However, selecting the optimal size of serverless functions is quite challenging, so developers often neglect it despite its significant cost and performance benefits. Existing approaches aiming to automate serverless functions resource sizing require dedicated performance tests, which are time-consuming to implement and maintain. In this paper, we introduce an approach to predict the optimal resource size of a serverless function using monitoring data from a single resource size. As our approach does not require dedicated performance tests, it enables cloud providers to implement resource sizing on a platform level and automate the last resource management task associated with serverless functions. We evaluate our approach on four different serverless applications on AWS, where it predicts the execution time of the other memory sizes based on monitoring data for a single memory size with an average prediction error of 15.3%. Based on these predictions, it selects the optimal memory size for 79.0% of the serverless functions and the secondbest memory size for 12.3% of the serverless functions, which results in an average speedup of 39.7% while also decreasing average costs by 2.6%.
• 
  Serverless Applications:Why, When, and How?. S. Eismann; S. Joel; E. van Eyk; M. Schwinger; J. Grohmann; N. Herbst; C. Abad; A. Iosup; in IEEE Software (2021). 38(1) 32–39.
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  • [ DOI ]
  • [ Download ]
  Serverless computing shows good promise for efficiency and ease-of-use. Yet, there are only a few, scattered and sometimes conflicting reports on questions such as Why do so many companies adopt serverless?, When are serverless applications well suited?, and How are serverless applications currently implemented? To address these questions, we analyze 89 serverless applications from open-source projects, industrial sources, academic literature, and scientific computing—the most extensive study to date.

  @article{eismann2020serverless, abstract = {Serverless computing shows good promise for efficiency and ease-of-use. Yet, there are only a few, scattered and sometimes conflicting reports on questions such as Why do so many companies adopt serverless?, When are serverless applications well suited?, and How are serverless applications currently implemented? To address these questions, we analyze 89 serverless applications from open-source projects, industrial sources, academic literature, and scientific computing—the most extensive study to date.}, author = {Eismann, Simon and Joel, Scheuner and van Eyk, Erwin and Schwinger, Maximilian and Grohmann, Johannes and Herbst, Nikolas and Abad, Cristina and Iosup, Alexandru}, journal = {IEEE Software}, keywords = {t_journalmagazine}, number = 1, pages = {32–39}, title = {Serverless Applications:Why, When, and How?}, volume = 38, year = 2021 }

  %0 Journal Article %1 eismann2020serverless %A Eismann, Simon %A Joel, Scheuner %A van Eyk, Erwin %A Schwinger, Maximilian %A Grohmann, Johannes %A Herbst, Nikolas %A Abad, Cristina %A Iosup, Alexandru %D 2021 %J IEEE Software %N 1 %P 32--39 %R 10.1109/MS.2020.3023302 %T Serverless Applications:Why, When, and How? %U https://doi.org/10.1109/MS.2020.3023302 %V 38 %X Serverless computing shows good promise for efficiency and ease-of-use. Yet, there are only a few, scattered and sometimes conflicting reports on questions such as Why do so many companies adopt serverless?, When are serverless applications well suited?, and How are serverless applications currently implemented? To address these questions, we analyze 89 serverless applications from open-source projects, industrial sources, academic literature, and scientific computing—the most extensive study to date.
• 
  Performance Evaluation of a Post-Quantum Public-Key Cryptosystem. T. Prantl; D. Prantl; L. Beierlieb; L. Iffländer; A. Dmitrienko; C. Krupitzer; S. Kounev; in 2021 IEEE 40th International Performance Computing and Communications Conference (IPCCC) (2021).
  • [ BibTeX ]
  • [ EndNote ]
  @inproceedings{PrPrBeIfDnKrKo2021-IPCCC-QuantumPublicKeyCryposystem, author = {Prantl, Thomas and Prantl, Dominik and Beierlieb, Lukas and Iffländer, Lukas and Dmitrienko, Alexandra and Krupitzer, Christian and Kounev, Samuel}, booktitle = {2021 IEEE 40th International Performance Computing and Communications Conference (IPCCC)}, keywords = {t_workshop}, organization = {IEEE}, title = {Performance Evaluation of a Post-Quantum Public-Key Cryptosystem}, year = 2021 }

  %0 Conference Paper %1 PrPrBeIfDnKrKo2021-IPCCC-QuantumPublicKeyCryposystem %A Prantl, Thomas %A Prantl, Dominik %A Beierlieb, Lukas %A Iffländer, Lukas %A Dmitrienko, Alexandra %A Krupitzer, Christian %A Kounev, Samuel %B 2021 IEEE 40th International Performance Computing and Communications Conference (IPCCC) %D 2021 %T Performance Evaluation of a Post-Quantum Public-Key Cryptosystem
• 
  Towards Scientific and Interoperable Earth Observation Exploitation Platforms. J. Eberle; M. Schwinger; H. Zwenzner; in Proceedings of the 2021 conference on Big Data from Space, P. Soille, S. Loekken, M. Albani (Hrsg.) (2021). 89–92.
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  Earth Observation (EO) exploitation platforms allow users to bring their algorithms and processing components to infrastructures where big EO data collections and compute resources are available. Working on different platforms, interoperability of these needs to be ensured - not only relevant for service specifications, but also for the contents of data inventories and metadata. The interactive development of algorithms and the possibility to share code and data with other users are further feedbacks from scientific users. Additionally, data processing needs to be reproducible and transferable to multiple EO exploitation platforms. In this paper, existing technologies and specifications for data discovery, access, and processing have been analyzed with focus on their usage in two connected cloud infrastructures and related to initial user feedbacks collected from scientists.

  @inproceedings{dlr145824, abstract = {Earth Observation (EO) exploitation platforms allow users to bring their algorithms and processing components to infrastructures where big EO data collections and compute resources are available. Working on different platforms, interoperability of these needs to be ensured - not only relevant for service specifications, but also for the contents of data inventories and metadata. The interactive development of algorithms and the possibility to share code and data with other users are further feedbacks from scientific users. Additionally, data processing needs to be reproducible and transferable to multiple EO exploitation platforms. In this paper, existing technologies and specifications for data discovery, access, and processing have been analyzed with focus on their usage in two connected cloud infrastructures and related to initial user feedbacks collected from scientists.}, author = {Eberle, Jonas and Schwinger, Maximilian and Zwenzner, Hendrik}, booktitle = {Proceedings of the 2021 conference on Big Data from Space}, editor = {Soille, Pierre and Loekken, Sveinung and Albani, Mirko}, keywords = {t_interdisciplinary}, month = {05}, pages = {89–92}, publisher = {Publications Office of the European Union}, title = {Towards Scientific and Interoperable Earth Observation Exploitation Platforms}, year = 2021 }

  %0 Conference Paper %1 dlr145824 %A Eberle, Jonas %A Schwinger, Maximilian %A Zwenzner, Hendrik %B Proceedings of the 2021 conference on Big Data from Space %D 2021 %E Soille, Pierre %E Loekken, Sveinung %E Albani, Mirko %I Publications Office of the European Union %P 89--92 %T Towards Scientific and Interoperable Earth Observation Exploitation Platforms %U https://elib.dlr.de/145824/ %X Earth Observation (EO) exploitation platforms allow users to bring their algorithms and processing components to infrastructures where big EO data collections and compute resources are available. Working on different platforms, interoperability of these needs to be ensured - not only relevant for service specifications, but also for the contents of data inventories and metadata. The interactive development of algorithms and the possibility to share code and data with other users are further feedbacks from scientific users. Additionally, data processing needs to be reproducible and transferable to multiple EO exploitation platforms. In this paper, existing technologies and specifications for data discovery, access, and processing have been analyzed with focus on their usage in two connected cloud infrastructures and related to initial user feedbacks collected from scientists.
• 
  People Detection with Depth Silhouettes and Convolutional Neural Networks on a Mobile Robot. F. Spiess; L. Reinhart; N. Strobel; D. Kaiser; S. Kounev; T. Kaupp; in Journal of Image and Graphics, (J. of Image; Graphics, Hrsg.) (2021). 9(4) 135–139.
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  @article{spiess2021people, author = {Spiess, Florian and Reinhart, Lucas and Strobel, Norbert and Kaiser, Dennis and Kounev, Samuel and Kaupp, Tobias}, editor = {of Image, Journal and Graphics}, journal = {Journal of Image and Graphics}, keywords = {t_journalmagazine}, month = 12, number = 4, pages = {135-139}, title = {People Detection with Depth Silhouettes and Convolutional Neural Networks on a Mobile Robot}, volume = 9, year = 2021 }

  %0 Journal Article %1 spiess2021people %A Spiess, Florian %A Reinhart, Lucas %A Strobel, Norbert %A Kaiser, Dennis %A Kounev, Samuel %A Kaupp, Tobias %D 2021 %E of Image, Journal %E Graphics, %J Journal of Image and Graphics %N 4 %P 135-139 %T People Detection with Depth Silhouettes and Convolutional Neural Networks on a Mobile Robot %U http://www.joig.net/index.php?m=content&c=index&a=show&catid=72&id=277 %V 9
• 
  Buzzy: Towards Realistic DBMS Benchmarking via Tailored, Representative, Synthetic Workloads. J. Domaschka; S. Eismann; M. Leznik; J. Grohmann; S. Kounev; D. Seybold; in Companion of the ACM/SPEC International Conference on Performance Engineering (2021). (Bd. ICPE ’21) 175–178.
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  • [ DOI ]
  • [ Download ]
  Distributed Database Management Systems (DBMS) are a crucial component of modern IT applications. Understanding their performance and non-functional properties is of paramount importance. Yet, benchmarking distributed DBMS has proven to be difficult in practice. Either, a realistic workload is often mapped to a synthetic workload without knowing if this mapping is correct or available workload traces are replayed. While the latter approach provides more realistic results, real-world traces are hard to obtain and their scope is limited in time scale and variance.We propose collecting real-world traces and then applying data generation techniques to synthesize similar realistic traces based on it. Based in this approach, we can obtain workloads for benchmarking, exhibit variability with respect to different aspects of interest while still being similar to the original traces. Varying generation parameters, we are able to support benchmarking what-if scenarios with hypothetical workloads and introduced anomalies.

  @inproceedings{domaschka2021buzzy, abstract = {Distributed Database Management Systems (DBMS) are a crucial component of modern IT applications. Understanding their performance and non-functional properties is of paramount importance. Yet, benchmarking distributed DBMS has proven to be difficult in practice. Either, a realistic workload is often mapped to a synthetic workload without knowing if this mapping is correct or available workload traces are replayed. While the latter approach provides more realistic results, real-world traces are hard to obtain and their scope is limited in time scale and variance.We propose collecting real-world traces and then applying data generation techniques to synthesize similar realistic traces based on it. Based in this approach, we can obtain workloads for benchmarking, exhibit variability with respect to different aspects of interest while still being similar to the original traces. Varying generation parameters, we are able to support benchmarking what-if scenarios with hypothetical workloads and introduced anomalies.}, address = {New York, NY, USA}, author = {Domaschka, Jörg and Eismann, Simon and Leznik, Mark and Grohmann, Johannes and Kounev, Samuel and Seybold, Daniel}, booktitle = {Companion of the ACM/SPEC International Conference on Performance Engineering}, keywords = {descartes}, pages = {175–178}, publisher = {Association for Computing Machinery}, title = {Buzzy: Towards Realistic DBMS Benchmarking via Tailored, Representative, Synthetic Workloads}, volume = {ICPE '21}, year = 2021 }

  %0 Conference Paper %1 domaschka2021buzzy %A Domaschka, Jörg %A Eismann, Simon %A Leznik, Mark %A Grohmann, Johannes %A Kounev, Samuel %A Seybold, Daniel %B Companion of the ACM/SPEC International Conference on Performance Engineering %C New York, NY, USA %D 2021 %I Association for Computing Machinery %P 175–178 %R 10.1145/3447545.3451175 %T Buzzy: Towards Realistic DBMS Benchmarking via Tailored, Representative, Synthetic Workloads %U https://doi.org/10.1145/3447545.3451175 %V ICPE '21 %X Distributed Database Management Systems (DBMS) are a crucial component of modern IT applications. Understanding their performance and non-functional properties is of paramount importance. Yet, benchmarking distributed DBMS has proven to be difficult in practice. Either, a realistic workload is often mapped to a synthetic workload without knowing if this mapping is correct or available workload traces are replayed. While the latter approach provides more realistic results, real-world traces are hard to obtain and their scope is limited in time scale and variance.We propose collecting real-world traces and then applying data generation techniques to synthesize similar realistic traces based on it. Based in this approach, we can obtain workloads for benchmarking, exhibit variability with respect to different aspects of interest while still being similar to the original traces. Varying generation parameters, we are able to support benchmarking what-if scenarios with hypothetical workloads and introduced anomalies. %@ 9781450383318
• 
  Energy-Efficiency Comparison of Common Sorting Algorithms. N. Schmitt; S. Kamthania; N. Rawtani; L. Mendoza; K.-D. Lange; S. Kounev; in 2021 29th International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS) (2021). 1–8.
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  With the rising demand for information technology comes an increase in energy consumption to power it. Namely, cloud computing is constantly growing, in part due to a rising number of devices using the cloud to provide certain functionality. This growth leads to an increase in energy consumption in data centers and is estimated to climb to over 1PWh in 2030. Hardware manufacturers counter the rising demand for energy in cloud data centers by providing techniques to make servers more energy-efficient. However, the advances cannot fully compensate for the growth. To further increase energy efficiency, software needs to be addressed as well but is often neglected by the developers.In this paper, we compare six sorting algorithms, a common task in most programs, against each other in terms of energy efficiency to allow developers to select the best solution to their problem. We selected well-known algorithms in two variants, and two implementation languages, C and Python. We ran each algorithm on two, out of four, state-of-the-art server systems with different CPUs.

  @inproceedings{9614299, abstract = {With the rising demand for information technology comes an increase in energy consumption to power it. Namely, cloud computing is constantly growing, in part due to a rising number of devices using the cloud to provide certain functionality. This growth leads to an increase in energy consumption in data centers and is estimated to climb to over 1PWh in 2030. Hardware manufacturers counter the rising demand for energy in cloud data centers by providing techniques to make servers more energy-efficient. However, the advances cannot fully compensate for the growth. To further increase energy efficiency, software needs to be addressed as well but is often neglected by the developers.In this paper, we compare six sorting algorithms, a common task in most programs, against each other in terms of energy efficiency to allow developers to select the best solution to their problem. We selected well-known algorithms in two variants, and two implementation languages, C and Python. We ran each algorithm on two, out of four, state-of-the-art server systems with different CPUs.}, author = {Schmitt, Norbert and Kamthania, Supriya and Rawtani, Nishant and Mendoza, Luis and Lange, Klaus-Dieter and Kounev, Samuel}, booktitle = {2021 29th International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS)}, keywords = {power}, month = 11, pages = {1-8}, title = {Energy-Efficiency Comparison of Common Sorting Algorithms}, year = 2021 }

  %0 Conference Paper %1 9614299 %A Schmitt, Norbert %A Kamthania, Supriya %A Rawtani, Nishant %A Mendoza, Luis %A Lange, Klaus-Dieter %A Kounev, Samuel %B 2021 29th International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS) %D 2021 %P 1-8 %T Energy-Efficiency Comparison of Common Sorting Algorithms %U https://ieeexplore.ieee.org/document/9614299/ %X With the rising demand for information technology comes an increase in energy consumption to power it. Namely, cloud computing is constantly growing, in part due to a rising number of devices using the cloud to provide certain functionality. This growth leads to an increase in energy consumption in data centers and is estimated to climb to over 1PWh in 2030. Hardware manufacturers counter the rising demand for energy in cloud data centers by providing techniques to make servers more energy-efficient. However, the advances cannot fully compensate for the growth. To further increase energy efficiency, software needs to be addressed as well but is often neglected by the developers.In this paper, we compare six sorting algorithms, a common task in most programs, against each other in terms of energy efficiency to allow developers to select the best solution to their problem. We selected well-known algorithms in two variants, and two implementation languages, C and Python. We ran each algorithm on two, out of four, state-of-the-art server systems with different CPUs.
• 
  Towards Splitting Monolithic Workflows into Serverless Functions and Estimating Their Run-Time in the Earth Observation Domain. D. Kaiser; B. Dovhan; A. Bauer; S. Kounev; in Proceedings of the 12th Symposium on Software Performance (SSP) (2021).

  Extended Abstract
  • [ BibTeX ]
  • [ EndNote ]
  @inproceedings{kaiser2021split, author = {Kaiser, Dennis and Dovhan, Bohdan and Bauer, Andr{\'e} and Kounev, Samuel}, booktitle = {Proceedings of the 12th Symposium on Software Performance (SSP)}, keywords = {severless}, month = 11, note = {Extended Abstract}, title = {{Towards Splitting Monolithic Workflows into Serverless Functions and Estimating Their Run-Time in the Earth Observation Domain}}, year = 2021 }

  %0 Conference Paper %1 kaiser2021split %A Kaiser, Dennis %A Dovhan, Bohdan %A Bauer, André %A Kounev, Samuel %B Proceedings of the 12th Symposium on Software Performance (SSP) %D 2021 %T Towards Splitting Monolithic Workflows into Serverless Functions and Estimating Their Run-Time in the Earth Observation Domain
• 
  Measuring the Performance Impact of Branching Instructions. L. Beierlieb; L. Iffländer; A. Milenkoski; T. Prantl; S. Kounev; in Proceedings of the 12th Symposium on Software Performance 2021 (SSP’21) (2021).
  • [ BibTeX ]
  • [ EndNote ]
  @inproceedings{Beierlieb_2021_MeasuringthePerformanceImpactofBranchingInstructions., author = {Beierlieb, Lukas and Iffländer, Lukas and Milenkoski, Aleksandar and Prantl, Thomas and Kounev, Samuel}, booktitle = {Proceedings of the 12th Symposium on Software Performance 2021 (SSP'21)}, keywords = {sys:relevantfor:se-group}, month = 11, title = {Measuring the Performance Impact of Branching Instructions}, year = 2021 }

  %0 Conference Paper %1 Beierlieb_2021_MeasuringthePerformanceImpactofBranchingInstructions. %A Beierlieb, Lukas %A Iffländer, Lukas %A Milenkoski, Aleksandar %A Prantl, Thomas %A Kounev, Samuel %B Proceedings of the 12th Symposium on Software Performance 2021 (SSP'21) %D 2021 %T Measuring the Performance Impact of Branching Instructions
• 
  A Simulation-based Optimization Framework for Online Adaptation of Networks. S. Herrnleben; J. Grohmann; P. Rygielski; V. Lesch; C. Krupitzer; S. Kounev; in Proceedings of the 12th EAI International Conference on Simulation Tools and Techniques (SIMUtools), H. Song, D. Jiang (Hrsg.) (2021). 513–532.
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  • [ DOI ]
  • [ Download ]
  Today's data centers face a rapid change of deployed services, growing complexity, and increasing performance requirements. Customers expect not only round-the-clock availability of the hosted services but also high responsiveness. Besides optimizing software architectures and deployments, networks have to be adapted to handle the changing and volatile demands. Approaches from self-adaptive systems can be used for optimizing data center networks to continuously meet Service Level Agreements (SLAs) between data center operators and customers. However, existing approaches focus only on specific objectives like topology design, power optimization, or traffic engineering. In this paper, we present an extensible framework that analyzes networks using different types of simulation and adapts them subject to multiple objectives using various adaptation techniques. Analyzing each suggested adaptation ensures that performance requirements and SLAs are continuously met. We evaluate our framework w.r.t. (i) general requirements and assessments of languages and frameworks for adaptation models, (ii) finding Pareto-optimal solutions considering a multi-dimensional cost model, and (iii) scalability. The evaluation shows that our approach detects the bottlenecks and the violated SLAs correctly, outputs valid and cost-optimal adaptations, and keeps the runtime for the adaptation process constant even with increasing network size and an increasing number of alternative configurations.

  @inproceedings{HeGrRyLeKrKo2020-SIMUtools-Network-Online-Adaptation, abstract = {Today's data centers face a rapid change of deployed services, growing complexity, and increasing performance requirements. Customers expect not only round-the-clock availability of the hosted services but also high responsiveness. Besides optimizing software architectures and deployments, networks have to be adapted to handle the changing and volatile demands. Approaches from self-adaptive systems can be used for optimizing data center networks to continuously meet Service Level Agreements (SLAs) between data center operators and customers. However, existing approaches focus only on specific objectives like topology design, power optimization, or traffic engineering. In this paper, we present an extensible framework that analyzes networks using different types of simulation and adapts them subject to multiple objectives using various adaptation techniques. Analyzing each suggested adaptation ensures that performance requirements and SLAs are continuously met. We evaluate our framework w.r.t. (i) general requirements and assessments of languages and frameworks for adaptation models, (ii) finding Pareto-optimal solutions considering a multi-dimensional cost model, and (iii) scalability. The evaluation shows that our approach detects the bottlenecks and the violated SLAs correctly, outputs valid and cost-optimal adaptations, and keeps the runtime for the adaptation process constant even with increasing network size and an increasing number of alternative configurations.}, address = {Cham}, author = {Herrnleben, Stefan and Grohmann, Johannes and Rygielski, Pitor and Lesch, Veronika and Krupitzer, Christian and Kounev, Samuel}, booktitle = {Proceedings of the 12th EAI International Conference on Simulation Tools and Techniques (SIMUtools)}, editor = {Song, Houbing and Jiang, Dingde}, keywords = {networking}, month = {08}, pages = {513–532}, publisher = {Springer International Publishing}, series = {SIMUtools 2020}, title = {A Simulation-based Optimization Framework for Online Adaptation of Networks}, year = 2021 }

  %0 Conference Paper %1 HeGrRyLeKrKo2020-SIMUtools-Network-Online-Adaptation %A Herrnleben, Stefan %A Grohmann, Johannes %A Rygielski, Pitor %A Lesch, Veronika %A Krupitzer, Christian %A Kounev, Samuel %B Proceedings of the 12th EAI International Conference on Simulation Tools and Techniques (SIMUtools) %C Cham %D 2021 %E Song, Houbing %E Jiang, Dingde %I Springer International Publishing %P 513--532 %R 10.1007/978-3-030-72792-5_41 %T A Simulation-based Optimization Framework for Online Adaptation of Networks %U https://doi.org/10.1007/978-3-030-72792-5_41 %X Today's data centers face a rapid change of deployed services, growing complexity, and increasing performance requirements. Customers expect not only round-the-clock availability of the hosted services but also high responsiveness. Besides optimizing software architectures and deployments, networks have to be adapted to handle the changing and volatile demands. Approaches from self-adaptive systems can be used for optimizing data center networks to continuously meet Service Level Agreements (SLAs) between data center operators and customers. However, existing approaches focus only on specific objectives like topology design, power optimization, or traffic engineering. In this paper, we present an extensible framework that analyzes networks using different types of simulation and adapts them subject to multiple objectives using various adaptation techniques. Analyzing each suggested adaptation ensures that performance requirements and SLAs are continuously met. We evaluate our framework w.r.t. (i) general requirements and assessments of languages and frameworks for adaptation models, (ii) finding Pareto-optimal solutions considering a multi-dimensional cost model, and (iii) scalability. The evaluation shows that our approach detects the bottlenecks and the violated SLAs correctly, outputs valid and cost-optimal adaptations, and keeps the runtime for the adaptation process constant even with increasing network size and an increasing number of alternative configurations. %@ 978-3-030-72792-5
• 
  A Predictive Maintenance Methodology: Predicting the Time-to-Failure of Machines in Industry 4.0. M. Züfle; J. Agne; J. Grohmann; I. Dörtoluk; S. Kounev; in Proceedings of the 21st IEEE IES International Conference on Industrial Informatics (2021).
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  • [ DOI ]
  • [ Download ]
  Predictive maintenance is an essential aspect of the concept of Industry 4.0. In contrast to previous maintenance strategies, which plan repairs based on periodic schedules or threshold values, predictive maintenance is normally based on estimating the time-to-failure of machines. Thus, predictive maintenance enables a more efficient and effective maintenance approach. Although much research has already been done on time-to-failure prediction, most existing works provide only specialized approaches for specific machines. In most cases, these are either rotary machines (i.e., bearings) or lithium-ion batteries. To bridge the gap to a more general time-to-failure prediction, we propose a generic end-to-end predictive maintenance methodology for the time-to-failure prediction of industrial machines. Our methodology exhibits a number of novel aspects including a universally applicable method for feature extraction based on different types of sensor data, well-known feature transformation and selection techniques, adjustable target class assignment based on fault records with three different labeling strategies, and the training of multiple state-of-the-art machine learning classification models including hyperparameter optimization. We evaluated our time-to-failure prediction methodology in a real-world case study consisting of monitoring data gathered over several years from a large industrial press. The results demonstrated the effectiveness of the proposed methodology for six different time-to-failure pre-diction windows, as well as for the downscaled binary prediction of impending failures. In this case study, the multi-class feed-forward neural network model achieved the overall best results.

  @inproceedings{ZuAgGrDoKo-INDIN2021-PdM, abstract = {Predictive maintenance is an essential aspect of the concept of Industry 4.0. In contrast to previous maintenance strategies, which plan repairs based on periodic schedules or threshold values, predictive maintenance is normally based on estimating the time-to-failure of machines. Thus, predictive maintenance enables a more efficient and effective maintenance approach. Although much research has already been done on time-to-failure prediction, most existing works provide only specialized approaches for specific machines. In most cases, these are either rotary machines (i.e., bearings) or lithium-ion batteries. To bridge the gap to a more general time-to-failure prediction, we propose a generic end-to-end predictive maintenance methodology for the time-to-failure prediction of industrial machines. Our methodology exhibits a number of novel aspects including a universally applicable method for feature extraction based on different types of sensor data, well-known feature transformation and selection techniques, adjustable target class assignment based on fault records with three different labeling strategies, and the training of multiple state-of-the-art machine learning classification models including hyperparameter optimization. We evaluated our time-to-failure prediction methodology in a real-world case study consisting of monitoring data gathered over several years from a large industrial press. The results demonstrated the effectiveness of the proposed methodology for six different time-to-failure pre-diction windows, as well as for the downscaled binary prediction of impending failures. In this case study, the multi-class feed-forward neural network model achieved the overall best results.}, author = {Züfle, Marwin and Agne, Joachim and Grohmann, Johannes and Dörtoluk, Ibrahim and Kounev, Samuel}, booktitle = {Proceedings of the 21st IEEE IES International Conference on Industrial Informatics}, keywords = {t_interdisciplinary}, month = {07}, publisher = {IEEE}, series = {INDIN'21}, title = {A Predictive Maintenance Methodology: Predicting the Time-to-Failure of Machines in Industry 4.0}, year = 2021 }

  %0 Conference Paper %1 ZuAgGrDoKo-INDIN2021-PdM %A Züfle, Marwin %A Agne, Joachim %A Grohmann, Johannes %A Dörtoluk, Ibrahim %A Kounev, Samuel %B Proceedings of the 21st IEEE IES International Conference on Industrial Informatics %D 2021 %I IEEE %R 10.1109/INDIN45523.2021.9557387 %T A Predictive Maintenance Methodology: Predicting the Time-to-Failure of Machines in Industry 4.0 %U https://ieeexplore.ieee.org/abstract/document/9557387 %X Predictive maintenance is an essential aspect of the concept of Industry 4.0. In contrast to previous maintenance strategies, which plan repairs based on periodic schedules or threshold values, predictive maintenance is normally based on estimating the time-to-failure of machines. Thus, predictive maintenance enables a more efficient and effective maintenance approach. Although much research has already been done on time-to-failure prediction, most existing works provide only specialized approaches for specific machines. In most cases, these are either rotary machines (i.e., bearings) or lithium-ion batteries. To bridge the gap to a more general time-to-failure prediction, we propose a generic end-to-end predictive maintenance methodology for the time-to-failure prediction of industrial machines. Our methodology exhibits a number of novel aspects including a universally applicable method for feature extraction based on different types of sensor data, well-known feature transformation and selection techniques, adjustable target class assignment based on fault records with three different labeling strategies, and the training of multiple state-of-the-art machine learning classification models including hyperparameter optimization. We evaluated our time-to-failure prediction methodology in a real-world case study consisting of monitoring data gathered over several years from a large industrial press. The results demonstrated the effectiveness of the proposed methodology for six different time-to-failure pre-diction windows, as well as for the downscaled binary prediction of impending failures. In this case study, the multi-class feed-forward neural network model achieved the overall best results.
• 
  SARDE: A Framework for Continuous and Self-Adaptive Resource Demand Estimation. J. Grohmann; S. Eismann; A. Bauer; S. Spinner; J. Blum; N. Herbst; S. Kounev; in ACM Transactions on Autonomous and Adaptive Systems (2021). 15(2)
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  • [ Download ]
  Resource demands are crucial parameters for modeling and predicting the performance of software systems. Currently, resource demand estimators are usually executed once for system analysis. However, the monitored system, as well as the resource demand itself, are subject to constant change in runtime environments. These changes additionally impact the applicability, the required parametrization as well as the resulting accuracy of individual estimation approaches. Over time, this leads to invalid or outdated estimates, which in turn negatively influence the decision-making of adaptive systems. In this article, we present SARDE, a framework for self-adaptive resource demand estimation in continuous environments. SARDE dynamically and continuously tunes, selects, and executes an ensemble of resource demand estimation approaches to adapt to changes in the environment. This creates an autonomous and unsupervised ensemble estimation technique, providing reliable resource demand estimations in dynamic environments. We evaluate SARDE using two realistic datasets. One set of different micro-benchmarks reflecting different possible system states and one dataset consisting of a continuously running application in a changing environment. Our results show that by continuously applying online optimization, selection and estimation, SARDE is able to efficiently adapt to the online trace and reduce the model error using the resulting ensemble technique.

  @article{GrEiBaSpBlHeKo2021-TaaS-SARDE, abstract = {Resource demands are crucial parameters for modeling and predicting the performance of software systems. Currently, resource demand estimators are usually executed once for system analysis. However, the monitored system, as well as the resource demand itself, are subject to constant change in runtime environments. These changes additionally impact the applicability, the required parametrization as well as the resulting accuracy of individual estimation approaches. Over time, this leads to invalid or outdated estimates, which in turn negatively influence the decision-making of adaptive systems. In this article, we present SARDE, a framework for self-adaptive resource demand estimation in continuous environments. SARDE dynamically and continuously tunes, selects, and executes an ensemble of resource demand estimation approaches to adapt to changes in the environment. This creates an autonomous and unsupervised ensemble estimation technique, providing reliable resource demand estimations in dynamic environments. We evaluate SARDE using two realistic datasets. One set of different micro-benchmarks reflecting different possible system states and one dataset consisting of a continuously running application in a changing environment. Our results show that by continuously applying online optimization, selection and estimation, SARDE is able to efficiently adapt to the online trace and reduce the model error using the resulting ensemble technique.}, address = {New York, NY, USA}, author = {Grohmann, Johannes and Eismann, Simon and Bauer, Andr\'{e} and Spinner, Simon and Blum, Johannes and Herbst, Nikolas and Kounev, Samuel}, journal = {ACM Transactions on Autonomous and Adaptive Systems}, keywords = {t_journalmagazine}, month = {06}, number = 2, publisher = {Association for Computing Machinery}, title = {SARDE: A Framework for Continuous and Self-Adaptive Resource Demand Estimation}, volume = 15, year = 2021 }

  %0 Journal Article %1 GrEiBaSpBlHeKo2021-TaaS-SARDE %A Grohmann, Johannes %A Eismann, Simon %A Bauer, André %A Spinner, Simon %A Blum, Johannes %A Herbst, Nikolas %A Kounev, Samuel %C New York, NY, USA %D 2021 %I Association for Computing Machinery %J ACM Transactions on Autonomous and Adaptive Systems %N 2 %T SARDE: A Framework for Continuous and Self-Adaptive Resource Demand Estimation %U https://doi.org/10.1145/3463369 %V 15 %X Resource demands are crucial parameters for modeling and predicting the performance of software systems. Currently, resource demand estimators are usually executed once for system analysis. However, the monitored system, as well as the resource demand itself, are subject to constant change in runtime environments. These changes additionally impact the applicability, the required parametrization as well as the resulting accuracy of individual estimation approaches. Over time, this leads to invalid or outdated estimates, which in turn negatively influence the decision-making of adaptive systems. In this article, we present SARDE, a framework for self-adaptive resource demand estimation in continuous environments. SARDE dynamically and continuously tunes, selects, and executes an ensemble of resource demand estimation approaches to adapt to changes in the environment. This creates an autonomous and unsupervised ensemble estimation technique, providing reliable resource demand estimations in dynamic environments. We evaluate SARDE using two realistic datasets. One set of different micro-benchmarks reflecting different possible system states and one dataset consisting of a continuously running application in a changing environment. Our results show that by continuously applying online optimization, selection and estimation, SARDE is able to efficiently adapt to the online trace and reduce the model error using the resulting ensemble technique.
• 
  Towards a Mobile Robot Localization Benchmark with Challenging Sensordata in an Industrial Environment. F. Spiess; J. Friesslich; D. Bluemm; F. Mast; D. Vinokour; S. Kounev; T. Kaupp; N. Strobel; in 2021 20th International Conference on Advanced Robotics (ICAR) (2021). 857–864.
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  To arrive at a realistic assessment of localization methods in terms of their performance in an industrial environment under various challenging conditions, we provide a benchmark to evaluate algorithms both for individual components as well as multi-sensor systems. For several sensor types, including wheel odometry, RGB cameras, RGB-D cameras, and LIDAR, potential issues were identified. The accuracy of wheel odometry, for example, when there are bumps on the track. For each sensor type, we explicitly chose a track for the benchmark dataset containing situations where the sensor fails to provide adequate measurements. Based on the acquired sensor data, localization can be achieved either using a single sensor information or sensor fusion. To help evaluate the output of associated localization algorithms, we provide a software to evaluate a set of metrics as part of the paper. An example application of the benchmark with state-of-the-art algorithms for each sensor is also provided.

  @inproceedings{9659355, abstract = {To arrive at a realistic assessment of localization methods in terms of their performance in an industrial environment under various challenging conditions, we provide a benchmark to evaluate algorithms both for individual components as well as multi-sensor systems. For several sensor types, including wheel odometry, RGB cameras, RGB-D cameras, and LIDAR, potential issues were identified. The accuracy of wheel odometry, for example, when there are bumps on the track. For each sensor type, we explicitly chose a track for the benchmark dataset containing situations where the sensor fails to provide adequate measurements. Based on the acquired sensor data, localization can be achieved either using a single sensor information or sensor fusion. To help evaluate the output of associated localization algorithms, we provide a software to evaluate a set of metrics as part of the paper. An example application of the benchmark with state-of-the-art algorithms for each sensor is also provided.}, author = {Spiess, Florian and Friesslich, Jonas and Bluemm, Daniel and Mast, Fabio and Vinokour, Dmitrij and Kounev, Samuel and Kaupp, Tobias and Strobel, Norbert}, booktitle = {2021 20th International Conference on Advanced Robotics (ICAR)}, keywords = {t_interdisciplinary}, month = 12, pages = {857-864}, title = {Towards a Mobile Robot Localization Benchmark with Challenging Sensordata in an Industrial Environment}, year = 2021 }

  %0 Conference Paper %1 9659355 %A Spiess, Florian %A Friesslich, Jonas %A Bluemm, Daniel %A Mast, Fabio %A Vinokour, Dmitrij %A Kounev, Samuel %A Kaupp, Tobias %A Strobel, Norbert %B 2021 20th International Conference on Advanced Robotics (ICAR) %D 2021 %P 857-864 %T Towards a Mobile Robot Localization Benchmark with Challenging Sensordata in an Industrial Environment %U https://ieeexplore.ieee.org/document/9659355/ %X To arrive at a realistic assessment of localization methods in terms of their performance in an industrial environment under various challenging conditions, we provide a benchmark to evaluate algorithms both for individual components as well as multi-sensor systems. For several sensor types, including wheel odometry, RGB cameras, RGB-D cameras, and LIDAR, potential issues were identified. The accuracy of wheel odometry, for example, when there are bumps on the track. For each sensor type, we explicitly chose a track for the benchmark dataset containing situations where the sensor fails to provide adequate measurements. Based on the acquired sensor data, localization can be achieved either using a single sensor information or sensor fusion. To help evaluate the output of associated localization algorithms, we provide a software to evaluate a set of metrics as part of the paper. An example application of the benchmark with state-of-the-art algorithms for each sensor is also provided.
• 
  Scalable Processing Of Copernicus Sentinel satellite Images Using Argo Workflows. F. W. Fichtner; N. Mandery; M. Schwinger; J. Eberle; M. Nolde; T. Riedlinger; in Big Data from Space 2021 (2021). 77–80.
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  With the goal of using a pool of resources dynamically for different applications we migrated scientific Earth Observation processors from dedicated Virtual Machines into a centralized cloud. Processing in this environment works using off-the-shelf components like Kubernetes, Docker and Argo Workflows. We were able to benefit from sharing data, tools and infrastructure in between processors. To showcase the new workflow or pipeline by means of an example we use our burnt area monitoring processor based on Sentinel-3 satellite data. A new architecture based on existing components was established, which we plan to extend it in the future.

  @inproceedings{dlr142309, abstract = {With the goal of using a pool of resources dynamically for different applications we migrated scientific Earth Observation processors from dedicated Virtual Machines into a centralized cloud. Processing in this environment works using off-the-shelf components like Kubernetes, Docker and Argo Workflows. We were able to benefit from sharing data, tools and infrastructure in between processors. To showcase the new workflow or pipeline by means of an example we use our burnt area monitoring processor based on Sentinel-3 satellite data. A new architecture based on existing components was established, which we plan to extend it in the future.}, author = {Fichtner, Florian Willy and Mandery, Nico and Schwinger, Maximilian and Eberle, Jonas and Nolde, Michael and Riedlinger, Torsten}, booktitle = {Big Data from Space 2021}, keywords = {t_interdisciplinary}, month = {05}, pages = {77–80}, title = {Scalable Processing Of Copernicus Sentinel satellite Images Using Argo Workflows}, year = 2021 }

  %0 Conference Paper %1 dlr142309 %A Fichtner, Florian Willy %A Mandery, Nico %A Schwinger, Maximilian %A Eberle, Jonas %A Nolde, Michael %A Riedlinger, Torsten %B Big Data from Space 2021 %D 2021 %P 77--80 %T Scalable Processing Of Copernicus Sentinel satellite Images Using Argo Workflows %U https://elib.dlr.de/142309/ %X With the goal of using a pool of resources dynamically for different applications we migrated scientific Earth Observation processors from dedicated Virtual Machines into a centralized cloud. Processing in this environment works using off-the-shelf components like Kubernetes, Docker and Argo Workflows. We were able to benefit from sharing data, tools and infrastructure in between processors. To showcase the new workflow or pipeline by means of an example we use our burnt area monitoring processor based on Sentinel-3 satellite data. A new architecture based on existing components was established, which we plan to extend it in the future.
• 
  SuanMing: Explainable Prediction of Performance Degradations in Microservice Applications. J. Grohmann; M. Straesser; A. Chalbani; S. Eismann; Y. Arian; N. Herbst; N. Peretz; S. Kounev; in Proceedings of the 12th ACM/SPEC International Conference on Performance Engineering (ICPE) (2021).

  Acceptance Rate: 29%
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  • [ DOI ]
  • [ Download ]
  Application performance management (APM) tools are useful to observe the performance properties of an application during production. However, APM is normally purely reactive, that is, it can only report about current or past performance degradation. Although some approaches capable of predictive application monitoring have been proposed, they can only report a predicted degradation but cannot explain its root-cause, making it hard to prevent the expected degradation. In this paper, we present SuanMing---a framework for predicting performance degradation of microservice applications running in cloud environments. SuanMing is able to predict future root causes for anticipated performance degradations and therefore aims at preventing performance degradations before they actually occur. We evaluate SuanMing on two realistic microservice applications, TeaStore and TrainTicket, and we show that our approach is able to predict and pinpoint performance degradations with an accuracy of over 90%.

  @inproceedings{GrStChEiArHePeKo2021-ICPE, abstract = {Application performance management (APM) tools are useful to observe the performance properties of an application during production. However, APM is normally purely reactive, that is, it can only report about current or past performance degradation. Although some approaches capable of predictive application monitoring have been proposed, they can only report a predicted degradation but cannot explain its root-cause, making it hard to prevent the expected degradation. In this paper, we present SuanMing—a framework for predicting performance degradation of microservice applications running in cloud environments. SuanMing is able to predict future root causes for anticipated performance degradations and therefore aims at preventing performance degradations before they actually occur. We evaluate SuanMing on two realistic microservice applications, TeaStore and TrainTicket, and we show that our approach is able to predict and pinpoint performance degradations with an accuracy of over 90\%.}, address = {New York, NY, USA}, author = {Grohmann, Johannes and Straesser, Martin and Chalbani, Avi and Eismann, Simon and Arian, Yair and Herbst, Nikolas and Peretz, Noam and Kounev, Samuel}, booktitle = {Proceedings of the 12th ACM/SPEC International Conference on Performance Engineering (ICPE)}, keywords = {performance}, month = {04}, note = {Acceptance Rate: 29%}, organization = {ACM}, title = {SuanMing: Explainable Prediction of Performance Degradations in Microservice Applications}, year = 2021 }

  %0 Conference Paper %1 GrStChEiArHePeKo2021-ICPE %A Grohmann, Johannes %A Straesser, Martin %A Chalbani, Avi %A Eismann, Simon %A Arian, Yair %A Herbst, Nikolas %A Peretz, Noam %A Kounev, Samuel %B Proceedings of the 12th ACM/SPEC International Conference on Performance Engineering (ICPE) %C New York, NY, USA %D 2021 %R https://doi.org/10.1145/3427921.3450248 %T SuanMing: Explainable Prediction of Performance Degradations in Microservice Applications %U https://doi.org/10.1145/3427921.3450248 %X Application performance management (APM) tools are useful to observe the performance properties of an application during production. However, APM is normally purely reactive, that is, it can only report about current or past performance degradation. Although some approaches capable of predictive application monitoring have been proposed, they can only report a predicted degradation but cannot explain its root-cause, making it hard to prevent the expected degradation. In this paper, we present SuanMing---a framework for predicting performance degradation of microservice applications running in cloud environments. SuanMing is able to predict future root causes for anticipated performance degradations and therefore aims at preventing performance degradations before they actually occur. We evaluate SuanMing on two realistic microservice applications, TeaStore and TrainTicket, and we show that our approach is able to predict and pinpoint performance degradations with an accuracy of over 90%.
• 
  Towards a Group Encryption Scheme Benchmark: A View on Centralized Schemes with focus on IoT. T. Prantl; P. Ten; L. Iffländer; S. Herrnleben; A. Dmitrenko; S. Kounev; C. Krupitzer; in 2021 ACM/SPEC International Conference on Performance Engineering (ICPE) (2021).
  • [ BibTeX ]
  • [ EndNote ]
  @inproceedings{PrTeIfHeDmKo2021-ICPE-GroupEncryptionCentralizedBenchmark, author = {Prantl, Thomas and Ten, Peter and Iffländer, Lukas and Herrnleben, Stefan and Dmitrenko, Alexandra and Kounev, Samuel and Krupitzer, Christian}, booktitle = {2021 ACM/SPEC International Conference on Performance Engineering (ICPE)}, keywords = {Group\_Encyrption\_Scheme}, month = {04}, series = {ICPE'21}, title = {Towards a Group Encryption Scheme Benchmark: A View on Centralized Schemes with focus on IoT}, year = 2021 }

  %0 Conference Paper %1 PrTeIfHeDmKo2021-ICPE-GroupEncryptionCentralizedBenchmark %A Prantl, Thomas %A Ten, Peter %A Iffländer, Lukas %A Herrnleben, Stefan %A Dmitrenko, Alexandra %A Kounev, Samuel %A Krupitzer, Christian %B 2021 ACM/SPEC International Conference on Performance Engineering (ICPE) %D 2021 %T Towards a Group Encryption Scheme Benchmark: A View on Centralized Schemes with focus on IoT
• 
  Attack-aware Security Function Management. L. Iffländer; Thesis; Universität Würzburg. (2021, Januar).
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  • [ Download ]
  Over the last decades, cybersecurity has become an increasingly important issue. Between 2019 and 2011 alone, the losses from cyberattacks in the United States grew by 6217%. At the same time, attacks became not only more intensive but also more and more versatile and diverse. Cybersecurity has become everyone’s concern. Today, service providers require sophisticated and extensive security infrastructures comprising many security functions dedicated to various cyberattacks. Still, attacks become more violent to a level where infrastructures can no longer keep up. Simply scaling up is no longer sufficient. To address this challenge, in a whitepaper, the Cloud Security Alliance (CSA) proposed multiple work packages for security infrastructure, leveraging the possibilities of Software-defined Networking (SDN) and Network Function Virtualization (NFV). Security functions require a more sophisticated modeling approach than regular network functions. Notably, the property to drop packets deemed malicious has a significant impact on Security Service Function Chains (SSFCs)—service chains consisting of multiple security functions to protect against multiple at- tack vectors. Under attack, the order of these chains influences the end-to-end system performance depending on the attack type. Unfortunately, it is hard to predict the attack composition at system design time. Thus, we make a case for dynamic attack-aware SSFC reordering. Also, we tackle the issues of the lack of integration between security functions and the surrounding network infrastructure, the insufficient use of short term CPU frequency boosting, and the lack of Intrusion Detection and Prevention Systems (IDPS) against database ransomware attacks. Current works focus on characterizing the performance of security functions and their behavior under overload without considering the surrounding infrastructure. Other works aim at replacing security functions using network infrastructure features but do not consider integrating security functions within the network. Further publications deal with using SDN for security or how to deal with new vulnerabilities introduced through SDN. However, they do not take security function performance into account. NFV is a popular field for research dealing with frameworks, benchmarking methods, the combination with SDN, and implementing security functions as Virtualized Network Functions (VNFs). Research in this area brought forth the concept of Service Function Chains (SFCs) that chain multiple network functions after one another. Nevertheless, they still do not consider the specifics of security functions. The mentioned CSA whitepaper proposes many valuable ideas but leaves their realization open to others. This thesis presents solutions to increase the performance of single security functions using SDN, performance modeling, a framework for attack-aware SSFC reordering, a solution to make better use of CPU frequency boosting, and an IDPS against database ransomware. Specifically, the primary contributions of this work are: • We present approaches to dynamically bypass Intrusion Detection Systems (IDS) in order to increase their performance without reducing the security level. To this end, we develop and implement three SDN-based approaches (two dynamic and one static). We evaluate the proposed approaches regarding security and performance and show that they significantly increase the performance com- pared to an inline IDS without significant security deficits. We show that using software switches can further increase the performance of the dynamic approaches up to a point where they can eliminate any throughput drawbacks when using the IDS. • We design a DDoS Protection System (DPS) against TCP SYN flood at tacks in the form of a VNF that works inside an SDN-enabled network. This solution eliminates known scalability and performance drawbacks of existing solutions for this attack type. Then, we evaluate this solution showing that it correctly handles the connection establishment and present solutions for an observed issue. Next, we evaluate the performance showing that our solution increases performance up to three times. Parallelization and parameter tuning yields another 76% performance boost. Based on these findings, we discuss optimal deployment strategies. • We introduce the idea of attack-aware SSFC reordering and explain its impact in a theoretical scenario. Then, we discuss the required information to perform this process. We validate our claim of the importance of the SSFC order by analyzing the behavior of single security functions and SSFCs. Based on the results, we conclude that there is a massive impact on the performance up to three orders of magnitude, and we find contradicting optimal orders for different workloads. Thus, we demonstrate the need for dynamic reordering. Last, we develop a model for SSFC regarding traffic composition and resource demands. We classify the traffic into multiple classes and model the effect of single security functions on the traffic and their generated resource demands as functions of the incoming network traffic. Based on our model, we propose three approaches to determine optimal orders for reordering. • We implement a framework for attack-aware SSFC reordering based on this knowledge. The framework places all security functions inside an SDN-enabled network and reorders them using SDN flows. Our evaluation shows that the framework can enforce all routes as desired. It correctly adapts to all attacks and returns to the original state after the attacks cease. We find possible security issues at the moment of reordering and present solutions to eliminate them. • Next, we design and implement an approach to load balance servers while taking into account their ability to go into a state of Central Processing Unit (CPU) frequency boost. To this end, the approach collects temperature information from available hosts and places services on the host that can attain the boosted mode the longest. We evaluate this approach and show its effectiveness. For high load scenarios, the approach increases the overall performance and the performance per watt. Even better results show up for low load workloads, where not only all performance metrics improve but also the temperatures and total power consumption decrease. • Last, we design an IDPS protecting against database ransomware attacks that comprise multiple queries to attain their goal. Our solution models these attacks using a Colored Petri Net (CPN). A proof-of-concept implementation shows that our approach is capable of detecting attacks without creating false positives for benign scenarios. Furthermore, our solution creates only a small performance impact. Our contributions can help to improve the performance of security infrastructures. We see multiple application areas from data center operators over software and hardware developers to security and performance researchers. Most of the above-listed contributions found use in several research publications. Regarding future work, we see the need to better integrate SDN-enabled security functions and SSFC reordering in data center networks. Future SSFC should discriminate between different traffic types, and security frameworks should support automatically learning models for security functions. We see the need to consider energy efficiency when regarding SSFCs and take CPU boosting technologies into account when designing performance models as well as placement, scaling, and deployment strategies. Last, for a faster adaptation against recent ransomware attacks, we propose machine-assisted learning for database IDPS signatures.

  @phdthesis{ifflander2021attackaware, abstract = {Over the last decades, cybersecurity has become an increasingly important issue. Between 2019 and 2011 alone, the losses from cyberattacks in the United States grew by 6217%. At the same time, attacks became not only more intensive but also more and more versatile and diverse. Cybersecurity has become everyone’s concern. Today, service providers require sophisticated and extensive security infrastructures comprising many security functions dedicated to various cyberattacks. Still, attacks become more violent to a level where infrastructures can no longer keep up. Simply scaling up is no longer sufficient. To address this challenge, in a whitepaper, the Cloud Security Alliance (CSA) proposed multiple work packages for security infrastructure, leveraging the possibilities of Software-defined Networking (SDN) and Network Function Virtualization (NFV). Security functions require a more sophisticated modeling approach than regular network functions. Notably, the property to drop packets deemed malicious has a significant impact on Security Service Function Chains (SSFCs)—service chains consisting of multiple security functions to protect against multiple at- tack vectors. Under attack, the order of these chains influences the end-to-end system performance depending on the attack type. Unfortunately, it is hard to predict the attack composition at system design time. Thus, we make a case for dynamic attack-aware SSFC reordering. Also, we tackle the issues of the lack of integration between security functions and the surrounding network infrastructure, the insufficient use of short term CPU frequency boosting, and the lack of Intrusion Detection and Prevention Systems (IDPS) against database ransomware attacks. Current works focus on characterizing the performance of security functions and their behavior under overload without considering the surrounding infrastructure. Other works aim at replacing security functions using network infrastructure features but do not consider integrating security functions within the network. Further publications deal with using SDN for security or how to deal with new vulnerabilities introduced through SDN. However, they do not take security function performance into account. NFV is a popular field for research dealing with frameworks, benchmarking methods, the combination with SDN, and implementing security functions as Virtualized Network Functions (VNFs). Research in this area brought forth the concept of Service Function Chains (SFCs) that chain multiple network functions after one another. Nevertheless, they still do not consider the specifics of security functions. The mentioned CSA whitepaper proposes many valuable ideas but leaves their realization open to others. This thesis presents solutions to increase the performance of single security functions using SDN, performance modeling, a framework for attack-aware SSFC reordering, a solution to make better use of CPU frequency boosting, and an IDPS against database ransomware. Specifically, the primary contributions of this work are: • We present approaches to dynamically bypass Intrusion Detection Systems (IDS) in order to increase their performance without reducing the security level. To this end, we develop and implement three SDN-based approaches (two dynamic and one static). We evaluate the proposed approaches regarding security and performance and show that they significantly increase the performance com- pared to an inline IDS without significant security deficits. We show that using software switches can further increase the performance of the dynamic approaches up to a point where they can eliminate any throughput drawbacks when using the IDS. • We design a DDoS Protection System (DPS) against TCP SYN flood at tacks in the form of a VNF that works inside an SDN-enabled network. This solution eliminates known scalability and performance drawbacks of existing solutions for this attack type. Then, we evaluate this solution showing that it correctly handles the connection establishment and present solutions for an observed issue. Next, we evaluate the performance showing that our solution increases performance up to three times. Parallelization and parameter tuning yields another 76% performance boost. Based on these findings, we discuss optimal deployment strategies. • We introduce the idea of attack-aware SSFC reordering and explain its impact in a theoretical scenario. Then, we discuss the required information to perform this process. We validate our claim of the importance of the SSFC order by analyzing the behavior of single security functions and SSFCs. Based on the results, we conclude that there is a massive impact on the performance up to three orders of magnitude, and we find contradicting optimal orders for different workloads. Thus, we demonstrate the need for dynamic reordering. Last, we develop a model for SSFC regarding traffic composition and resource demands. We classify the traffic into multiple classes and model the effect of single security functions on the traffic and their generated resource demands as functions of the incoming network traffic. Based on our model, we propose three approaches to determine optimal orders for reordering. • We implement a framework for attack-aware SSFC reordering based on this knowledge. The framework places all security functions inside an SDN-enabled network and reorders them using SDN flows. Our evaluation shows that the framework can enforce all routes as desired. It correctly adapts to all attacks and returns to the original state after the attacks cease. We find possible security issues at the moment of reordering and present solutions to eliminate them. • Next, we design and implement an approach to load balance servers while taking into account their ability to go into a state of Central Processing Unit (CPU) frequency boost. To this end, the approach collects temperature information from available hosts and places services on the host that can attain the boosted mode the longest. We evaluate this approach and show its effectiveness. For high load scenarios, the approach increases the overall performance and the performance per watt. Even better results show up for low load workloads, where not only all performance metrics improve but also the temperatures and total power consumption decrease. • Last, we design an IDPS protecting against database ransomware attacks that comprise multiple queries to attain their goal. Our solution models these attacks using a Colored Petri Net (CPN). A proof-of-concept implementation shows that our approach is capable of detecting attacks without creating false positives for benign scenarios. Furthermore, our solution creates only a small performance impact. Our contributions can help to improve the performance of security infrastructures. We see multiple application areas from data center operators over software and hardware developers to security and performance researchers. Most of the above-listed contributions found use in several research publications. Regarding future work, we see the need to better integrate SDN-enabled security functions and SSFC reordering in data center networks. Future SSFC should discriminate between different traffic types, and security frameworks should support automatically learning models for security functions. We see the need to consider energy efficiency when regarding SSFCs and take CPU boosting technologies into account when designing performance models as well as placement, scaling, and deployment strategies. Last, for a faster adaptation against recent ransomware attacks, we propose machine-assisted learning for database IDPS signatures.}, author = {Iffl{\"a}nder, Lukas}, keywords = {security}, month = {01}, school = {Universit{\"a}t W{\"u}rzburg}, title = {Attack-aware Security Function Management}, type = {doctoralthesis}, year = 2021 }

  %0 Thesis %1 ifflander2021attackaware %A Iffländer, Lukas %D 2021 %T Attack-aware Security Function Management %X Over the last decades, cybersecurity has become an increasingly important issue. Between 2019 and 2011 alone, the losses from cyberattacks in the United States grew by 6217%. At the same time, attacks became not only more intensive but also more and more versatile and diverse. Cybersecurity has become everyone’s concern. Today, service providers require sophisticated and extensive security infrastructures comprising many security functions dedicated to various cyberattacks. Still, attacks become more violent to a level where infrastructures can no longer keep up. Simply scaling up is no longer sufficient. To address this challenge, in a whitepaper, the Cloud Security Alliance (CSA) proposed multiple work packages for security infrastructure, leveraging the possibilities of Software-defined Networking (SDN) and Network Function Virtualization (NFV). Security functions require a more sophisticated modeling approach than regular network functions. Notably, the property to drop packets deemed malicious has a significant impact on Security Service Function Chains (SSFCs)—service chains consisting of multiple security functions to protect against multiple at- tack vectors. Under attack, the order of these chains influences the end-to-end system performance depending on the attack type. Unfortunately, it is hard to predict the attack composition at system design time. Thus, we make a case for dynamic attack-aware SSFC reordering. Also, we tackle the issues of the lack of integration between security functions and the surrounding network infrastructure, the insufficient use of short term CPU frequency boosting, and the lack of Intrusion Detection and Prevention Systems (IDPS) against database ransomware attacks. Current works focus on characterizing the performance of security functions and their behavior under overload without considering the surrounding infrastructure. Other works aim at replacing security functions using network infrastructure features but do not consider integrating security functions within the network. Further publications deal with using SDN for security or how to deal with new vulnerabilities introduced through SDN. However, they do not take security function performance into account. NFV is a popular field for research dealing with frameworks, benchmarking methods, the combination with SDN, and implementing security functions as Virtualized Network Functions (VNFs). Research in this area brought forth the concept of Service Function Chains (SFCs) that chain multiple network functions after one another. Nevertheless, they still do not consider the specifics of security functions. The mentioned CSA whitepaper proposes many valuable ideas but leaves their realization open to others. This thesis presents solutions to increase the performance of single security functions using SDN, performance modeling, a framework for attack-aware SSFC reordering, a solution to make better use of CPU frequency boosting, and an IDPS against database ransomware. Specifically, the primary contributions of this work are: • We present approaches to dynamically bypass Intrusion Detection Systems (IDS) in order to increase their performance without reducing the security level. To this end, we develop and implement three SDN-based approaches (two dynamic and one static). We evaluate the proposed approaches regarding security and performance and show that they significantly increase the performance com- pared to an inline IDS without significant security deficits. We show that using software switches can further increase the performance of the dynamic approaches up to a point where they can eliminate any throughput drawbacks when using the IDS. • We design a DDoS Protection System (DPS) against TCP SYN flood at tacks in the form of a VNF that works inside an SDN-enabled network. This solution eliminates known scalability and performance drawbacks of existing solutions for this attack type. Then, we evaluate this solution showing that it correctly handles the connection establishment and present solutions for an observed issue. Next, we evaluate the performance showing that our solution increases performance up to three times. Parallelization and parameter tuning yields another 76% performance boost. Based on these findings, we discuss optimal deployment strategies. • We introduce the idea of attack-aware SSFC reordering and explain its impact in a theoretical scenario. Then, we discuss the required information to perform this process. We validate our claim of the importance of the SSFC order by analyzing the behavior of single security functions and SSFCs. Based on the results, we conclude that there is a massive impact on the performance up to three orders of magnitude, and we find contradicting optimal orders for different workloads. Thus, we demonstrate the need for dynamic reordering. Last, we develop a model for SSFC regarding traffic composition and resource demands. We classify the traffic into multiple classes and model the effect of single security functions on the traffic and their generated resource demands as functions of the incoming network traffic. Based on our model, we propose three approaches to determine optimal orders for reordering. • We implement a framework for attack-aware SSFC reordering based on this knowledge. The framework places all security functions inside an SDN-enabled network and reorders them using SDN flows. Our evaluation shows that the framework can enforce all routes as desired. It correctly adapts to all attacks and returns to the original state after the attacks cease. We find possible security issues at the moment of reordering and present solutions to eliminate them. • Next, we design and implement an approach to load balance servers while taking into account their ability to go into a state of Central Processing Unit (CPU) frequency boost. To this end, the approach collects temperature information from available hosts and places services on the host that can attain the boosted mode the longest. We evaluate this approach and show its effectiveness. For high load scenarios, the approach increases the overall performance and the performance per watt. Even better results show up for low load workloads, where not only all performance metrics improve but also the temperatures and total power consumption decrease. • Last, we design an IDPS protecting against database ransomware attacks that comprise multiple queries to attain their goal. Our solution models these attacks using a Colored Petri Net (CPN). A proof-of-concept implementation shows that our approach is capable of detecting attacks without creating false positives for benign scenarios. Furthermore, our solution creates only a small performance impact. Our contributions can help to improve the performance of security infrastructures. We see multiple application areas from data center operators over software and hardware developers to security and performance researchers. Most of the above-listed contributions found use in several research publications. Regarding future work, we see the need to better integrate SDN-enabled security functions and SSFC reordering in data center networks. Future SSFC should discriminate between different traffic types, and security frameworks should support automatically learning models for security functions. We see the need to consider energy efficiency when regarding SSFCs and take CPU boosting technologies into account when designing performance models as well as placement, scaling, and deployment strategies. Last, for a faster adaptation against recent ransomware attacks, we propose machine-assisted learning for database IDPS signatures.
• 
  Utility-based Vehicle Routing Integrating User Preferences. V. Lesch; M. Hadry; S. Kounev; C. Krupitzer; in Proceedings of 3rd International Workshop on Pervasive Computing for Vehicular Systems (PerVehicle), 2021 (2021).
  • [ BibTeX ]
  • [ EndNote ]
  • [ Download ]
  @inproceedings{lesch2021utility, author = {Lesch, Veronika and Hadry, Marius and Kounev, Samuel and Krupitzer, Christian}, booktitle = {Proceedings of 3rd International Workshop on Pervasive Computing for Vehicular Systems (PerVehicle), 2021}, keywords = {t_workshop}, month = {03}, publisher = {IEEE}, title = {Utility-based Vehicle Routing Integrating User Preferences}, year = 2021 }

  %0 Conference Paper %1 lesch2021utility %A Lesch, Veronika %A Hadry, Marius %A Kounev, Samuel %A Krupitzer, Christian %B Proceedings of 3rd International Workshop on Pervasive Computing for Vehicular Systems (PerVehicle), 2021 %D 2021 %I IEEE %T Utility-based Vehicle Routing Integrating User Preferences
• 
  A Comparison of Mechanisms for Compensating Negative Impacts of System Integration. V. Lesch; C. Krupitzer; K. Stubenrauch; N. Keil; C. Becker; S. Kounev; M. Segata; in Future Generation Computer Systems (2021). 116 117–131.
  • [ BibTeX ]
  • [ EndNote ]
  • [ DOI ]
  • [ Download ]
  @article{lesch2020comparison, author = {Lesch, Veronika and Krupitzer, Christian and Stubenrauch, Kevin and Keil, Nico and Becker, Christian and Kounev, Samuel and Segata, Michele}, journal = {Future Generation Computer Systems}, keywords = {platooning}, month = {03}, pages = {117-131}, title = {A Comparison of Mechanisms for Compensating Negative Impacts of System Integration}, volume = 116, year = 2021 }

  %0 Journal Article %1 lesch2020comparison %A Lesch, Veronika %A Krupitzer, Christian %A Stubenrauch, Kevin %A Keil, Nico %A Becker, Christian %A Kounev, Samuel %A Segata, Michele %D 2021 %J Future Generation Computer Systems %P 117-131 %R https://doi.org/10.1016/j.future.2020.10.029 %T A Comparison of Mechanisms for Compensating Negative Impacts of System Integration %V 116
• 
  SPEC Research Group Newsletter, vol. 3 no. 2. S. Kounev; A. van Hoorn; A. Bauer; (2021, April).

  Published by Standard Performance Evaluation Corporation (SPEC)
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  • [ Download ]
  @misc{SPEC-RG-NEWSLETTER-10, author = {Kounev, Samuel and van Hoorn, Andre and Bauer, Andr{\'e}}, keywords = {SPEC}, month = {04}, note = {Published by Standard Performance Evaluation Corporation (SPEC)}, title = {{SPEC Research Group Newsletter, vol. 3 no. 2}}, year = 2021 }

  %0 Generic %1 SPEC-RG-NEWSLETTER-10 %A Kounev, Samuel %A van Hoorn, Andre %A Bauer, André %D 2021 %T SPEC Research Group Newsletter, vol. 3 no. 2 %U http://research.spec.org/en/newsletter.html
• 
  SPEC - Spotlight on the International Standards Group (ISG). N. Schmitt; K.-D. Lange; S. Sharma; A. Cragin; D. Reiner; S. Kounev; in Companion of the ACM/SPEC International Conference on Performance Engineering (2021).
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  @inproceedings{Schmitt_2021, author = {Schmitt, Norbert and Lange, Klaus-Dieter and Sharma, Sanjay and Cragin, Aaron and Reiner, David and Kounev, Samuel}, booktitle = {Companion of the {ACM}/{SPEC} International Conference on Performance Engineering}, keywords = {descartes}, month = {04}, publisher = {{ACM}}, title = {{SPEC} - Spotlight on the International Standards Group ({ISG})}, year = 2021 }

  %0 Conference Paper %1 Schmitt_2021 %A Schmitt, Norbert %A Lange, Klaus-Dieter %A Sharma, Sanjay %A Cragin, Aaron %A Reiner, David %A Kounev, Samuel %B Companion of the ACM/SPEC International Conference on Performance Engineering %D 2021 %I ACM %T SPEC - Spotlight on the International Standards Group (ISG) %U https://doi.org/10.1145%2F3447545.3451171
• 
  Libra: A Benchmark for Time Series Forecasting Methods. A. Bauer; M. Züfle; S. Eismann; J. Grohmann; N. Herbst; S. Kounev; in Proceedings of the 12th ACM/SPEC International Conference on Performance Engineering (ICPE) (2021).
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  • [ DOI ]
  • [ Download ]
  In many areas of decision making, forecasting is an essential pillar. Consequently, there are many different forecasting methods. According to the "No-Free-Lunch Theorem", there is no single forecasting method that performs best for all time series. In other words, each method has its advantages and disadvantages depending on the specific use case. Therefore, the choice of the forecasting method remains a mandatory expert task. However, expert knowledge cannot be fully automated. To establish a level playing field for evaluating the performance of time series forecasting methods in a broad setting, we propose Libra, a forecasting benchmark that automatically evaluates and ranks forecasting methods based on their performance in a diverse set of evaluation scenarios. The benchmark comprises four different use cases, each covering 100 heterogeneous time series taken from different domains. The data set was assembled from publicly available time series and was designed to exhibit much higher diversity than existing forecasting competitions. Based on this benchmark, we perform a comprehensive evaluation to compare different existing time series forecasting methods.

  @inproceedings{bauer2021benchmark, abstract = {In many areas of decision making, forecasting is an essential pillar. Consequently, there are many different forecasting methods. According to the "No-Free-Lunch Theorem", there is no single forecasting method that performs best for all time series. In other words, each method has its advantages and disadvantages depending on the specific use case. Therefore, the choice of the forecasting method remains a mandatory expert task. However, expert knowledge cannot be fully automated. To establish a level playing field for evaluating the performance of time series forecasting methods in a broad setting, we propose Libra, a forecasting benchmark that automatically evaluates and ranks forecasting methods based on their performance in a diverse set of evaluation scenarios. The benchmark comprises four different use cases, each covering 100 heterogeneous time series taken from different domains. The data set was assembled from publicly available time series and was designed to exhibit much higher diversity than existing forecasting competitions. Based on this benchmark, we perform a comprehensive evaluation to compare different existing time series forecasting methods.}, address = {New York, NY, USA}, author = {Bauer, Andr{\'e} and Z{\"u}fle, Marwin and Eismann, Simon and Grohmann, Johannes and Herbst, Nikolas and Kounev, Samuel}, booktitle = {Proceedings of the 12th ACM/SPEC International Conference on Performance Engineering (ICPE)}, keywords = {benchmark}, month = {04}, organization = {ACM}, title = {Libra: A Benchmark for Time Series Forecasting Methods}, year = 2021 }

  %0 Conference Paper %1 bauer2021benchmark %A Bauer, André %A Züfle, Marwin %A Eismann, Simon %A Grohmann, Johannes %A Herbst, Nikolas %A Kounev, Samuel %B Proceedings of the 12th ACM/SPEC International Conference on Performance Engineering (ICPE) %C New York, NY, USA %D 2021 %R 10.1145/3427921.3450241 %T Libra: A Benchmark for Time Series Forecasting Methods %U https://dl.acm.org/doi/10.1145/3427921.3450241 %X In many areas of decision making, forecasting is an essential pillar. Consequently, there are many different forecasting methods. According to the "No-Free-Lunch Theorem", there is no single forecasting method that performs best for all time series. In other words, each method has its advantages and disadvantages depending on the specific use case. Therefore, the choice of the forecasting method remains a mandatory expert task. However, expert knowledge cannot be fully automated. To establish a level playing field for evaluating the performance of time series forecasting methods in a broad setting, we propose Libra, a forecasting benchmark that automatically evaluates and ranks forecasting methods based on their performance in a diverse set of evaluation scenarios. The benchmark comprises four different use cases, each covering 100 heterogeneous time series taken from different domains. The data set was assembled from publicly available time series and was designed to exhibit much higher diversity than existing forecasting competitions. Based on this benchmark, we perform a comprehensive evaluation to compare different existing time series forecasting methods.
• 
  Performance Impact Analysis of Securing MQTT Using TLS. T. Prantl; L. Iffländer; S. Herrnleben; S. Engel; S. Kounev; C. Krupitzer; in 2021 ACM/SPEC International Conference on Performance Engineering (ICPE) (2021).
  • [ BibTeX ]
  • [ EndNote ]
  @inproceedings{PrTeIfHeDmKo2021-ICPE-MQTT_TLS, author = {Prantl, Thomas and Iffländer, Lukas and Herrnleben, Stefan and Engel, Simon and Kounev, Samuel and Krupitzer, Christian}, booktitle = {2021 ACM/SPEC International Conference on Performance Engineering (ICPE)}, keywords = {IoT}, month = {04}, series = {ICPE'21}, title = {Performance Impact Analysis of Securing MQTT Using TLS}, year = 2021 }

  %0 Conference Paper %1 PrTeIfHeDmKo2021-ICPE-MQTT_TLS %A Prantl, Thomas %A Iffländer, Lukas %A Herrnleben, Stefan %A Engel, Simon %A Kounev, Samuel %A Krupitzer, Christian %B 2021 ACM/SPEC International Conference on Performance Engineering (ICPE) %D 2021 %T Performance Impact Analysis of Securing MQTT Using TLS

• 
  A Taxonomy of Techniques for SLO Failure Prediction in Software Systems. J. Grohmann; N. Herbst; A. Chalbani; Y. Arian; N. Peretz; S. Kounev; in Computers (2020). 9(1) 10.
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  • [ DOI ]
  Failure prediction is an important aspect of self-aware computing systems. Therefore, a multitude of different approaches has been proposed in the literature over the past few years. In this work, we propose a taxonomy for organizing works focusing on the prediction of Service Level Objective (SLO) failures. Our taxonomy classifies related work along the dimensions of the prediction target (e.g., anomaly detection, performance prediction, or failure prediction), the time horizon (e.g., detection or prediction, online or offline application), and the applied modeling type (e.g., time series forecasting, machine learning, or queueing theory). The classification is derived based on a systematic mapping of relevant papers in the area. Additionally, we give an overview of different techniques in each sub-group and address remaining challenges in order to guide future research.

  @article{grohmann2020-MDPI-taxonomy, abstract = {Failure prediction is an important aspect of self-aware computing systems. Therefore, a multitude of different approaches has been proposed in the literature over the past few years. In this work, we propose a taxonomy for organizing works focusing on the prediction of Service Level Objective (SLO) failures. Our taxonomy classifies related work along the dimensions of the prediction target (e.g., anomaly detection, performance prediction, or failure prediction), the time horizon (e.g., detection or prediction, online or offline application), and the applied modeling type (e.g., time series forecasting, machine learning, or queueing theory). The classification is derived based on a systematic mapping of relevant papers in the area. Additionally, we give an overview of different techniques in each sub-group and address remaining challenges in order to guide future research.}, author = {Grohmann, Johannes and Herbst, Nikolas and Chalbani, Avi and Arian, Yair and Peretz, Noam and Kounev, Samuel}, journal = {Computers}, keywords = {automated_model_learning}, number = 1, pages = 10, publisher = {Multidisciplinary Digital Publishing Institute (MDPI)}, title = {A Taxonomy of Techniques for SLO Failure Prediction in Software Systems}, volume = 9, year = 2020 }

  %0 Journal Article %1 grohmann2020-MDPI-taxonomy %A Grohmann, Johannes %A Herbst, Nikolas %A Chalbani, Avi %A Arian, Yair %A Peretz, Noam %A Kounev, Samuel %D 2020 %I Multidisciplinary Digital Publishing Institute (MDPI) %J Computers %N 1 %P 10 %R https://doi.org/10.3390/computers9010010 %T A Taxonomy of Techniques for SLO Failure Prediction in Software Systems %U https://doi.org/10.3390/computers9010010 %V 9 %X Failure prediction is an important aspect of self-aware computing systems. Therefore, a multitude of different approaches has been proposed in the literature over the past few years. In this work, we propose a taxonomy for organizing works focusing on the prediction of Service Level Objective (SLO) failures. Our taxonomy classifies related work along the dimensions of the prediction target (e.g., anomaly detection, performance prediction, or failure prediction), the time horizon (e.g., detection or prediction, online or offline application), and the applied modeling type (e.g., time series forecasting, machine learning, or queueing theory). The classification is derived based on a systematic mapping of relevant papers in the area. Additionally, we give an overview of different techniques in each sub-group and address remaining challenges in order to guide future research.
• 
  Predicting Failures by Means of Machine Learning Methods on the Example of an Industrial Press. J. Agne; Thesis; University of Würzburg; Am Hubland, Informatikgebäude, 97074 Würzburg, Germany. (2020, Februar).
  • [ BibTeX ]
  • [ EndNote ]
  @mastersthesis{Agne2020, address = {Am Hubland, Informatikgeb{\"a}ude, 97074 W{\"u}rzburg, Germany}, author = {Agne, Joachim}, keywords = {Industry_4_0}, month = {02}, school = {University of W{\"u}rzburg}, title = {{Predicting Failures by Means of Machine Learning Methods on the Example of an Industrial Press}}, type = {{MasterThesis}}, year = 2020 }

  %0 Thesis %1 Agne2020 %A Agne, Joachim %C Am Hubland, Informatikgebäude, 97074 Würzburg, Germany %D 2020 %T Predicting Failures by Means of Machine Learning Methods on the Example of an Industrial Press
• 
  A Concept for Crowd-sensed Prediction of Mobile Network Connectivity. S. Herrnleben; B. Zeidler; M. Züfle; C. Krupitzer; S. Kounev; in GI/ITG Workshop on Machine Learning in the Context of Communication Networks 2020 (2020).
  • [ BibTeX ]
  • [ EndNote ]
  @inproceedings{HeZeZuKrKo-FGMLN2020-Prediction-of-Mobile-Network-Connectivity, author = {Herrnleben, Stefan and Zeidler, Bernd and Z{\"u}fle, Marwin and Krupitzer, Christian and Kounev, Samuel}, booktitle = {GI/ITG Workshop on Machine Learning in the Context of Communication Networks 2020}, keywords = {t_workshop}, month = {02}, title = {{A Concept for Crowd-sensed Prediction of Mobile Network Connectivity}}, year = 2020 }

  %0 Conference Paper %1 HeZeZuKrKo-FGMLN2020-Prediction-of-Mobile-Network-Connectivity %A Herrnleben, Stefan %A Zeidler, Bernd %A Züfle, Marwin %A Krupitzer, Christian %A Kounev, Samuel %B GI/ITG Workshop on Machine Learning in the Context of Communication Networks 2020 %D 2020 %T A Concept for Crowd-sensed Prediction of Mobile Network Connectivity
• 
  Towards Self-Aware Multirotor Formations. D. Kaiser; V. Lesch; J. Rothe; M. Strohmeier; F. Spiess; C. Krupitzer; S. Montenegro; S. Kounev; in Computers (2020). 9(7)

  Special Issue on Self-Aware Computing
  • [ BibTeX ]
  • [ EndNote ]
  • [ Download ]
  @article{Kaiser2020Towards, author = {Kaiser, Dennis and Lesch, Veronika and Rothe, Julian and Strohmeier, Michael and Spiess, Florian and Krupitzer, Christian and Montenegro, Sergio and Kounev, Samuel}, journal = {Computers}, keywords = {Intelligent_Transportation_Systems}, month = {02}, note = {Special Issue on Self-Aware Computing}, number = 7, publisher = {MDPI}, title = {{Towards Self-Aware Multirotor Formations}}, volume = 9, year = 2020 }

  %0 Journal Article %1 Kaiser2020Towards %A Kaiser, Dennis %A Lesch, Veronika %A Rothe, Julian %A Strohmeier, Michael %A Spiess, Florian %A Krupitzer, Christian %A Montenegro, Sergio %A Kounev, Samuel %D 2020 %I MDPI %J Computers %N 7 %T Towards Self-Aware Multirotor Formations %V 9
• 
  Elasticity of Cloud Platforms. N. Herbst; A. Bauer; S. Kounev; in Systems Benchmarking: For Scientists and Engineers, S. Kounev, K.-D. Lange, J. von Kistowski (Hrsg.) (2020). 319–340.
  • [ BibTeX ]
  • [ EndNote ]
  @inproceedings{bauer2020bookelasticity, author = {Herbst, Nikolas and Bauer, Andr{\'e} and Kounev, Samuel}, booktitle = {{Systems Benchmarking: For Scientists and Engineers}}, editor = {Kounev, Samuel and Lange, Klaus-Dieter and von Kistowski, J{\'o}akim}, keywords = {t_bookchapter}, month = {01}, organization = {Springer}, pages = {319-340}, title = {{Elasticity of Cloud Platforms}}, year = 2020 }

  %0 Conference Paper %1 bauer2020bookelasticity %A Herbst, Nikolas %A Bauer, André %A Kounev, Samuel %B Systems Benchmarking: For Scientists and Engineers %D 2020 %E Kounev, Samuel %E Lange, Klaus-Dieter %E von Kistowski, Jóakim %P 319-340 %T Elasticity of Cloud Platforms
• 
  REACT: A Model-Based Runtime Environment for Adapting Communication Systems. M. Pfannemüller; M. Breitbach; C. Krupitzer; M. Weckesser; C. Becker; B. Schmerl; A. Schürr; in Proceedings of the IEEE International Conference on Autonomic Computing and Self-Organizing Systems (ACSOS 2020) (2020).
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  • [ Download ]
  Trends such as the Internet of Things or edge computing lead to a growing number of networked devices. Hence, it is becoming increasingly important to manage communication systems at runtime. Adding self-adaptive capabilities is one approach to reduce administrative effort and cope with changing execution contexts. Existing frameworks for building self-adaptive software can help to reduce development effort in general. Yet, they are neither tailored towards the use in communication systems nor easily usable without profound knowledge in self-adaptive systems development. In this paper, we propose REACT, a reusable, model-based runtime environment to complement communication systems with adaptive behavior. It addresses the heterogeneity and distribution aspects of networks and reduces development effort. REACT empowers developers of communication systems to add adaptive behavior without having experience in self-adaptive systems development. We show the effectiveness and efficiency of our prototype in an experimental evaluation based on two distinct use cases from the communication systems domain: cloud resource management and software-defined networking. The first use case includes a comparison with Rainbow, which represents a state-of-the-art model-based framework for building self-adaptive systems. The second use case applies REACT in a sophisticated, real-world communication system scenario.

  @conference{acsos2020:react, abstract = {Trends such as the Internet of Things or edge computing lead to a growing number of networked devices. Hence, it is becoming increasingly important to manage communication systems at runtime. Adding self-adaptive capabilities is one approach to reduce administrative effort and cope with changing execution contexts. Existing frameworks for building self-adaptive software can help to reduce development effort in general. Yet, they are neither tailored towards the use in communication systems nor easily usable without profound knowledge in self-adaptive systems development. In this paper, we propose REACT, a reusable, model-based runtime environment to complement communication systems with adaptive behavior. It addresses the heterogeneity and distribution aspects of networks and reduces development effort. REACT empowers developers of communication systems to add adaptive behavior without having experience in self-adaptive systems development. We show the effectiveness and efficiency of our prototype in an experimental evaluation based on two distinct use cases from the communication systems domain: cloud resource management and software-defined networking. The first use case includes a comparison with Rainbow, which represents a state-of-the-art model-based framework for building self-adaptive systems. The second use case applies REACT in a sophisticated, real-world communication system scenario.}, author = {Pfannemüller, Martin and Breitbach, Martin and Krupitzer, Christian and Weckesser, Markus and Becker, Christian and Schmerl, Bradley and Schürr, Andy}, booktitle = {Proceedings of the IEEE International Conference on Autonomic Computing and Self-Organizing Systems (ACSOS 2020)}, keywords = {self-adaptive-systems}, title = {REACT: A Model-Based Runtime Environment for Adapting Communication Systems}, year = 2020 }

  %0 Generic %1 acsos2020:react %A Pfannemüller, Martin %A Breitbach, Martin %A Krupitzer, Christian %A Weckesser, Markus %A Becker, Christian %A Schmerl, Bradley %A Schürr, Andy %B Proceedings of the IEEE International Conference on Autonomic Computing and Self-Organizing Systems (ACSOS 2020) %D 2020 %T REACT: A Model-Based Runtime Environment for Adapting Communication Systems %X Trends such as the Internet of Things or edge computing lead to a growing number of networked devices. Hence, it is becoming increasingly important to manage communication systems at runtime. Adding self-adaptive capabilities is one approach to reduce administrative effort and cope with changing execution contexts. Existing frameworks for building self-adaptive software can help to reduce development effort in general. Yet, they are neither tailored towards the use in communication systems nor easily usable without profound knowledge in self-adaptive systems development. In this paper, we propose REACT, a reusable, model-based runtime environment to complement communication systems with adaptive behavior. It addresses the heterogeneity and distribution aspects of networks and reduces development effort. REACT empowers developers of communication systems to add adaptive behavior without having experience in self-adaptive systems development. We show the effectiveness and efficiency of our prototype in an experimental evaluation based on two distinct use cases from the communication systems domain: cloud resource management and software-defined networking. The first use case includes a comparison with Rainbow, which represents a state-of-the-art model-based framework for building self-adaptive systems. The second use case applies REACT in a sophisticated, real-world communication system scenario.
• 
  Introduction to the Special Issue ``Applications in Self-Aware Computing Systems and their Evaluation’’. C. Krupitzer; B. Eberhardinger; I. Gerostathopoulos; C. Raibulet; (2020).
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  • [ Download ]
  The joint 1st Workshop on Evaluations and Measurements in Self-Aware Computing Systems (EMSAC 2019) and Workshop on Self-Aware Computing (SeAC) was held as part of the FAS* conference alliance in conjunction with the 16th IEEE International Conference on Autonomic Computing (ICAC) and the 13th IEEE International Conference on Self-Adaptive and Self-Organizing Systems (SASO) in Umea, Sweden on 20 June 2019. The goal of this one-day workshop was to bring together researchers and practitioners from academic environments and from the industry to share their solutions, ideas, visions, and doubts in self-aware computing systems in general and in the evaluation and measurements of such systems in particular. The workshop aimed to enable discussions, partnerships, and collaborations among the participants. This special issue follows the theme of the workshop. It contains extended versions of workshop presentations as well as additional contributions.

  @misc{KrEbGeRa2020_Computers_seacSI, abstract = {The joint 1st Workshop on Evaluations and Measurements in Self-Aware Computing Systems (EMSAC 2019) and Workshop on Self-Aware Computing (SeAC) was held as part of the FAS* conference alliance in conjunction with the 16th IEEE International Conference on Autonomic Computing (ICAC) and the 13th IEEE International Conference on Self-Adaptive and Self-Organizing Systems (SASO) in Umea, Sweden on 20 June 2019. The goal of this one-day workshop was to bring together researchers and practitioners from academic environments and from the industry to share their solutions, ideas, visions, and doubts in self-aware computing systems in general and in the evaluation and measurements of such systems in particular. The workshop aimed to enable discussions, partnerships, and collaborations among the participants. This special issue follows the theme of the workshop. It contains extended versions of workshop presentations as well as additional contributions.}, author = {Krupitzer, Christian and Eberhardinger, Benedikt and Gerostathopoulos, Ilias and Raibulet, Claudia}, journal = {MDPI Computers}, keywords = {se2}, number = 1, publisher = {MDPI}, title = {{Introduction to the Special Issue ``Applications in Self-Aware Computing Systems and their Evaluation''}}, volume = 9, year = 2020 }

  %0 Generic %1 KrEbGeRa2020_Computers_seacSI %A Krupitzer, Christian %A Eberhardinger, Benedikt %A Gerostathopoulos, Ilias %A Raibulet, Claudia %D 2020 %I MDPI %J MDPI Computers %N 1 %T Introduction to the Special Issue ``Applications in Self-Aware Computing Systems and their Evaluation'' %U https://www.mdpi.com/2073-431X/9/1/22 %V 9 %X The joint 1st Workshop on Evaluations and Measurements in Self-Aware Computing Systems (EMSAC 2019) and Workshop on Self-Aware Computing (SeAC) was held as part of the FAS* conference alliance in conjunction with the 16th IEEE International Conference on Autonomic Computing (ICAC) and the 13th IEEE International Conference on Self-Adaptive and Self-Organizing Systems (SASO) in Umea, Sweden on 20 June 2019. The goal of this one-day workshop was to bring together researchers and practitioners from academic environments and from the industry to share their solutions, ideas, visions, and doubts in self-aware computing systems in general and in the evaluation and measurements of such systems in particular. The workshop aimed to enable discussions, partnerships, and collaborations among the participants. This special issue follows the theme of the workshop. It contains extended versions of workshop presentations as well as additional contributions.
• 
  The impact of the German strategy for containment of Coronavirus SARS-CoV-2 on the training characteristics, physical activity, sleep of highly trained kayakers and canoeists: A retrospective observational study. C. Zinner; M. Matzka; R. Leppich; S. Kounev; H. Holmberg; B. Sperlich; in Frontiers in Sports and Active Living (2020). 2 127.
  • [ BibTeX ]
  • [ EndNote ]
  @article{zinner2020impact, author = {Zinner, Christoph and Matzka, Manuel and Leppich, Robert and Kounev, Samuel and Holmberg, HC and Sperlich, Billy}, journal = {Frontiers in Sports and Active Living}, keywords = {covid19}, pages = 127, publisher = {Frontiers}, title = {The impact of the German strategy for containment of Coronavirus SARS-CoV-2 on the training characteristics, physical activity, sleep of highly trained kayakers and canoeists: A retrospective observational study}, volume = 2, year = 2020 }

  %0 Journal Article %1 zinner2020impact %A Zinner, Christoph %A Matzka, Manuel %A Leppich, Robert %A Kounev, Samuel %A Holmberg, HC %A Sperlich, Billy %D 2020 %I Frontiers %J Frontiers in Sports and Active Living %P 127 %T The impact of the German strategy for containment of Coronavirus SARS-CoV-2 on the training characteristics, physical activity, sleep of highly trained kayakers and canoeists: A retrospective observational study %V 2
• 
  Systems Benchmarking S. Kounev; K.-D. Lange; J. von Kistowski; (2020). (1. Aufl.) Springer International Publishing.
  • [ BibTeX ]
  • [ EndNote ]
  @book{KoLaKi-2020-SystemsBenchmarking, author = {Kounev, Samuel and Lange, Klaus-Dieter and von Kistowski, Jóakim}, edition = 1, keywords = {t_book}, publisher = {Springer International Publishing}, title = {{Systems Benchmarking}}, year = 2020 }

  %0 Book %1 KoLaKi-2020-SystemsBenchmarking %A Kounev, Samuel %A Lange, Klaus-Dieter %A von Kistowski, Jóakim %D 2020 %I Springer International Publishing %T Systems Benchmarking %7 1
• 
  Beyond Microbenchmarks: The SPEC-RG Vision for A Comprehensive Serverless Benchmark. E. van Eyk; J. Scheuner; S. Eismann; C. Abad; A. Iosup; in Companion of the 2020 ACM/SPEC International Conference on Performance Engineering (2020).
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  • [ Download ]
  Serverless computing services, such as Function-as-a-Service (FaaS), hold the attractive promise of a high level of abstraction and high performance, combined with the minimization of operational logic. Several large ecosystems of serverless platforms, both open- and closed-source, aim to realize this promise. Consequently, a lucrative market has emerged. However, the performance trade-offs of these systems are not well-understood. Moreover, it is exactly the high level of abstraction and the opaqueness of the operational-side that make performance evaluation studies of serverless platforms challenging. Learning from the history of IT platforms, we argue that a benchmark for serverless platforms could help address this challenge. We envision a comprehensive serverless benchmark, which we contrast to the narrow focus of prior work in this area. We argue that a comprehensive benchmark will need to take into account more than just runtime overhead, and include notions of cost, realistic workloads, more (open-source) platforms, and cloud integrations. Finally, we show through preliminary real-world experiments how such a benchmark can help compare the performance overhead when running a serverless workload on state-of-the-art platforms.

  @inproceedings{10.1145/3185768.3186293, abstract = {Serverless computing services, such as Function-as-a-Service (FaaS), hold the attractive promise of a high level of abstraction and high performance, combined with the minimization of operational logic. Several large ecosystems of serverless platforms, both open- and closed-source, aim to realize this promise. Consequently, a lucrative market has emerged. However, the performance trade-offs of these systems are not well-understood. Moreover, it is exactly the high level of abstraction and the opaqueness of the operational-side that make performance evaluation studies of serverless platforms challenging. Learning from the history of IT platforms, we argue that a benchmark for serverless platforms could help address this challenge. We envision a comprehensive serverless benchmark, which we contrast to the narrow focus of prior work in this area. We argue that a comprehensive benchmark will need to take into account more than just runtime overhead, and include notions of cost, realistic workloads, more (open-source) platforms, and cloud integrations. Finally, we show through preliminary real-world experiments how such a benchmark can help compare the performance overhead when running a serverless workload on state-of-the-art platforms.}, author = {van Eyk, Erwin and Scheuner, Joel and Eismann, Simon and Abad, Cristina and Iosup, Alexandru}, booktitle = {Companion of the 2020 ACM/SPEC International Conference on Performance Engineering}, keywords = {SPEC}, title = {{Beyond Microbenchmarks: The SPEC-RG Vision for A Comprehensive Serverless Benchmark}}, year = 2020 }

  %0 Conference Paper %1 10.1145/3185768.3186293 %A van Eyk, Erwin %A Scheuner, Joel %A Eismann, Simon %A Abad, Cristina %A Iosup, Alexandru %B Companion of the 2020 ACM/SPEC International Conference on Performance Engineering %D 2020 %T Beyond Microbenchmarks: The SPEC-RG Vision for A Comprehensive Serverless Benchmark %U https://dl.acm.org/doi/10.1145/3375555.3384381 %X Serverless computing services, such as Function-as-a-Service (FaaS), hold the attractive promise of a high level of abstraction and high performance, combined with the minimization of operational logic. Several large ecosystems of serverless platforms, both open- and closed-source, aim to realize this promise. Consequently, a lucrative market has emerged. However, the performance trade-offs of these systems are not well-understood. Moreover, it is exactly the high level of abstraction and the opaqueness of the operational-side that make performance evaluation studies of serverless platforms challenging. Learning from the history of IT platforms, we argue that a benchmark for serverless platforms could help address this challenge. We envision a comprehensive serverless benchmark, which we contrast to the narrow focus of prior work in this area. We argue that a comprehensive benchmark will need to take into account more than just runtime overhead, and include notions of cost, realistic workloads, more (open-source) platforms, and cloud integrations. Finally, we show through preliminary real-world experiments how such a benchmark can help compare the performance overhead when running a serverless workload on state-of-the-art platforms.
• 
  An Overview of Design Patterns for Self-Adaptive Systems in the Context of the Internet of Things. C. Krupitzer; T. Temizer; T. Prantl; C. Raibulet; in IEEE Access (2020).
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  • [ Download ]
  The Internet of Things (IoT) requires the integration of all available, highly specialized, and heterogeneous devices, ranging from embedded sensor nodes to servers in the cloud. The self-adaptive research domain provides adaptive capabilities that can support the integration in IoT systems. However, developing such systems is a challenging, error-prone, and time-consuming task. In this context, design patterns propose already used and optimized solutions to specific problems in various contexts. Applying design patterns might help to reuse existing knowledge about similar development issues. However, so far, there is a lack of taxonomies on design patterns for self-adaptive systems. To tackle this issue, in this paper, we provide a taxonomy on design patterns for self-adaptive systems that can be transferred to support adaptivity in IoT systems. Besides describing the taxonomy and the design patterns, we discuss their applicability in an Industrial IoT case study.

  @article{ieeeaccess2020:sasdesignpatterns, abstract = {The Internet of Things (IoT) requires the integration of all available, highly specialized, and heterogeneous devices, ranging from embedded sensor nodes to servers in the cloud. The self-adaptive research domain provides adaptive capabilities that can support the integration in IoT systems. However, developing such systems is a challenging, error-prone, and time-consuming task. In this context, design patterns propose already used and optimized solutions to specific problems in various contexts. Applying design patterns might help to reuse existing knowledge about similar development issues. However, so far, there is a lack of taxonomies on design patterns for self-adaptive systems. To tackle this issue, in this paper, we provide a taxonomy on design patterns for self-adaptive systems that can be transferred to support adaptivity in IoT systems. Besides describing the taxonomy and the design patterns, we discuss their applicability in an Industrial IoT case study.}, author = {Krupitzer, Christian and Temizer, Timur and Prantl, Thomas and Raibulet, Claudia}, journal = {IEEE Access}, keywords = {self-adaptive-systems}, title = {An Overview of Design Patterns for Self-Adaptive Systems in the Context of the Internet of Things}, year = 2020 }

  %0 Journal Article %1 ieeeaccess2020:sasdesignpatterns %A Krupitzer, Christian %A Temizer, Timur %A Prantl, Thomas %A Raibulet, Claudia %D 2020 %J IEEE Access %T An Overview of Design Patterns for Self-Adaptive Systems in the Context of the Internet of Things %X The Internet of Things (IoT) requires the integration of all available, highly specialized, and heterogeneous devices, ranging from embedded sensor nodes to servers in the cloud. The self-adaptive research domain provides adaptive capabilities that can support the integration in IoT systems. However, developing such systems is a challenging, error-prone, and time-consuming task. In this context, design patterns propose already used and optimized solutions to specific problems in various contexts. Applying design patterns might help to reuse existing knowledge about similar development issues. However, so far, there is a lack of taxonomies on design patterns for self-adaptive systems. To tackle this issue, in this paper, we provide a taxonomy on design patterns for self-adaptive systems that can be transferred to support adaptivity in IoT systems. Besides describing the taxonomy and the design patterns, we discuss their applicability in an Industrial IoT case study.
• 
  Intra-individual physiological response of recreational runners to different training mesocycles: a randomized cross-over study. P. Düking; H.-C. Holmberg; P. Kunz; R. Leppich; B. Sperlich; in European Journal of Applied Physiology (2020). 1–9.
  • [ BibTeX ]
  • [ EndNote ]
  @article{duking2020intra, author = {D{\"u}king, Peter and Holmberg, Hans-Christer and Kunz, Philipp and Leppich, Robert and Sperlich, Billy}, journal = {European Journal of Applied Physiology}, keywords = {t_journalmagazine}, pages = {1–9}, publisher = {Springer}, title = {Intra-individual physiological response of recreational runners to different training mesocycles: a randomized cross-over study}, year = 2020 }

  %0 Journal Article %1 duking2020intra %A Düking, Peter %A Holmberg, Hans-Christer %A Kunz, Philipp %A Leppich, Robert %A Sperlich, Billy %D 2020 %I Springer %J European Journal of Applied Physiology %P 1--9 %T Intra-individual physiological response of recreational runners to different training mesocycles: a randomized cross-over study
• 
  Quantifying measurement quality and load distribution in Tor. A. Greubel; S. Pohl; S. Kounev; in Proceedings of the 36th Annual Computer Security Applications Conference (ACSAC 2020) (2020).
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  • [ Download ]
  Tor is a widely used anonymization network. Traffic is routed over different relay nodes to conceal the communication partners. However, if a single relay handles too much traffic, de-anonymization attacks are possible. The Tor Load Balancing Mechanism (TLBM) is responsible for balanced and secure load distribution. It must verify that relays cannot attract more traffic than they should by lying about their self-reported bandwidth. This work shows that the current bandwidth measurement method used for bandwidth verification is not suitable to verify the bandwidth of many relays. Most importantly, multiple measurements of high-bandwidth relays are uncorrelated to each other. Furthermore, we analyze the current load distribution in Tor. We show that the current load distribution reduces the resources necessary for several large-scale de-anonymization attacks by more than 80%. Additionally, as Tor favors fast relays during path selection, verifiable relays only handle a small fraction of Tor’s traffic. More precisely, we show that only 7.21% of all paths consist of entry and exit relays verifiable by measurements. We discuss these results’ security implications and argue that future TLBM research should focus at least as much on secure load distribution as on high traffic performance.

  @article{greubel2020quantifying, abstract = {Tor is a widely used anonymization network. Traffic is routed over different relay nodes to conceal the communication partners. However, if a single relay handles too much traffic, de-anonymization attacks are possible. The Tor Load Balancing Mechanism (TLBM) is responsible for balanced and secure load distribution. It must verify that relays cannot attract more traffic than they should by lying about their self-reported bandwidth. This work shows that the current bandwidth measurement method used for bandwidth verification is not suitable to verify the bandwidth of many relays. Most importantly, multiple measurements of high-bandwidth relays are uncorrelated to each other. Furthermore, we analyze the current load distribution in Tor. We show that the current load distribution reduces the resources necessary for several large-scale de-anonymization attacks by more than 80\%. Additionally, as Tor favors fast relays during path selection, verifiable relays only handle a small fraction of Tor’s traffic. More precisely, we show that only 7.21\% of all paths consist of entry and exit relays verifiable by measurements. We discuss these results’ security implications and argue that future TLBM research should focus at least as much on secure load distribution as on high traffic performance.}, author = {Greubel, Andre and Pohl, Steffen and Kounev, Samuel}, journal = {Proceedings of the 36th Annual Computer Security Applications Conference (ACSAC 2020)}, keywords = {tor}, title = {Quantifying measurement quality and load distribution in Tor}, year = 2020 }

  %0 Journal Article %1 greubel2020quantifying %A Greubel, Andre %A Pohl, Steffen %A Kounev, Samuel %D 2020 %J Proceedings of the 36th Annual Computer Security Applications Conference (ACSAC 2020) %T Quantifying measurement quality and load distribution in Tor %X Tor is a widely used anonymization network. Traffic is routed over different relay nodes to conceal the communication partners. However, if a single relay handles too much traffic, de-anonymization attacks are possible. The Tor Load Balancing Mechanism (TLBM) is responsible for balanced and secure load distribution. It must verify that relays cannot attract more traffic than they should by lying about their self-reported bandwidth. This work shows that the current bandwidth measurement method used for bandwidth verification is not suitable to verify the bandwidth of many relays. Most importantly, multiple measurements of high-bandwidth relays are uncorrelated to each other. Furthermore, we analyze the current load distribution in Tor. We show that the current load distribution reduces the resources necessary for several large-scale de-anonymization attacks by more than 80%. Additionally, as Tor favors fast relays during path selection, verifiable relays only handle a small fraction of Tor’s traffic. More precisely, we show that only 7.21% of all paths consist of entry and exit relays verifiable by measurements. We discuss these results’ security implications and argue that future TLBM research should focus at least as much on secure load distribution as on high traffic performance.
• 
  Learning to Learn in Collective Adaptive Systems: Mining Design Pattern for Data-driven Reasoning. M. D’Angelo; S. Ghahremani; S. Gerasimou; J. Grohmann; I. Nunes; S. Tomforde; E. Pournaras; in 2020 IEEE International Conference on Autonomic Computing and Self-Organizing Systems Companion (ACSOS-C) (2020). 121–126.
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  • [ DOI ]
  • [ Download ]
  Engineering collective adaptive systems (CAS) with learning capabilities is a challenging task due to their multidimensional and complex design space. Data-driven approaches for CAS design could introduce new insights enabling system engineers to manage the CAS complexity more cost-effectively at the design-phase. This paper introduces a systematic approach to reason about design choices and patterns of learning-based CAS. Using data from a systematic literature review, reasoning is performed with a novel application of data-driven methodologies such as clustering, multiple correspondence analysis and decision trees. The reasoning based on past experience as well as supporting novel and innovative design choices are demonstrated.

  @conference{DaGhGeGrNuToPo2020-eCas-LearningInCAS, abstract = {Engineering collective adaptive systems (CAS) with learning capabilities is a challenging task due to their multidimensional and complex design space. Data-driven approaches for CAS design could introduce new insights enabling system engineers to manage the CAS complexity more cost-effectively at the design-phase. This paper introduces a systematic approach to reason about design choices and patterns of learning-based CAS. Using data from a systematic literature review, reasoning is performed with a novel application of data-driven methodologies such as clustering, multiple correspondence analysis and decision trees. The reasoning based on past experience as well as supporting novel and innovative design choices are demonstrated.}, author = {D'Angelo, Mirko and Ghahremani, Sona and Gerasimou, Simos and Grohmann, Johannes and Nunes, Ingrid and Tomforde, Sven and Pournaras, Evangelos}, booktitle = {2020 IEEE International Conference on Autonomic Computing and Self-Organizing Systems Companion (ACSOS-C)}, keywords = {t_workshop}, pages = {121–126}, publisher = {IEEE}, title = {Learning to Learn in Collective Adaptive Systems: Mining Design Pattern for Data-driven Reasoning}, year = 2020 }

  %0 Generic %1 DaGhGeGrNuToPo2020-eCas-LearningInCAS %A D'Angelo, Mirko %A Ghahremani, Sona %A Gerasimou, Simos %A Grohmann, Johannes %A Nunes, Ingrid %A Tomforde, Sven %A Pournaras, Evangelos %B 2020 IEEE International Conference on Autonomic Computing and Self-Organizing Systems Companion (ACSOS-C) %D 2020 %I IEEE %P 121--126 %R 10.1109/ACSOS-C51401.2020.00042 %T Learning to Learn in Collective Adaptive Systems: Mining Design Pattern for Data-driven Reasoning %U https://doi.org/10.1109/ACSOS-C51401.2020.00042 %X Engineering collective adaptive systems (CAS) with learning capabilities is a challenging task due to their multidimensional and complex design space. Data-driven approaches for CAS design could introduce new insights enabling system engineers to manage the CAS complexity more cost-effectively at the design-phase. This paper introduces a systematic approach to reason about design choices and patterns of learning-based CAS. Using data from a systematic literature review, reasoning is performed with a novel application of data-driven methodologies such as clustering, multiple correspondence analysis and decision trees. The reasoning based on past experience as well as supporting novel and innovative design choices are demonstrated.
• 
  A Survey on Predictive Maintenance for Industry 4.0 C. Krupitzer; T. Wagenhals; M. Züfle; V. Lesch; D. Schäfer; A. Mozaffarin; J. Edinger; C. Becker; S. Kounev; (2020).
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  • [ Download ]
  @techreport{Krupitzer2020ASurveyPdM, author = {Krupitzer, Christian and Wagenhals, Tim and Z{\"u}fle, Marwin and Lesch, Veronika and Sch{\"a}fer, Dominik and Mozaffarin, Amin and Edinger, Janick and Becker, Christian and Kounev, Samuel}, institution = {Universit{\"a}t W{\"u}rzburg and University of Mannheim and Syntax Systems GmbH and MOZYS Engineering GmbH}, journal = {arXiv}, keywords = {Reliability}, month = {02}, title = {{A Survey on Predictive Maintenance for Industry 4.0}}, year = 2020 }

  %0 Report %1 Krupitzer2020ASurveyPdM %A Krupitzer, Christian %A Wagenhals, Tim %A Züfle, Marwin %A Lesch, Veronika %A Schäfer, Dominik %A Mozaffarin, Amin %A Edinger, Janick %A Becker, Christian %A Kounev, Samuel %D 2020 %J arXiv %T A Survey on Predictive Maintenance for Industry 4.0 %U https://arxiv.org/abs/2002.08224
• 
  Methodological Principles for Reproducible Performance Evaluation in Cloud Computing. A. V. Papadopoulos; L. Versluis; A. Bauer; N. Herbst; J. von Kistowski; A. Ali-Eldin; C. L. Abad; J. N. Amaral; P. Tuma; A. Iosup; in Software Engineering 2020, Fachtagung des GI-Fachbereichs Softwaretechnik, 24.-28. Februar 2020, Innsbruck, Austria, M. Felderer, W. Hasselbring, R. Rabiser, R. Jung (Hrsg.) (2020). (Bd. P-300) 93–94.
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  • [ Download ]
  @inproceedings{DBLP:conf/se/PapadopoulosVBH20, author = {Papadopoulos, Alessandro Vittorio and Versluis, Laurens and Bauer, Andr{{\'e}} and Herbst, Nikolas and von Kistowski, J{{\'o}}akim and Ali{-}Eldin, Ahmed and Abad, Cristina L. and Amaral, Jos{{\'e}} Nelson and Tuma, Petr and Iosup, Alexandru}, booktitle = {Software Engineering 2020, Fachtagung des GI-Fachbereichs Softwaretechnik, 24.-28. Februar 2020, Innsbruck, Austria}, editor = {Felderer, Michael and Hasselbring, Wilhelm and Rabiser, Rick and Jung, Reiner}, keywords = {se2}, pages = {93–94}, publisher = {Gesellschaft f{{\"u}}r Informatik e.V.}, series = {{LNI}}, title = {{Methodological Principles for Reproducible Performance Evaluation in Cloud Computing}}, volume = {{P-300}}, year = 2020 }

  %0 Conference Paper %1 DBLP:conf/se/PapadopoulosVBH20 %A Papadopoulos, Alessandro Vittorio %A Versluis, Laurens %A Bauer, André %A Herbst, Nikolas %A von Kistowski, Jóakim %A Ali-Eldin, Ahmed %A Abad, Cristina L. %A Amaral, José Nelson %A Tuma, Petr %A Iosup, Alexandru %B Software Engineering 2020, Fachtagung des GI-Fachbereichs Softwaretechnik, 24.-28. Februar 2020, Innsbruck, Austria %D 2020 %E Felderer, Michael %E Hasselbring, Wilhelm %E Rabiser, Rick %E Jung, Reiner %I Gesellschaft für Informatik e.V. %P 93--94 %T Methodological Principles for Reproducible Performance Evaluation in Cloud Computing %U https://doi.org/10.18420/SE2020_27 %V P-300
• 
  A Survey on Human Machine Interaction in Industry 4.0 C. Krupitzer; S. Müller; V. Lesch; M. Züfle; J. Edinger; A. Lemken; D. Schäfer; S. Kounev; C. Becker; (2020).
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  • [ Download ]
  @techreport{Krupitzer2020ASurvey, author = {Krupitzer, Christian and M{\"u}ller, Sebastian and Lesch, Veronika and Z{\"u}fle, Marwin and Edinger, Janick and Lemken, Alexander and Sch{\"a}fer, Dominik and Kounev, Samuel and Becker, Christian}, institution = {Universit{\"a}t W{\"u}rzburg and University of Mannheim and ioxp GmbH and Syntax Systems GmbH}, journal = {arXiv}, keywords = {t_interdisciplinary}, month = {02}, title = {{A Survey on Human Machine Interaction in Industry 4.0}}, year = 2020 }

  %0 Report %1 Krupitzer2020ASurvey %A Krupitzer, Christian %A Müller, Sebastian %A Lesch, Veronika %A Züfle, Marwin %A Edinger, Janick %A Lemken, Alexander %A Schäfer, Dominik %A Kounev, Samuel %A Becker, Christian %D 2020 %J arXiv %T A Survey on Human Machine Interaction in Industry 4.0 %U https://arxiv.org/abs/2002.01025
• 
  Toward a Framework for Self-Learning Adaptation Planning through Optimization. V. Lesch; in Organic Computing: Doctoral Dissertation Colloquium 2020 (2020).
  • [ BibTeX ]
  • [ EndNote ]
  @incollection{lesch2020toward, author = {Lesch, Veronika}, booktitle = {Organic Computing: Doctoral Dissertation Colloquium 2020}, keywords = {cyber-physical_systems}, title = {Toward a Framework for Self-Learning Adaptation Planning through Optimization}, year = 2020 }

  %0 Book Section %1 lesch2020toward %A Lesch, Veronika %B Organic Computing: Doctoral Dissertation Colloquium 2020 %D 2020 %T Toward a Framework for Self-Learning Adaptation Planning through Optimization
• 
  To Fail Or Not To Fail: Predicting Hard Disk Drive Failure Time Windows. M. Züfle; C. Krupitzer; F. Erhard; J. Grohmann; S. Kounev; in Proceedings of the 20th International GI/ITG Conference on Measurement, Modelling and Evaluation of Computing Systems (2020). 19–36.
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  • [ DOI ]
  • [ Download ]
  Due to the increasing size of today's data centers as well as the expectation of 24/7 availability, the complexity in the administration of hardware continuously icreases. Techniques as the Self-Monitoring, Analysis, and Reporting Technology (S.M.A.R.T.) support the monitoring of the hardware. However, those techniques often lack algorithms for intelligent data analytics. Especially, the integration of machine learning to identify potential failures in advance seems to be promising to reduce administration overhead. In this work, we present three machine learning approaches to (i) identify imminent failures, (ii) predict time windows for failures, as well as (iii) predict the exact time-to-failure. In a case study with real data from 369 hard disks, we achieve an F1-score of up to 98.0% and 97.6% for predicting potential failures with two or multiple time windows, respectively, and a hit rate of 84.9% (with a mean absolute error of 4.5 hours) for predicting the time-to-failure.

  @inproceedings{ZuKrErGrKo-MMB2020-ToFailOrNotToFail, abstract = {Due to the increasing size of today's data centers as well as the expectation of 24/7 availability, the complexity in the administration of hardware continuously icreases. Techniques as the Self-Monitoring, Analysis, and Reporting Technology (S.M.A.R.T.) support the monitoring of the hardware. However, those techniques often lack algorithms for intelligent data analytics. Especially, the integration of machine learning to identify potential failures in advance seems to be promising to reduce administration overhead. In this work, we present three machine learning approaches to (i) identify imminent failures, (ii) predict time windows for failures, as well as (iii) predict the exact time-to-failure. In a case study with real data from 369 hard disks, we achieve an F1-score of up to 98.0% and 97.6% for predicting potential failures with two or multiple time windows, respectively, and a hit rate of 84.9% (with a mean absolute error of 4.5 hours) for predicting the time-to-failure.}, address = {Cham}, author = {Z{\"u}fle, Marwin and Krupitzer, Christian and Erhard, Florian and Grohmann, Johannes and Kounev, Samuel}, booktitle = {Proceedings of the 20th International GI/ITG Conference on Measurement, Modelling and Evaluation of Computing Systems}, keywords = {Reliability}, month = {03}, pages = {19–36}, publisher = {Springer}, series = {MMB 2020}, title = {{To Fail Or Not To Fail: Predicting Hard Disk Drive Failure Time Windows}}, year = 2020 }

  %0 Conference Paper %1 ZuKrErGrKo-MMB2020-ToFailOrNotToFail %A Züfle, Marwin %A Krupitzer, Christian %A Erhard, Florian %A Grohmann, Johannes %A Kounev, Samuel %B Proceedings of the 20th International GI/ITG Conference on Measurement, Modelling and Evaluation of Computing Systems %C Cham %D 2020 %I Springer %P 19--36 %R 10.1007/978-3-030-43024-5_2 %T To Fail Or Not To Fail: Predicting Hard Disk Drive Failure Time Windows %U https://doi.org/10.1007/978-3-030-43024-5_2 %X Due to the increasing size of today's data centers as well as the expectation of 24/7 availability, the complexity in the administration of hardware continuously icreases. Techniques as the Self-Monitoring, Analysis, and Reporting Technology (S.M.A.R.T.) support the monitoring of the hardware. However, those techniques often lack algorithms for intelligent data analytics. Especially, the integration of machine learning to identify potential failures in advance seems to be promising to reduce administration overhead. In this work, we present three machine learning approaches to (i) identify imminent failures, (ii) predict time windows for failures, as well as (iii) predict the exact time-to-failure. In a case study with real data from 369 hard disks, we achieve an F1-score of up to 98.0% and 97.6% for predicting potential failures with two or multiple time windows, respectively, and a hit rate of 84.9% (with a mean absolute error of 4.5 hours) for predicting the time-to-failure. %@ 978-3-030-43024-5
• 
  Time Series Forecasting for Self-Aware Systems. A. Bauer; M. Züfle; N. Herbst; A. Zehe; A. Hotho; S. Kounev; in Proceedings of the IEEE (2020). 108(7) 1068–1093.
  • [ BibTeX ]
  • [ EndNote ]
  • [ DOI ]
  @article{BaZuHeZeHoKo-PIEEE-Forecasting, author = {Bauer, Andr{\'e} and Z{\"u}fle, Marwin and Herbst, Nikolas and Zehe, Albin and Hotho, Andreas and Kounev, Samuel}, journal = {Proceedings of the IEEE}, keywords = {t_journalmagazine}, month = {07}, number = 7, pages = {1068 - 1093}, title = {{Time Series Forecasting for Self-Aware Systems}}, volume = 108, year = 2020 }

  %0 Journal Article %1 BaZuHeZeHoKo-PIEEE-Forecasting %A Bauer, André %A Züfle, Marwin %A Herbst, Nikolas %A Zehe, Albin %A Hotho, Andreas %A Kounev, Samuel %D 2020 %J Proceedings of the IEEE %N 7 %P 1068 - 1093 %R 10.1109/JPROC.2020.2983857 %T Time Series Forecasting for Self-Aware Systems %V 108
• 
  Incremental Calibration of Architectural Performance Models with Parametric Dependencies. M. Mazkatli; D. Monschein; J. Grohmann; A. Koziolek; in 2020 IEEE International Conference on Software Architecture (ICSA 2020) (2020). 23–34.
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  • [ DOI ]
  • [ Download ]
  Architecture-based Performance Prediction (AbPP) allows evaluation of the performance of systems and to answer what-if questions without measurements for all alternatives. A difficulty when creating models is that Performance Model Parameters (PMPs, such as resource demands, loop iteration numbers and branch probabilities) depend on various influencing factors like input data, used hardware and the applied workload. To enable a broad range of what-if questions, Performance Models (PMs) need to have predictive power beyond what has been measured to calibrate the models. Thus, PMPs need to be parametrized over the influencing factors that may vary. Existing approaches allow for the estimation of parametrized PMPs by measuring the complete system. Thus, they are too costly to be applied frequently, up to after each code change. They do not keep also manual changes to the model when recalibrating. In this work, we present the Continuous Integration of Performance Models (CIPM), which incrementally extracts and calibrates the performance model, including parametric dependencies. CIPM responds to source code changes by updating the PM and adaptively instrumenting the changed parts. To allow AbPP, CIPM estimates the parametrized PMPs using the measurements (generated by performance tests or executing the system in production) and statistical analysis, e.g., regression analysis and decision trees. Additionally, our approach responds to production changes (e.g., load or deployment changes) and calibrates the usage and deployment parts of PMs accordingly. For the evaluation, we used two case studies. Evaluation results show that we were able to calibrate the PM incrementally and accurately.

  @inproceedings{MaMoGrKo2020-ICSA, abstract = {Architecture-based Performance Prediction (AbPP) allows evaluation of the performance of systems and to answer what-if questions without measurements for all alternatives. A difficulty when creating models is that Performance Model Parameters (PMPs, such as resource demands, loop iteration numbers and branch probabilities) depend on various influencing factors like input data, used hardware and the applied workload. To enable a broad range of what-if questions, Performance Models (PMs) need to have predictive power beyond what has been measured to calibrate the models. Thus, PMPs need to be parametrized over the influencing factors that may vary. Existing approaches allow for the estimation of parametrized PMPs by measuring the complete system. Thus, they are too costly to be applied frequently, up to after each code change. They do not keep also manual changes to the model when recalibrating. In this work, we present the Continuous Integration of Performance Models (CIPM), which incrementally extracts and calibrates the performance model, including parametric dependencies. CIPM responds to source code changes by updating the PM and adaptively instrumenting the changed parts. To allow AbPP, CIPM estimates the parametrized PMPs using the measurements (generated by performance tests or executing the system in production) and statistical analysis, e.g., regression analysis and decision trees. Additionally, our approach responds to production changes (e.g., load or deployment changes) and calibrates the usage and deployment parts of PMs accordingly. For the evaluation, we used two case studies. Evaluation results show that we were able to calibrate the PM incrementally and accurately.}, author = {Mazkatli, Manar and Monschein, David and Grohmann, Johannes and Koziolek, Anne}, booktitle = {2020 IEEE International Conference on Software Architecture (ICSA 2020)}, keywords = {performance}, month = {03}, pages = {23–34}, publisher = {IEEE}, title = {Incremental Calibration of Architectural Performance Models with Parametric Dependencies}, year = 2020 }

  %0 Conference Paper %1 MaMoGrKo2020-ICSA %A Mazkatli, Manar %A Monschein, David %A Grohmann, Johannes %A Koziolek, Anne %B 2020 IEEE International Conference on Software Architecture (ICSA 2020) %D 2020 %I IEEE %P 23--34 %R 10.1109/ICSA47634.2020.00011 %T Incremental Calibration of Architectural Performance Models with Parametric Dependencies %U https://doi.org/10.1109/ICSA47634.2020.00011 %X Architecture-based Performance Prediction (AbPP) allows evaluation of the performance of systems and to answer what-if questions without measurements for all alternatives. A difficulty when creating models is that Performance Model Parameters (PMPs, such as resource demands, loop iteration numbers and branch probabilities) depend on various influencing factors like input data, used hardware and the applied workload. To enable a broad range of what-if questions, Performance Models (PMs) need to have predictive power beyond what has been measured to calibrate the models. Thus, PMPs need to be parametrized over the influencing factors that may vary. Existing approaches allow for the estimation of parametrized PMPs by measuring the complete system. Thus, they are too costly to be applied frequently, up to after each code change. They do not keep also manual changes to the model when recalibrating. In this work, we present the Continuous Integration of Performance Models (CIPM), which incrementally extracts and calibrates the performance model, including parametric dependencies. CIPM responds to source code changes by updating the PM and adaptively instrumenting the changed parts. To allow AbPP, CIPM estimates the parametrized PMPs using the measurements (generated by performance tests or executing the system in production) and statistical analysis, e.g., regression analysis and decision trees. Additionally, our approach responds to production changes (e.g., load or deployment changes) and calibrates the usage and deployment parts of PMs accordingly. For the evaluation, we used two case studies. Evaluation results show that we were able to calibrate the PM incrementally and accurately.
• 
  Survey and Experimental Comparison of RGB-D Indoor Robot Navigation Methods Supported by ROS and Their Expansion via Fusion with Wheel Odometry and IMU Data. F. Spiess; J. Friesslich; K. Tobias; S. Kounev; N. Strobel; in International Journal of Mechanical Engineering and Robotics Research (IJMERR), (P. R. (Chunhui) Yang, Hrsg.) (2020). 9(12) 1532–1540.
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  This paper presents an experimental evaluation and comparison of selected Visual Odometry (VO) and Visual-SLAM (V-SLAM) algorithms for indoor mobile robot navigation supported by the Robot Operating System (ROS). The focus is on algorithms involving RGB-D cameras. Since RGB-D cameras integrate color and depth information, they output coherent measurement data and facilitate an efficient processing pipeline. The various underlying methods of vision-based algorithms are described and evaluated on two datasets covering different indoor situations as well as various lighting and movement conditions. In general, V-SLAM algorithms yielded better results. They were superior with respect to handling drift, in particular when loop closures were involved. However, the results confirmed that VO algorithms could outperform V-SLAM methods under certain circumstances. This happened when there was a very good match between an algorithm’s design objectives and the situation at hand. While the experiments showed that there is no single best algorithm for every scenario, ORB-SLAM2 is recommended as a robust stand-alone RGB-D based localization method available under ROS. Furthermore, we observed that the position estimation error could be reduced by around 67% on average when combining vision-based position estimates with sensor data obtained from wheel odometry and an inertial measurement unit (IMU), respectively. This clearly demonstrates the potential of sensor fusion techniques. The best results in case of sensor fusion were obtained with RGB-DSLAMv2.

  @article{yang2020survey, abstract = {This paper presents an experimental evaluation and comparison of selected Visual Odometry (VO) and Visual-SLAM (V-SLAM) algorithms for indoor mobile robot navigation supported by the Robot Operating System (ROS). The focus is on algorithms involving RGB-D cameras. Since RGB-D cameras integrate color and depth information, they output coherent measurement data and facilitate an efficient processing pipeline. The various underlying methods of vision-based algorithms are described and evaluated on two datasets covering different indoor situations as well as various lighting and movement conditions. In general, V-SLAM algorithms yielded better results. They were superior with respect to handling drift, in particular when loop closures were involved. However, the results confirmed that VO algorithms could outperform V-SLAM methods under certain circumstances. This happened when there was a very good match between an algorithm’s design objectives and the situation at hand. While the experiments showed that there is no single best algorithm for every scenario, ORB-SLAM2 is recommended as a robust stand-alone RGB-D based localization method available under ROS. Furthermore, we observed that the position estimation error could be reduced by around 67% on average when combining vision-based position estimates with sensor data obtained from wheel odometry and an inertial measurement unit (IMU), respectively. This clearly demonstrates the potential of sensor fusion techniques. The best results in case of sensor fusion were obtained with RGB-DSLAMv2.}, author = {Spiess, Florian and Friesslich, Jonas and Tobias, Kaupp and Kounev, Samuel and Strobel, Norbert}, editor = {Yang, Prof Richard (Chunhui)}, journal = {International Journal of Mechanical Engineering and Robotics Research (IJMERR)}, keywords = {rgb}, month = 12, number = 12, pages = {1532-1540}, title = {Survey and Experimental Comparison of RGB-D Indoor Robot Navigation Methods Supported by ROS and Their Expansion via Fusion with Wheel Odometry and IMU Data}, volume = 9, year = 2020 }

  %0 Journal Article %1 yang2020survey %A Spiess, Florian %A Friesslich, Jonas %A Tobias, Kaupp %A Kounev, Samuel %A Strobel, Norbert %D 2020 %E Yang, Prof Richard (Chunhui) %J International Journal of Mechanical Engineering and Robotics Research (IJMERR) %N 12 %P 1532-1540 %T Survey and Experimental Comparison of RGB-D Indoor Robot Navigation Methods Supported by ROS and Their Expansion via Fusion with Wheel Odometry and IMU Data %U http://www.ijmerr.com/index.php?m=content&c=index&a=show&catid=185&id=1529 %V 9 %X This paper presents an experimental evaluation and comparison of selected Visual Odometry (VO) and Visual-SLAM (V-SLAM) algorithms for indoor mobile robot navigation supported by the Robot Operating System (ROS). The focus is on algorithms involving RGB-D cameras. Since RGB-D cameras integrate color and depth information, they output coherent measurement data and facilitate an efficient processing pipeline. The various underlying methods of vision-based algorithms are described and evaluated on two datasets covering different indoor situations as well as various lighting and movement conditions. In general, V-SLAM algorithms yielded better results. They were superior with respect to handling drift, in particular when loop closures were involved. However, the results confirmed that VO algorithms could outperform V-SLAM methods under certain circumstances. This happened when there was a very good match between an algorithm’s design objectives and the situation at hand. While the experiments showed that there is no single best algorithm for every scenario, ORB-SLAM2 is recommended as a robust stand-alone RGB-D based localization method available under ROS. Furthermore, we observed that the position estimation error could be reduced by around 67% on average when combining vision-based position estimates with sensor data obtained from wheel odometry and an inertial measurement unit (IMU), respectively. This clearly demonstrates the potential of sensor fusion techniques. The best results in case of sensor fusion were obtained with RGB-DSLAMv2.
• 
  Performance, Power, and Energy-Efficiency Impact Analysis of Compiler Optimizations on the SPEC CPU 2017 Benchmark Suite. N. Schmitt; J. Bucek; J. Beckett; A. Cragin; K.-D. Lange; S. Kounev; in 2020 IEEE/ACM 13th International Conference on Utility and Cloud Computing (UCC) (2020). 292–301.
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  • [ URL ]
  The growth of cloud services leads to more and more data centers that are increasingly larger and consume considerable amounts of power. To increase energy efficiency, both the actual server equipment and the software must become more energy efficient. Software has a major impact on hardware utilization levels, and subsequently, the energy efficiency. While energy efficiency is often seen as identical to performance, we argue that this may not be necessarily the case. A sizable amount of energy could be saved, increasing energy efficiency by leveraging compiler optimizations but at the same time impacting performance and power consumption over time. We analyze the SPEC CPU 2017 benchmark suite with 43 benchmarks from different domains, including integer and floating-point heavy computations on a state-of-the-art server system for cloud applications. Our results show that power consumption displays more stable behavior if less compiler optimizations are used and also confirmed that performance and energy efficiency are different optimizations goals. Additionally, compiler optimizations possibly could be used to enable power capping on a software level and care must be taken when selecting such optimizations.

  @inproceedings{9302787, abstract = {The growth of cloud services leads to more and more data centers that are increasingly larger and consume considerable amounts of power. To increase energy efficiency, both the actual server equipment and the software must become more energy efficient. Software has a major impact on hardware utilization levels, and subsequently, the energy efficiency. While energy efficiency is often seen as identical to performance, we argue that this may not be necessarily the case. A sizable amount of energy could be saved, increasing energy efficiency by leveraging compiler optimizations but at the same time impacting performance and power consumption over time. We analyze the SPEC CPU 2017 benchmark suite with 43 benchmarks from different domains, including integer and floating-point heavy computations on a state-of-the-art server system for cloud applications. Our results show that power consumption displays more stable behavior if less compiler optimizations are used and also confirmed that performance and energy efficiency are different optimizations goals. Additionally, compiler optimizations possibly could be used to enable power capping on a software level and care must be taken when selecting such optimizations.}, author = {Schmitt, Norbert and Bucek, James and Beckett, John and Cragin, Aaron and Lange, Klaus-Dieter and Kounev, Samuel}, booktitle = {2020 IEEE/ACM 13th International Conference on Utility and Cloud Computing (UCC)}, keywords = {power}, month = 12, pages = {292-301}, title = {Performance, Power, and Energy-Efficiency Impact Analysis of Compiler Optimizations on the SPEC CPU 2017 Benchmark Suite}, year = 2020 }

  %0 Conference Paper %1 9302787 %A Schmitt, Norbert %A Bucek, James %A Beckett, John %A Cragin, Aaron %A Lange, Klaus-Dieter %A Kounev, Samuel %B 2020 IEEE/ACM 13th International Conference on Utility and Cloud Computing (UCC) %D 2020 %P 292-301 %T Performance, Power, and Energy-Efficiency Impact Analysis of Compiler Optimizations on the SPEC CPU 2017 Benchmark Suite %U https://ieeexplore.ieee.org/document/9302787/ %X The growth of cloud services leads to more and more data centers that are increasingly larger and consume considerable amounts of power. To increase energy efficiency, both the actual server equipment and the software must become more energy efficient. Software has a major impact on hardware utilization levels, and subsequently, the energy efficiency. While energy efficiency is often seen as identical to performance, we argue that this may not be necessarily the case. A sizable amount of energy could be saved, increasing energy efficiency by leveraging compiler optimizations but at the same time impacting performance and power consumption over time. We analyze the SPEC CPU 2017 benchmark suite with 43 benchmarks from different domains, including integer and floating-point heavy computations on a state-of-the-art server system for cloud applications. Our results show that power consumption displays more stable behavior if less compiler optimizations are used and also confirmed that performance and energy efficiency are different optimizations goals. Additionally, compiler optimizations possibly could be used to enable power capping on a software level and care must be taken when selecting such optimizations.
• 
  Evaluating the Performance of a State-of-the-Art Group-oriented Encryption Scheme for Dynamic Groups in an IoT Scenario. T. Prantl; P. Ten; L. Iffländer; A. Dmitrenko; S. Kounev; C. Krupitzer; in 2020 IEEE 28th International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS) (2020).

  Acceptance Rate: 27%
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  New emerging technologies, such as autonomous driving, intelligent buildings, and smart cities, are promising to revolutionize user experience and offer new services. The world has to undergo large scale deployment of billions of things — cost-efficient intelligent sensors that will be interconnected into extensive networks and will collect and supply data to intelligent algorithms — to make it happen. To date, however, it is challenging to secure such an infrastructure for many-fold reasons, such as resource constraints of things, large scale deployment, manyto-many communication patterns, and dynamically changing communication groups. All these factors rule out most of the state-of-the-art encryption and key-management techniques. Group encryption algorithms are well-suitable for many-tomany communication patterns typical for IoT networks, and many of them can deal with dynamic groups. There are, however, very few constructions that could potentially fulfill the computational and storage constraints of IoT devices while providing sufficient scalability for large networks. The promising candidates, such as construction by Nishat et al. [1], were not evaluated using IoT platforms and under constraints typical for IoT networks. In this paper, we aim to fill this gap and present the evaluation of a state-of-the-art group-oriented encryption scheme by Nishat et al. to identify its applicability to IoT systems. In detail, we provide a measurement workflow, a revised version of the approach, and describe a reproducible hardware testbed. Using this evaluation environment, we analyze the performance of the encryption scheme in a typical IoT scenario from a group member perspective. The results show that all calculation times can be assumed to be constant and are always below 2 seconds. The memory requirement for permanent parameters can also be considered to be constant and are below 8.5 kbit in each case. However, the information that has to be stored temporarily for group updates has turned out to be the bottleneck of the scheme, since their memory requirements increase linearly with the group size.

  @inproceedings{PrTeIfDmKo2020-MASCOTS-GroupEncryption, abstract = {New emerging technologies, such as autonomous driving, intelligent buildings, and smart cities, are promising to revolutionize user experience and offer new services. The world has to undergo large scale deployment of billions of things — cost-efficient intelligent sensors that will be interconnected into extensive networks and will collect and supply data to intelligent algorithms — to make it happen. To date, however, it is challenging to secure such an infrastructure for many-fold reasons, such as resource constraints of things, large scale deployment, manyto-many communication patterns, and dynamically changing communication groups. All these factors rule out most of the state-of-the-art encryption and key-management techniques. Group encryption algorithms are well-suitable for many-tomany communication patterns typical for IoT networks, and many of them can deal with dynamic groups. There are, however, very few constructions that could potentially fulfill the computational and storage constraints of IoT devices while providing sufficient scalability for large networks. The promising candidates, such as construction by Nishat et al. [1], were not evaluated using IoT platforms and under constraints typical for IoT networks. In this paper, we aim to fill this gap and present the evaluation of a state-of-the-art group-oriented encryption scheme by Nishat et al. to identify its applicability to IoT systems. In detail, we provide a measurement workflow, a revised version of the approach, and describe a reproducible hardware testbed. Using this evaluation environment, we analyze the performance of the encryption scheme in a typical IoT scenario from a group member perspective. The results show that all calculation times can be assumed to be constant and are always below 2 seconds. The memory requirement for permanent parameters can also be considered to be constant and are below 8.5 kbit in each case. However, the information that has to be stored temporarily for group updates has turned out to be the bottleneck of the scheme, since their memory requirements increase linearly with the group size.}, author = {Prantl, Thomas and Ten, Peter and Iffländer, Lukas and Dmitrenko, Alexandra and Kounev, Samuel and Krupitzer, Christian}, booktitle = {2020 IEEE 28th International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS)}, keywords = {Performance_Evaluation}, month = 11, note = {Acceptance Rate: 27\%}, series = {MASCOTS '20}, title = {Evaluating the Performance of a State-of-the-Art Group-oriented Encryption Scheme for Dynamic Groups in an IoT Scenario}, year = 2020 }

  %0 Conference Paper %1 PrTeIfDmKo2020-MASCOTS-GroupEncryption %A Prantl, Thomas %A Ten, Peter %A Iffländer, Lukas %A Dmitrenko, Alexandra %A Kounev, Samuel %A Krupitzer, Christian %B 2020 IEEE 28th International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS) %D 2020 %T Evaluating the Performance of a State-of-the-Art Group-oriented Encryption Scheme for Dynamic Groups in an IoT Scenario %X New emerging technologies, such as autonomous driving, intelligent buildings, and smart cities, are promising to revolutionize user experience and offer new services. The world has to undergo large scale deployment of billions of things — cost-efficient intelligent sensors that will be interconnected into extensive networks and will collect and supply data to intelligent algorithms — to make it happen. To date, however, it is challenging to secure such an infrastructure for many-fold reasons, such as resource constraints of things, large scale deployment, manyto-many communication patterns, and dynamically changing communication groups. All these factors rule out most of the state-of-the-art encryption and key-management techniques. Group encryption algorithms are well-suitable for many-tomany communication patterns typical for IoT networks, and many of them can deal with dynamic groups. There are, however, very few constructions that could potentially fulfill the computational and storage constraints of IoT devices while providing sufficient scalability for large networks. The promising candidates, such as construction by Nishat et al. [1], were not evaluated using IoT platforms and under constraints typical for IoT networks. In this paper, we aim to fill this gap and present the evaluation of a state-of-the-art group-oriented encryption scheme by Nishat et al. to identify its applicability to IoT systems. In detail, we provide a measurement workflow, a revised version of the approach, and describe a reproducible hardware testbed. Using this evaluation environment, we analyze the performance of the encryption scheme in a typical IoT scenario from a group member perspective. The results show that all calculation times can be assumed to be constant and are always below 2 seconds. The memory requirement for permanent parameters can also be considered to be constant and are below 8.5 kbit in each case. However, the information that has to be stored temporarily for group updates has turned out to be the bottleneck of the scheme, since their memory requirements increase linearly with the group size.