Bernhard Klein

Bernhard Klein is a fifth-year PhD student at the Computing Systems Group lead by Prof. Dr. Holger Fröning at Heidelberg University. He completed his Master of Science at the Institute for Environmental Physics in 2018. His research interests include code generation, machine learning, probabilistic, approximate and noisy computing and all means of closing the gap between machine learning and embedded devices.

Research interests

  • Probabilistic Machine Learning, especially Bayesian Neural Networks
  • Hardware-aware Machine Learning, includes Neural Architecture Search, Automatic Compression, Machine Learning Compiler,…
  • Embedded Resource-constrained Systems
  • Analog/Optical Energy-efficient Hardware

Recent news (2-year horizon)

  • 03/2023: Invited Talk at the 4th Workshop on Embedded Machine Learning (WEML) - “Galen: HW-specific Automatic Compression”

Recent Service (4-year horizon)

Reviewer

  • 2023: IET Computers & Digital Techniques
  • 2021: ITEM Workshop

Subreviewer

  • 2024: International Conference on Supercomputing (ICS)
  • 2023: Conference on Parallel Processing (ICPP)
  • 2022: International Conference on Field-Programmable Logic and Applications (FPL)
  • 2021: Conference on Parallel Processing (ICPP)
  • 2021: International Conference on Field-Programmable Logic and Applications (FPL)
  • 2020: International Conference on Field-Programmable Logic and Applications (FPL)

Recent Teaching (4-year horizon)

Summer term 2024 Lecturer - graduate course “Embedded Machine Learning (2+2)”*

Publications

  1. Lisa Kuhn, Bernhard Klein and Holger Fröning
    On the Non-Associativity of Analog Computations
    CoRR, abs/2309.14292, 2023
    @article{DBLP:journals/corr/abs-2309-14292,
      author = {Kuhn, Lisa and Klein, Bernhard and Fr{\"{o}}ning, Holger},
      title = {On the Non-Associativity of Analog Computations},
      journal = {CoRR},
      volume = {abs/2309.14292},
      year = {2023},
      url = {https://doi.org/10.48550/arXiv.2309.14292}
      doi = {10.48550/ARXIV.2309.14292},
      eprinttype = {arXiv},
      eprint = {2309.14292},
      timestamp = {Wed, 27 Sep 2023 01:00:00 +0200},
    }
    
  2. Torben Krieger, Bernhard Klein and Holger Fröning
    Towards Hardware-Specific Automatic Compression of Neural Networks
    CoRR, abs/2212.07818, 2022
    @article{DBLP:journals/corr/abs-2212-07818,
      author = {Krieger, Torben and Klein, Bernhard and Fr{\"{o}}ning, Holger},
      title = {Towards Hardware-Specific Automatic Compression of Neural Networks},
      journal = {CoRR},
      volume = {abs/2212.07818},
      year = {2022},
      url = {https://doi.org/10.48550/arXiv.2212.07818}
      doi = {10.48550/ARXIV.2212.07818},
      eprinttype = {arXiv},
      eprint = {2212.07818},
      timestamp = {Mon, 02 Jan 2023 00:00:00 +0100},
    }
    
  3. Hendrik Borras, Bernhard Klein and Holger Fröning
    Walking Noise: Understanding Implications of Noisy Computations on Classification Tasks
    CoRR, abs/2212.10430, 2022
    @article{DBLP:journals/corr/abs-2212-10430,
      author = {Borras, Hendrik and Klein, Bernhard and Fr{\"{o}}ning, Holger},
      title = {Walking Noise: Understanding Implications of Noisy Computations on
                        Classification Tasks},
      journal = {CoRR},
      volume = {abs/2212.10430},
      year = {2022},
      url = {https://doi.org/10.48550/arXiv.2212.10430}
      doi = {10.48550/ARXIV.2212.10430},
      eprinttype = {arXiv},
      eprint = {2212.10430},
      timestamp = {Wed, 04 Jan 2023 00:00:00 +0100},
    }
    
  4. Bernhard Klein, Lisa Kuhn, Johannes Weis, Arne Emmel, Yannik Stradmann, Johannes Schemmel and Holger Fröning
    Towards Addressing Noise and Static Variations of Analog Computations Using Efficient Retraining
    Communications in Computer and Information Science,Machine Learning and Principles and Practice of Knowledge Discovery in Databases - International Workshops of ECML PKDD 2021, Virtual Event, September 13-17, 2021, Proceedings, Part I, 1524, 409–420, Springer, 2021
    @inproceedings{DBLP:conf/pkdd/KleinKWESSF21,
      author = {Klein, Bernhard and Kuhn, Lisa and Weis, Johannes and Emmel, Arne and Stradmann, Yannik and Schemmel, Johannes and Fr{\"{o}}ning, Holger},
      editor = {Kamp, Michael and Koprinska, Irena and Bibal, Adrien and Bouadi, Tassadit and Fr{\'{e}}nay, Beno{\^{\i}}t and Gal{\'{a}}rraga, Luis and Oramas, Jos{\'{e}} and Adilova, Linara and Krishnamurthy, Yamuna and Kang, Bo and Largeron, Christine and Lijffijt, Jefrey and Viard, Tiphaine and Welke, Pascal and Ruocco, Massimiliano and Aune, Erlend and Gallicchio, Claudio and Schiele, Gregor and Pernkopf, Franz and Blott, Michaela and Fr{\"{o}}ning, Holger and Schindler, G{\"{u}}nther and Guidotti, Riccardo and Monreale, Anna and Rinzivillo, Salvatore and Biecek, Przemyslaw and Ntoutsi, Eirini and Pechenizkiy, Mykola and Rosenhahn, Bodo and Buckley, Christopher L. and Cialfi, Daniela and Lanillos, Pablo and Ramstead, Maxwell and Verbelen, Tim and Ferreira, Pedro M. and Andresini, Giuseppina and Malerba, Donato and Medeiros, Ib{\'{e}}ria and Fournier{-}Viger, Philippe and Nawaz, M. Saqib and Ventura, Sebasti{\'{a}}n and Sun, Meng and Zhou, Min and Bitetta, Valerio and Bordino, Ilaria and Ferretti, Andrea and Gullo, Francesco and Ponti, Giovanni and Severini, Lorenzo and Ribeiro, Rita P. and Gama, Jo{\~{a}}o and Gavald{\`{a}}, Ricard and Cooper, Lee A. D. and Ghazaleh, Naghmeh and Richiardi, Jonas and Roqueiro, Damian and Miranda, Diego Saldana and Sechidis, Konstantinos and Gra{\c{c}}a, Guilherme},
      title = {Towards Addressing Noise and Static Variations of Analog Computations
                        Using Efficient Retraining},
      booktitle = {Machine Learning and Principles and Practice of Knowledge Discovery
                        in Databases - International Workshops of {ECML} {PKDD} 2021, Virtual
                        Event, September 13-17, 2021, Proceedings, Part {I}},
      series = {Communications in Computer and Information Science},
      volume = {1524},
      pages = {409--420},
      publisher = {Springer},
      year = {2021},
      url = {https://doi.org/10.1007/978-3-030-93736-2\_32}
      doi = {10.1007/978-3-030-93736-2\_32},
      timestamp = {Tue, 15 Mar 2022 00:00:00 +0100},
    }
    
  5. Bernhard Klein, Christoph Gratl, Manfred Mücke and Holger Fröning
    Understanding Cache Boundness of ML Operators on ARM Processors
    CoRR, abs/2102.00932, 2021
    @article{DBLP:journals/corr/abs-2102-00932,
      author = {Klein, Bernhard and Gratl, Christoph and M{\"{u}}cke, Manfred and Fr{\"{o}}ning, Holger},
      title = {Understanding Cache Boundness of {ML} Operators on {ARM} Processors},
      journal = {CoRR},
      volume = {abs/2102.00932},
      year = {2021},
      url = {https://arxiv.org/abs/2102.00932}
      eprinttype = {arXiv},
      eprint = {2102.00932},
      timestamp = {Thu, 14 Oct 2021 01:00:00 +0200},
    }