Mobirise

Dmitrii Ustiugov

I am an Assistant Professor at Nanyang Technological University (NTU) Singapore. My work spans the domains of computer systems and architecture with a focus on designing fast, scalable, and resource-efficient cloud systems. My current research projects target cloud and serverless architectures, and system support for large-scale LLM inference serving.

I am leading the vHive open-source ecosystem for serverless experimentation and innovation across the deep distributed HW/SW stack used in 30+ academic and 8+ industry organisations.

Bio: I received a PhD degree in Computer Science from the University of Edinburgh where was co-advised by Profs. Boris Grot and Edouard Bugnion (EPFL). Previously, I was a Postdoctoral Researcher at ETH Zurich with Prof. Ana Klimovic. I feature in the list of 35 Innovators Under 35 (Visionary category, Asia-Pacific) 2024 by MIT Technology Review for spearheading  open-source works.

HIRING: I am looking for motivated PhD students and Research Assistants/Associates.
News 2024: 2 open Research Fellow (postdoc) positions! 

Mobirise

Hyperscale Systems and Cloud Architecture lab
NTU Singapore

Interested in Cloud Systems Research?

Open Positions: PhD students (August 2025 intake), Research Associate/Assistants, and a Research Fellow (aka Postdoc)
Do you love prototyping and hacking systems? Wonder what is under the hood of a modern cloud? Or just curious what the future of computing holds? I have a number of fully-funded PhD student positions for research in cloud/serverless/edge computing and systems for machine learning.

Qualifications
A strong applicant must have a MSc or BSc degree in computer science, electrical or computer engineering with a solid GPA. Background in programming, and systems programming in particular, as well as understanding of operating systems, networking, and/or computer architecture are key. Experience in research or working with open-source projects are desirable.

Why Join NTU Singapore?
NTU is a top international university ranked #9 in Computer Science, #15 overall in QS rankings. Singapore is an excellent place for research, comfortable and safe environment for daily life, and a melting pot of the western and eastern cultures.

PhD student and RA applications: Please send me an email attaching your CV. Prospective students should also send me the transcripts (including BSc), motivation letter, as well as a TOEFL (or IELTS) certificate. If you miss any documents (e.g., TOEFL) at the moment of contacting me, please elaborate on your plans to obtain them. Note, all these documents are mandatory, no exceptions are possible. Also, some applicants might need to obtain GRE (please contact me first). Only shortlisted applicants will be notified.
Note for the PhD applicants from Mainland China, we seek primarily MSc degree holders (due to the funding reasons) but we will also consider strong BSc applicants. 

Postdoc/RF applications (we have 2 open positions!): Please send me an email with a CV. Note that applicants must (co-)author at least one paper in the venues listed in csrankings.org. Only shortlisted applicants will be notified.

Funding Opportunities for PhD Students
(contact me before applying)
Nanyang President's Graduate for all
SINGA for international students
Alibaba-NTU for Singaporeans and PRs
A*STAR Graduate (AGS) for Singaporeans and Singaporean Uni graduates
AISG PhD fellowship for all
A*STAR Computing and Information Science (ACIS) for all
SIMTech-NTU for all
Other NTU scholarships

International PhD exchange scholarships 
(contact me before applying)
A*STAR Research Attachment Programme (ARAP) for current international PhD students

Funding Opportunities for PostDocs 
(contact me before applying)
A*STAR International fellowship for Singaporeans
Lee Kuan Yew Postdoctoral fellowship (LKYPDF) for Singaporeans
NTU Presidential Postdoctoral Fellowship (PPF) for all
NTU Research Assistant Professor (RAP) for all
Maria Curie (MSCA) for EU and UK graduates (but not only)
Schmidt AI in Science for all

Send an Email

Research Directions

There are three principal means of acquiring knowledge available to us: observation of nature, reflection, and experimentation. Observation collects facts; reflection combines them; experimentation verifies the result of that combination.
Denis Diderot, On the Interpretation of Nature

Mobirise

Cloud & Serverless

Explore trade-offs in performance, security, and efficiency of next-generation cloud systems
Learn more about Serverless & vHive

Mobirise

Serverless GenAI

Explore efficient Generative AI inference, e.g., LLM, RAG, at scale by exploiting heterogeneous hardware and HW/SW co-design.

Mobirise

Cloud-Edge Systems

Design a geo-distributed OS for emerging edge apps, e.g., Retrieval-Augmented Generation, video analytics, autonomous vehicles.

vHive Serverless Ecosystem 

vHive
Join the vHive Open-Source Community

vHive is a full-stack open-source framework & ecosystem for serverless experimentation and innovation. vHive is representative of real serverless clouds, as recognized by leading serverless providers and an ASPLOS'21 Distinguished Artifact Award, integrating production-grade components, including AWS Firecracker, Containerd and Kubernetes.

Today, vHive is in use in 30+ top universities around the globe, for both research and teaching, supported and/or sponsored by 8 international IT companies.

vHive tutorials featured at SOSP'23 (slides) and ASPLOS'22 (YouTube).

Learn more GitHub

Selected Publications (More)

There is a time for many words, and there is also a time for sleep.
Homer, The Odyssey

  • ServerlessLLM: Locality-Enhanced Serverless Inference for Large Language Models. Y. Fu, L. Xue, Y. Huang, A.-O. Brabete, D. Ustiugov, Y. Patel, L. Mai. OSDI'24. 
    PDF GitHub
  • Enabling In-Vitro Serverless Systems Research. D. Ustiugov, D. Park, L. Cvetković, M. Djokic, H. Hè, B. Grot, A. Klimovic. WORDS@SOSP'23
    PDF GitHub
  • Lukewarm Serverless Functions: Characterization and Optimization. D. Schall, A. Margaritov, D. Ustiugov, A. Sandberg, B. Grot. ISCA'22
    IEEE Micro Top Picks Honorable Mention
    PDF GitHub
  • Analyzing Tail Latency in Serverless Clouds with STeLLAR. D.Ustiugov, T.Amariucai, B.Grot. IISWC'21
    PDF Video GitHub
  • Benchmarking, Analysis, and Optimization of Serverless Function Snapshots. D.Ustiugov, P.Petrov, M.Kogias, E.Bugnion, B.Grot. ASPLOS'21, Distinguished Artifact Award
    PDF Video GitHub
  • PTEMagnet: Fine-Grained Physical Memory Reservation for Faster Page Walks in Public Clouds. A.Margaritov, D.Ustiugov, A.Shahab, B.Grot. ASPLOS'21
    PDF Video GitHub
  • Prefetched Address Translation. A.Margaritov, D.Ustiugov, E.Bugnion, B.Grot. MICRO'19
    PDF

Teaching & Supervision

It is the supreme art of the teacher to awaken joy in creative expression and knowledge.
Albert Einstein

  • Operating Systems. Lecturer and tutor, 2023-ongoing. NTU Singapore.
  • Digital Logic. Lecturer and tutor, 2023-ongoing. NTU Singapore.
  • Cloud Computing Architecture. Invited lecturer, Spring'22. ETH Zurich.
  • Extreme Computing. Invited lecturer, Fall'21. University of Edinburgh. [Slides]
  • Operating Systems. Invited lecturer, Spring'21. University of Edinburgh. [Slides]
  • Systems Programming and Computer Architecture, Teaching assistant, Fall'22, ETH Zurich.
  • Introduction to Computer Systems, Teaching assistant, Fall'19, '20, University of Edinburgh.
  • Extreme Computing, Teaching assistant, Fall'19, University of Edinburgh.
  • Computer Architecture, Teaching assistant, Fall'15, '17, EPFL.
  • Statistics, Teaching assistant, Spring'16, EPFL.
  • Introduction to Multiprocessor Architecture, Teaching assistant, Spring'15, EPFL.

Students, Research Staff, and Interns

PhD students
Leonid Kondrashov (MIPT), 2023-ongoing.
Ruiqi Lai (SJTU, China), 2023-ongoing.
JooYoung Park (Korea University, South Korea), 2023-ongoing.
Yulin Zou (NTU), 2024-ongoing.
Junke Mao (NTU), 2024-ongoing.
Hongrui Liu (Beihang University), 2024-ongoing.
Colin Hong (NTU) 2025-ongoing.

Research Assistants
Yixin Zhang (NTU MSc; SJTU, China BSc), 2024-ongoing
Siyu Cao (NTU MSc; BJTU, China BSc)

Exchange PhD students
Junyi Chen (Hong Kong Polytechnic University), 2024-2025. 

Alumni
Vlad Pandelea (NTU; University of Pisa, Italy), postdoc, 2024. 1st employment at American Express.
Hancheng Wang (Nanjing University), exchange PhD, 2023-2024.

URECA
Siyang Shao 2023-2024

Final Year Projects (FYP)
Batch 2024-2025
Aryan Sharma
Chaanan Anand Singh
Dhairya Rungta
Greg Lim
Ian Yeoh
Jia Xuan Koh
Kavita Sriram
Kavithran Ravisankar
Lenson Lim
Siyang Shao

Batch 2023-2024
Benjamin Chun
Colin Hong
Jason Chua
Min Kabar Kyaw
Lee Xuan Hua
Sokunthea Eang
Yan Kai Lim
Xingjian Li
Yi Pun Wong
Yi Shen Kwai

Aiza Maksutova (HSE), 2023-2024.
Dohyun Park (Korea University, South Korea), 2023.
Georgiy Lebedev (MIPT), 2023.
Haoyuan Ma (Zhejiang University, China), 2023.
Anshal Shukla (BITS Pilani, India), 2023.

Past Students and Projects

Lazar Cvetković, PhD Student (with Prof. Klimovic), ETH Zurich, 2021-2022.
Project: Scheduling policy exploration for serverless clouds.

Foteini Strati, PhD Student (with Prof. Klimovic), ETH Zurich, 2022.
Project: Cloud and serverless computing support for large-scale machine learning.

Hongyu He, Master Student (with Prof. Klimovic), ETH Zurich, 2021-2022.
Project: Methodology for performance analysis of large-scale serverless clusters.

Mihajlo Djokic, Master Student (with Prof. Klimovic), ETH Zurich, 2021-2022.
Project: Large-scale serverless cloud simulation for rapid design exploration.

Yijun Ma, Master Student (with Prof. Klimovic), ETH Zurich, 2021.
Project: Edge computing with a serverless programming model.

Tom Kuchler, PhD Student (with Prof. Klimovic), ETH Zurich, 2021-2022.
Project: Scheduling policy exploration for serverless clouds.

Shyam Jesalpura, Research Intern, BITS Pilani, 2021.
Project: High-speed communication fabric for serverless clouds.

Mert Bora Alper, Undergraduate Intern, University of Edinburgh, 2021.
Project: Benchmarking methodology for serverless clouds.

Michal Baczun, Undergraduate Intern, University of Edinburgh, 2021.
Project: Representative suite of serverless workloads.

Yuchen Niu, Undergraduate Student, University of Edinburgh, 2020-2021.
Project: Implications of multi-tenancy on serverless hosts.

Theodor Amariucai, Undergraduate Student, University of Edinburgh, 2020-2021.
Project: Tail latency analysis framework for serverless clouds.

Plamen Petrov, Undergraduate Student & Intern, University of Edinburgh, 2020.
Project 1: End-to-end serverless benchmarking framework.
Project 2: RDMA networks security and covert communication.

Ivy Wang, Undergraduate Student, University of Edinburgh, 2019.
Project: Software support for contiguous page table allocation.

Sean Mullan, Undergraduate Student, University of Edinburgh, 2019.
Project: Design exploration for TLB prefetching.

Lei Yan, Master Student, EPFL and RWTH Aachen University, 2018.
Project: Design space exploration of cooperative scheduling for latency-critical cloud services.

Siddharth Gupta, PhD Student, EPFL, 2017.
Project: Analysis of persistent memory systems on modern CPUs.

Nikhil Gupta, Undergraduate Intern, EPFL and IIT Delhi, 2016.
Project: Robust infrastructure for QFlex (Flexus) simulation framework.

Virgile Neu, Undergraduate Student, EPFL, 2016.
Project: Analyzing CPU front-end efficiency using perf counters. 

Collaboration & Funding

I thank my past and present collaborators round the globe for their professional and financial support.

Previous Next
  1. Sept. 2024: We have kicked off collaboration projects with AWS (UK), Microsoft Azure (USA), AMD (Singapore) to work on the large-scale serverless cloud and LLM inference serving systems.
  2. Singapore MoE Tier-2 grant (S$661k) for the project, called "Serverless Programming Model and Cloud Resource Virtualization Co-Design for High Performance and Efficiency".
  3. Arm generously provided 3-year fellowship at the University of Edinburgh, supporting our work on "Virtual Memory Software-Hardware Co-Design for Cloud Computing".
  4. Google generously provided one-year Faculty Award (2019) for "Neural Address Translation" project at University of Edinburgh based on the research proposal written together with Prof. Boris Grot and my colleague Artemiy Margaritov.
  5. Oracle Labs generously provided one-year (2018) gift funding for the joint "Disaggregated processors" project at EPFL based on the research proposal I wrote with the help of Prof. Alex Daglis and Prof. Babak Falsafi.

Professional Activities

  • TPC member: ATC'25 (light), SoCC'24, OSDI'24, ATC'24 (light), ASPLOS'24 (light), SoCC'23, FedEdge'23, MICRO'22.
  • Co-chair of the 1st and 2nd SESAME workshop at EuroSys 2023, 2024.
  • The head organizer of the Serverless & vHive Tutorial series at ASPLOS'22 and SOSP'23.
  • External reviewer at ATC'19, ISCA'19, CAL'19, 20; MDPI JLPEA'22, MDPI Electronics'22, TCC'24.
  • EuroSys'21 ShadowPC member.
  • SOSP'21 session co-chair.
  • Artifact Evaluation: co-chair at HPCA'24,  committee member at JSys'22, ASPLOS'20.

Awards and Recognition

  • Featured in the list of 35 Innovators Under 35 (Visionary category, Asia-Pacific) 2024 by MIT Technology Review for many recognized open-source contributions, such as vHive and ServerlessLLM.
  • IEEE Micro Top Picks Honorable Mention 2023.
  • ASPLOS'21 Distinguished Artifact Award.
  • The winner of the 1-minute thesis pitch competition at the JOBS workshop at MICRO'20.
  • Arm Center of Excellence Fellowship, 2019.
  • EPFL PhD Fellowship, 2014.

© Copyright Dmitrii Ustiugov - All Rights Reserved
The HyScale logo was designed by Anna Kondrashova.

‌

Best AI Website Maker