Publications

2023

Exoshuffle-CloudSort.

Frank Sifei Luan, Stephanie Wang, Samyukta Yagati, Sean Kim, Kenneth Lien, Isaac Ong, Tony Hong, SangBin Cho, Eric Liang, Ion Stoica:
Exoshuffle-CloudSort. CoRR abs/2301.03734 (2023)

AlpaServe: Statistical Multiplexing with Model Parallelism for Deep Learning Serving.

Zhuohan Li, Lianmin Zheng, Yinmin Zhong, Vincent Liu, Ying Sheng, Xin Jin, Yanping Huang, Zhifeng Chen, Hao Zhang, Joseph E. Gonzalez, Ion Stoica:
AlpaServe: Statistical Multiplexing with Model Parallelism for Deep Learning Serving. CoRR abs/2302.11665 (2023)

Exploiting Programmatic Behavior of LLMs: Dual-Use Through Standard Security Attacks.

Daniel Kang, Xuechen Li, Ion Stoica, Carlos Guestrin, Matei Zaharia, Tatsunori Hashimoto:
Exploiting Programmatic Behavior of LLMs: Dual-Use Through Standard Security Attacks. CoRR abs/2302.05733 (2023)

High-throughput Generative Inference of Large Language Models with a Single GPU.

Ying Sheng, Lianmin Zheng, Binhang Yuan, Zhuohan Li, Max Ryabinin, Daniel Y. Fu, Zhiqiang Xie, Beidi Chen, Clark W. Barrett, Joseph E. Gonzalez, Percy Liang, Christopher Ré, Ion Stoica, Ce Zhang:
High-throughput Generative Inference of Large Language Models with a Single GPU. CoRR abs/2303.06865 (2023)

2022

Reliable Transactions in Serverless-Edge Architecture

Published: ICDE'23 (IEEE International Conference on Data Engineering)

Authors Suyash Gupta, Sajjad Rahnama, Erik Linsenmayer, Faisal Nawab, Mohammad Sadoghi

Reliable Transactions in Serverless-Edge Architecture

Modern edge applications demand novel solutions where edge applications do not have to rely on a single cloud provider (which cannot be in the vicinity of every edge device) or dedicated edge servers (which cannot scale as clouds) for processing compute-intensive tasks. A recent computing philosophy, Sky computing, proposes giving each user ability to select between available cloud providers.

In this paper, we present our serverless-edge co-design, which extends the Sky computing vision. In our serverless-edge co-design, we expect edge devices to collaborate and spawn required number of serverless functions. This raises several key challenges: (1) how will this collaboration take place, (2) what if some edge devices are compromised, and (3) what if a selected cloud provider is malicious. Hence, we design ServerlessBFT, the first protocol to guarantee Byzantine fault-tolerant (BFT) transactional flow between edge devices and serverless functions. We present an exhaustive list of attacks and their solutions on our serverless-edge co-design. Further, we extensively benchmark our architecture on a variety of parameters.

Jiffy: elastic far-memory for stateful serverless analytics

A Khandelwal, Y Tang, R Agarwal, A Akella, I Stoica Proceedings of the Seventeenth European Conference on Computer Systems (Eurosys’22)

Technology ecosystems often undergo significant transformations as they mature. For example, telephony, the Internet, and PCs all started with a single provider, but in the United States each is now served by a competitive market that uses comprehensive and universal technology standards to provide compatibility. This white paper presents our view on how the cloud ecosystem, barely over fifteen years old, could evolve as it matures.

CostCO: An automatic cost modeling framework for secure multi-party computation

Vivian Fang, Lloyd Brown, William Lin, Wenting Zheng, Aurojit Panda, Raluca Ada Popa

New Directions in Cloud Programming

11th Conference on Innovative – 11th Conference on Innovative Data Systems Research, CIDR 2021 Data Systems Research, CIDR 2021 – Cheung, A.; Crooks, N.; Hellerstein, J. M.; and Milano, M.

Serverless Boom or Bust? An Analysis of Economic Incentives

12th USENIX Workshop on Hot Topics in Cloud Computing (HotCloud) -Charles Lin, Joseph E. Gonzalez, and Joseph M. Hellerstein.

Synthesizing CRDTs from Sequential Data Types with Verified Lifting.

Shadaj Laddad, Conor Power, Mae Milano, Alvin Cheung, Joseph M. Hellerstein:
Synthesizing CRDTs from Sequential Data Types with Verified Lifting. CoRR abs/2205.12425 (2022)

Keep CALM and CRDT On.

Shadaj Laddad, Conor Power, Mae Milano, Alvin Cheung, Natacha Crooks, Joseph M. Hellerstein:
Keep CALM and CRDT On. Proc. VLDB Endow. 16(4): 856-863 (2022)

CostCO: An automatic cost modeling framework for secure multi-party computation.

Vivian Fang, Lloyd Brown, William Lin, Wenting Zheng, Aurojit Panda, Raluca Ada Popa:
CostCO: An automatic cost modeling framework for secure multi-party computation. EuroS&P 2022: 140-153

2021

Snoopy: Surpassing the Scalability Bottleneck of Oblivious Storage

E Dauterman, V Fang, I Demertzis, N Crooks, RA Popa Proceedings of the ACM SIGOPS 28th Symposium on Operating Systems Principles

Basil: Breaking up BFT with ACID (transactions)

Florian Suri-Payer, Matthew Burke, Zheng Wang, Yunhao Zhang, Lorenzo Alvisi, Natacha Crooks Proceedings of the ACM SIGOPS 28th Symposium on Operating Systems Principles