I. INTRODUCTION

II. CHALLENGES & OPPORTUNITIES FOR MULTI-TENANT COMPUTING ON GPU

III. MULTI-TENANT COMPUTING OPTIMIZATION: DESIGN AND INNOVATIONS

IV. TOWARDS LARGE-SCALE DL COMPUTING: VISION AND INSIGHTS

V. CONCLUSION