Enabling Cost Effective SLO Aware Machine Learning Inference Serving On Public Cloud