Semi-supervised approach for inference serving at the edge