Author(s): Aditya Kumar Manethia
Originally published on Towards AI.
Photo by Manja Vitolic on Unsplash
If you are learning Machine Learning, you have probably lived this exact scenario: You spend hours cleaning a dataset, you build a PyTorch model, you run model.fit() , and after watching the progress bar for hours, your model finally reaches 95% accuracy.
But if you take that 95% accurate model and deploy it in a real-time web app, a trading algorithm, or a self-driving car, it might take five seconds just to process a single image. The user gets frustrated, the trade is missed, the car crashes.
