Class ModelWarmupUtility
- java.lang.Object
-
- com.codedstreams.otterstreams.sql.runtime.ModelWarmupUtility
-
public class ModelWarmupUtility extends Object
Utility for warming up models to avoid cold start latency.- Since:
- 1.0.0
- Author:
- Nestor Martourez Abiangang A.
-
-
Constructor Summary
Constructors Constructor Description ModelWarmupUtility()
-
Method Summary
All Methods Static Methods Concrete Methods Modifier and Type Method Description static voidwarmupModel(String modelName)Warms up a model by running a dummy inference.static voidwarmupModels(String... modelNames)Warms up multiple models.
-