Class InferenceEngine.EngineCapabilities
- java.lang.Object
-
- com.codedstream.otterstream.inference.engine.InferenceEngine.EngineCapabilities
-
- Enclosing interface:
- InferenceEngine<T>
public static class InferenceEngine.EngineCapabilities extends Object
Describes the capabilities of an inference engine.Use this to determine what features are supported before using them.
-
-
Constructor Summary
Constructors Constructor Description EngineCapabilities(boolean supportsBatching, boolean supportsGPU, int maxBatchSize, boolean supportsStreaming)Constructs engine capabilities.
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description intgetMaxBatchSize()booleansupportsBatching()booleansupportsGPU()booleansupportsStreaming()
-
-
-
Constructor Detail
-
EngineCapabilities
public EngineCapabilities(boolean supportsBatching, boolean supportsGPU, int maxBatchSize, boolean supportsStreaming)Constructs engine capabilities.- Parameters:
supportsBatching- whether batch inference is supportedsupportsGPU- whether GPU acceleration is availablemaxBatchSize- maximum batch size (0 if unlimited)supportsStreaming- whether streaming inference is supported
-
-