Class InferenceEngine.EngineCapabilities

  • Enclosing interface:
    InferenceEngine<T>

    public static class InferenceEngine.EngineCapabilities
    extends Object
    Describes the capabilities of an inference engine.

    Use this to determine what features are supported before using them.

    • Constructor Detail

      • EngineCapabilities

        public EngineCapabilities​(boolean supportsBatching,
                                  boolean supportsGPU,
                                  int maxBatchSize,
                                  boolean supportsStreaming)
        Constructs engine capabilities.
        Parameters:
        supportsBatching - whether batch inference is supported
        supportsGPU - whether GPU acceleration is available
        maxBatchSize - maximum batch size (0 if unlimited)
        supportsStreaming - whether streaming inference is supported
    • Method Detail

      • supportsBatching

        public boolean supportsBatching()
      • supportsGPU

        public boolean supportsGPU()
      • getMaxBatchSize

        public int getMaxBatchSize()
      • supportsStreaming

        public boolean supportsStreaming()