Package com.codedstreams.otterstreams.sql.runtime

Class BatchInferenceProcessor

java.lang.Object

com.codedstreams.otterstreams.sql.runtime.BatchInferenceProcessor

public class BatchInferenceProcessor
extends Object

Batches inference requests for improved throughput.

Since:

1.0.0

Author:

Nestor Martourez Abiangang A.

Constructor Summary

Constructors

Constructor	Description
BatchInferenceProcessor(InferenceEngine<?> engine, int batchSize, long batchTimeoutMs)

Method Summary

Modifier and Type	Method	Description
void	start()
void	stop()
InferenceResult	submitAndWait(Map<String,Object> features)	Submits an inference request and waits for result.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

BatchInferenceProcessor

public BatchInferenceProcessor(InferenceEngine<?> engine,
                               int batchSize,
                               long batchTimeoutMs)

Method Detail

start

public void start()

stop

public void stop()

submitAndWait

public InferenceResult submitAndWait(Map<String,Object> features)
                              throws InterruptedException

Submits an inference request and waits for result.

Throws:

InterruptedException