Uses of Interface
com.codedstream.otterstream.inference.engine.InferenceEngine

Packages that use InferenceEngine

Package	Description
com.codedstream.otterstream.inference.engine
com.codedstream.otterstream.inference.function
com.codedstream.otterstream.onnx
com.codedstream.otterstream.pmml
com.codedstream.otterstream.pytorch
com.codedstream.otterstream.remote
com.codedstream.otterstream.remote.http
com.codedstream.otterstream.remote.sagemaker
com.codedstream.otterstream.remote.vertex
com.codedstream.otterstream.tensorflow
com.codedstream.otterstream.xgboost
com.codedstreams.otterstreams.sql.loader
com.codedstreams.otterstreams.sql.metadata
com.codedstreams.otterstreams.sql.runtime

Uses of InferenceEngine in com.codedstream.otterstream.inference.engine

Classes in com.codedstream.otterstream.inference.engine that implement InferenceEngine

Modifier and Type	Class	Description
class	LocalInferenceEngine<T>	Abstract base class for local inference engines that load models from files.

Uses of InferenceEngine in com.codedstream.otterstream.inference.function

Constructor parameters in com.codedstream.otterstream.inference.function with type arguments of type InferenceEngine

Constructor	Description
AsyncModelInferenceFunction(InferenceConfig inferenceConfig, Function<InferenceConfig,InferenceEngine<?>> engineFactory)	Constructs async inference function.

Uses of InferenceEngine in com.codedstream.otterstream.onnx

Classes in com.codedstream.otterstream.onnx that implement InferenceEngine

Modifier and Type	Class	Description
class	OnnxInferenceEngine	ONNX Runtime implementation of LocalInferenceEngine for ML inference.

Uses of InferenceEngine in com.codedstream.otterstream.pmml

Classes in com.codedstream.otterstream.pmml that implement InferenceEngine

Modifier and Type	Class	Description
class	PmmlInferenceEngine	PMML (Predictive Model Markup Language) implementation of LocalInferenceEngine.

Uses of InferenceEngine in com.codedstream.otterstream.pytorch

Classes in com.codedstream.otterstream.pytorch that implement InferenceEngine

Modifier and Type	Class	Description
class	TorchScriptInferenceEngine	TorchScript (PyTorch) implementation of LocalInferenceEngine using Deep Java Library (DJL).

Uses of InferenceEngine in com.codedstream.otterstream.remote

Classes in com.codedstream.otterstream.remote that implement InferenceEngine

Modifier and Type	Class	Description
class	RemoteInferenceEngine	Abstract base class for remote inference engines communicating with external model endpoints.

Uses of InferenceEngine in com.codedstream.otterstream.remote.http

Classes in com.codedstream.otterstream.remote.http that implement InferenceEngine

Modifier and Type	Class	Description
class	HttpInferenceClient	HTTP-based remote inference client for REST API model endpoints.

Uses of InferenceEngine in com.codedstream.otterstream.remote.sagemaker

Classes in com.codedstream.otterstream.remote.sagemaker that implement InferenceEngine

Modifier and Type	Class	Description
class	SageMakerInferenceClient	AWS SageMaker remote inference client for hosted ML models.

Uses of InferenceEngine in com.codedstream.otterstream.remote.vertex

Classes in com.codedstream.otterstream.remote.vertex that implement InferenceEngine

Modifier and Type	Class	Description
class	VertexAIInferenceClient	Google Vertex AI remote inference client for Google Cloud ML models.

Uses of InferenceEngine in com.codedstream.otterstream.tensorflow

Classes in com.codedstream.otterstream.tensorflow that implement InferenceEngine

Modifier and Type	Class	Description
class	TensorFlowInferenceEngine	TensorFlow SavedModel inference engine using TensorFlow Java API.

Uses of InferenceEngine in com.codedstream.otterstream.xgboost

Classes in com.codedstream.otterstream.xgboost that implement InferenceEngine

Modifier and Type	Class	Description
class	XGBoostInferenceEngine	XGBoost inference engine for gradient boosting tree models.

Uses of InferenceEngine in com.codedstreams.otterstreams.sql.loader

Methods in com.codedstreams.otterstreams.sql.loader that return InferenceEngine

Modifier and Type	Method	Description
InferenceEngine<?>	ModelCache.getEngine(String modelName)
InferenceEngine<?>	ModelRegistrationManager.registerAndLoadModel(SqlInferenceConfig config)	Registers and loads a model from configuration.
InferenceEngine<?>	ModelRegistrationManager.reloadModel(String modelName, SqlInferenceConfig newConfig)	Reloads a model with new configuration.

Methods in com.codedstreams.otterstreams.sql.loader with parameters of type InferenceEngine

Modifier and Type	Method	Description
void	ModelCache.putEngine(String modelName, InferenceEngine<?> engine)

Uses of InferenceEngine in com.codedstreams.otterstreams.sql.metadata

Methods in com.codedstreams.otterstreams.sql.metadata with parameters of type InferenceEngine

Modifier and Type	Method	Description
static InputOutputSchema	InputOutputSchemaExtractor.extractSchema(InferenceEngine<?> engine)	Extracts schema from inference engine.

Uses of InferenceEngine in com.codedstreams.otterstreams.sql.runtime

Classes in com.codedstreams.otterstreams.sql.runtime that implement InferenceEngine

Modifier and Type	Class	Description
class	TensorFlowGraphDefEngine	TensorFlow GraphDef (frozen graph) inference engine.
class	TensorFlowSavedModelEngine	TensorFlow SavedModel inference engine.

Methods in com.codedstreams.otterstreams.sql.runtime that return InferenceEngine

Modifier and Type	Method	Description
static InferenceEngine<?>	InferenceEngineFactory.createEngine(ModelConfig config)
InferenceEngine<?>	ModelHealthChecker.HealthStatus.getEngine()

Methods in com.codedstreams.otterstreams.sql.runtime with parameters of type InferenceEngine

Modifier and Type	Method	Description
void	ModelHealthChecker.registerModel(String modelName, InferenceEngine<?> engine)

Constructors in com.codedstreams.otterstreams.sql.runtime with parameters of type InferenceEngine

Constructor	Description
BatchInferenceProcessor(InferenceEngine<?> engine, int batchSize, long batchTimeoutMs)
HealthStatus(String modelName, InferenceEngine<?> engine)