Uses of Interface
com.codedstream.otterstream.inference.engine.InferenceEngine
-
-
Uses of InferenceEngine in com.codedstream.otterstream.inference.engine
Classes in com.codedstream.otterstream.inference.engine that implement InferenceEngine Modifier and Type Class Description classLocalInferenceEngine<T>Abstract base class for local inference engines that load models from files. -
Uses of InferenceEngine in com.codedstream.otterstream.inference.function
Constructor parameters in com.codedstream.otterstream.inference.function with type arguments of type InferenceEngine Constructor Description AsyncModelInferenceFunction(InferenceConfig inferenceConfig, Function<InferenceConfig,InferenceEngine<?>> engineFactory)Constructs async inference function. -
Uses of InferenceEngine in com.codedstream.otterstream.onnx
Classes in com.codedstream.otterstream.onnx that implement InferenceEngine Modifier and Type Class Description classOnnxInferenceEngineONNX Runtime implementation ofLocalInferenceEnginefor ML inference. -
Uses of InferenceEngine in com.codedstream.otterstream.pmml
Classes in com.codedstream.otterstream.pmml that implement InferenceEngine Modifier and Type Class Description classPmmlInferenceEnginePMML (Predictive Model Markup Language) implementation ofLocalInferenceEngine. -
Uses of InferenceEngine in com.codedstream.otterstream.pytorch
Classes in com.codedstream.otterstream.pytorch that implement InferenceEngine Modifier and Type Class Description classTorchScriptInferenceEngineTorchScript (PyTorch) implementation ofLocalInferenceEngineusing Deep Java Library (DJL). -
Uses of InferenceEngine in com.codedstream.otterstream.remote
Classes in com.codedstream.otterstream.remote that implement InferenceEngine Modifier and Type Class Description classRemoteInferenceEngineAbstract base class for remote inference engines communicating with external model endpoints. -
Uses of InferenceEngine in com.codedstream.otterstream.remote.http
Classes in com.codedstream.otterstream.remote.http that implement InferenceEngine Modifier and Type Class Description classHttpInferenceClientHTTP-based remote inference client for REST API model endpoints. -
Uses of InferenceEngine in com.codedstream.otterstream.remote.sagemaker
Classes in com.codedstream.otterstream.remote.sagemaker that implement InferenceEngine Modifier and Type Class Description classSageMakerInferenceClientAWS SageMaker remote inference client for hosted ML models. -
Uses of InferenceEngine in com.codedstream.otterstream.remote.vertex
Classes in com.codedstream.otterstream.remote.vertex that implement InferenceEngine Modifier and Type Class Description classVertexAIInferenceClientGoogle Vertex AI remote inference client for Google Cloud ML models. -
Uses of InferenceEngine in com.codedstream.otterstream.tensorflow
Classes in com.codedstream.otterstream.tensorflow that implement InferenceEngine Modifier and Type Class Description classTensorFlowInferenceEngineTensorFlow SavedModel inference engine using TensorFlow Java API. -
Uses of InferenceEngine in com.codedstream.otterstream.xgboost
Classes in com.codedstream.otterstream.xgboost that implement InferenceEngine Modifier and Type Class Description classXGBoostInferenceEngineXGBoost inference engine for gradient boosting tree models. -
Uses of InferenceEngine in com.codedstreams.otterstreams.sql.loader
Methods in com.codedstreams.otterstreams.sql.loader that return InferenceEngine Modifier and Type Method Description InferenceEngine<?>ModelCache. getEngine(String modelName)InferenceEngine<?>ModelRegistrationManager. registerAndLoadModel(SqlInferenceConfig config)Registers and loads a model from configuration.InferenceEngine<?>ModelRegistrationManager. reloadModel(String modelName, SqlInferenceConfig newConfig)Reloads a model with new configuration.Methods in com.codedstreams.otterstreams.sql.loader with parameters of type InferenceEngine Modifier and Type Method Description voidModelCache. putEngine(String modelName, InferenceEngine<?> engine) -
Uses of InferenceEngine in com.codedstreams.otterstreams.sql.metadata
Methods in com.codedstreams.otterstreams.sql.metadata with parameters of type InferenceEngine Modifier and Type Method Description static InputOutputSchemaInputOutputSchemaExtractor. extractSchema(InferenceEngine<?> engine)Extracts schema from inference engine. -
Uses of InferenceEngine in com.codedstreams.otterstreams.sql.runtime
Classes in com.codedstreams.otterstreams.sql.runtime that implement InferenceEngine Modifier and Type Class Description classTensorFlowGraphDefEngineTensorFlow GraphDef (frozen graph) inference engine.classTensorFlowSavedModelEngineTensorFlow SavedModel inference engine.Methods in com.codedstreams.otterstreams.sql.runtime that return InferenceEngine Modifier and Type Method Description static InferenceEngine<?>InferenceEngineFactory. createEngine(ModelConfig config)InferenceEngine<?>ModelHealthChecker.HealthStatus. getEngine()Methods in com.codedstreams.otterstreams.sql.runtime with parameters of type InferenceEngine Modifier and Type Method Description voidModelHealthChecker. registerModel(String modelName, InferenceEngine<?> engine)Constructors in com.codedstreams.otterstreams.sql.runtime with parameters of type InferenceEngine Constructor Description BatchInferenceProcessor(InferenceEngine<?> engine, int batchSize, long batchTimeoutMs)HealthStatus(String modelName, InferenceEngine<?> engine)
-