Uses of Class
com.codedstream.otterstream.inference.config.InferenceConfig.Builder

Packages that use InferenceConfig.Builder

Package	Description
com.codedstream.otterstream.inference.config

Uses of InferenceConfig.Builder in com.codedstream.otterstream.inference.config

Methods in com.codedstream.otterstream.inference.config that return InferenceConfig.Builder

Modifier and Type	Method	Description
InferenceConfig.Builder	InferenceConfig.Builder.batchSize(int batchSize)	Sets the batch size for inference operations.
static InferenceConfig.Builder	InferenceConfig.builder()	Creates a new builder for InferenceConfig.
InferenceConfig.Builder	InferenceConfig.Builder.enableMetrics(boolean enableMetrics)	Enables or disables metrics collection.
InferenceConfig.Builder	InferenceConfig.Builder.engineOptions(Map<String,Object> engineOptions)	Sets engine-specific options.
InferenceConfig.Builder	InferenceConfig.Builder.maxRetries(int maxRetries)	Sets maximum retry attempts for failed inferences.
InferenceConfig.Builder	InferenceConfig.Builder.modelConfig(ModelConfig modelConfig)	Sets the model configuration.
InferenceConfig.Builder	InferenceConfig.Builder.timeout(Duration duration)	Sets the inference timeout using Duration.
InferenceConfig.Builder	InferenceConfig.Builder.timeoutMs(long timeoutMs)	Sets the inference timeout in milliseconds.