Package com.codedstreams.otterstreams.sql.runtime

Class InferenceMetricsCollector

java.lang.Object

com.codedstreams.otterstreams.sql.runtime.InferenceMetricsCollector

public class InferenceMetricsCollector
extends Object

Collects and tracks inference metrics per model.

Since:

1.0.0

Author:

Nestor Martourez Abiangang A.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	InferenceMetricsCollector.ModelMetrics	Metrics for a single model.

Method Summary

Modifier and Type	Method	Description
static InferenceMetricsCollector	getInstance()
InferenceMetricsCollector.ModelMetrics	getMetrics(String modelName)
void	recordCacheHit(String modelName)
void	recordCacheMiss(String modelName)
void	recordInference(String modelName, long latencyMs, boolean success)
void	reset(String modelName)
void	resetAll()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

getInstance

public static InferenceMetricsCollector getInstance()

recordInference

public void recordInference(String modelName,
                            long latencyMs,
                            boolean success)

recordCacheHit

public void recordCacheHit(String modelName)

recordCacheMiss

public void recordCacheMiss(String modelName)

getMetrics

public InferenceMetricsCollector.ModelMetrics getMetrics(String modelName)

reset

public void reset(String modelName)

resetAll

public void resetAll()