Interface LDAIConfigTracker

The LDAIConfigTracker is used to track various details about AI operations.

Hierarchy

  • LDAIConfigTracker

Methods

trackBedrockConverseMetrics trackDuration trackDurationOf trackFeedback trackOpenAIMetrics trackSuccess trackTokens

Methods

trackBedrockConverseMetrics

  • Track an operation which uses Bedrock.

    Type Parameters

    • TRes extends {
          $metadata: {
              httpStatusCode?: number;
          };
          metrics?: {
              latencyMs?: number;
          };
          usage?: {
              inputTokens?: number;
              outputTokens?: number;
              totalTokens?: number;
          };
      }

    Parameters

    • res: TRes

      The result of the Bedrock operation.

    Returns TRes

    The input operation.

trackDuration

  • Track the duration of generation.

    Ideally this would not include overhead time such as network communication.

    Parameters

    • durationMs: number

      The duration in milliseconds.

    Returns void

trackDurationOf

  • Track the duration of execution of the provided function.

    Parameters

    • func: (() => Promise<any>)

      The function to track the duration of.

        • (): Promise<any>

        • Returns Promise<any>

    Returns Promise<any>

    The result of the function.

trackFeedback

trackOpenAIMetrics

  • Track an OpenAI operation.

    Type Parameters

    • TRes extends {
          usage?: {
              completion_tokens?: number;
              prompt_tokens?: number;
              total_tokens?: number;
          };
      }

    Parameters

    • func: (() => Promise<TRes>)

      Function which executes the operation.

        • (): Promise<TRes>

        • Returns Promise<TRes>

    Returns Promise<TRes>

    The result of the operation.

trackSuccess

trackTokens

Settings

Member Visibility

Theme

On This Page

Generated using TypeDoc