Interface IAIModelRequestHandler
public interface IAIModelRequestHandler
Provides an abstraction for sending asynchronous requests to AI models and receiving structured responses.
IAIModelRequestHandler handler = new IAIModelRequestHandler() {
@Override
public CompletableFuture<AIModelResponse> sendRequestAsync(AIModelRequest request) {
return CompletableFuture.completedFuture(new AIModelResponse(true, "[[\"Accepted\"]]"));
}
};
-
Method Summary
Sends a request to the AI model asynchronously.
-
Method Details
-
sendRequestAsync
Sends a request to the AI model asynchronously.
- Parameters:
request - The model request containing messages.
- Returns:
- A
CompletableFuture that contains an AIModelResponse when completed.