from autoblocks.tracer import AutoblocksTracer
from openai import OpenAI
client = OpenAI()
tracer = AutoblocksTracer()
tracer.send_event("ai.request", properties=params)
completion = client.chat.completions.create(**params)
tracer.send_event("ai.response", properties=completion)
Improve your
LLM Product Accuracy
Bring your entire team together with expert-driven testing & evaluation
The collaborative testing & evaluation platform that automatically improves with feedback from users and experts.Better tests. Better products.
Align every component of your tests more closely with reality.Curate high-quality test datasets
Experiment, collaboratively
Align evaluation metrics
Integrate easily with any codebase, any framework
Flexible SDKs
- Trace events
- Test app behavior
- Manage prompts
- Manage configs
- Manage custom models