Product Update - Aug 7, 2024

We are thrilled to bring you another round of exciting updates this month!

Quick demo by Willy!

Annotation Queues

Introducing Annotation Queues: a new feature designed to streamline the human review process.

Annotation Queues allow users to populate queues using production logs, making it easier to manage and organise annotation tasks for domain experts.

Domain experts can then rapidly review and annotate these tasks using convenient shortcuts, significantly speeding up the review process!

Environments

We've added a new environment parameter to the SDKs to help you manage your logs efficiently. Now you can silo experiment, development, staging, and production logs.

Experiments

Faster Bootstrap: Launch experiments quickly without the need to link to a dataset.
Sortable Leaderboard: Experiment items can now be sorted by score, making comparisons easier.
Full Trace Visualization: Troubleshoot your experiments by visualizing the runs as full traces.

Open-Source SDKs

We have made the Python and TypeScript SDKs open-source to promote contributions, ensure transparency, and facilitate integration with AI frameworks.

Check out the full release notes: https://docs.getliteral.ai/more/release-notes#0-0-615-beta-july-31th-2024

Give these a try and let us know what you think!