Langfuse

Traces and Graphs (Agents)

Capture detailed traces and graphs of agent interactions to visualize the flow of requests and responses. This feature allows users to understand the performance and behavior of their AI agents in real-time, facilitating debugging and optimization.

Session Tracking (Chats/Threads)

Monitor and track user sessions across chats and threads to gain insights into user interactions. This feature helps in understanding user behavior and improving the overall user experience by analyzing session data.

User Tracking

Keep track of individual user interactions with the AI agents to analyze usage patterns and engagement levels. This feature provides valuable insights into user behavior, enabling targeted improvements and personalized experiences.

Token and Cost Tracking

Monitor the usage of tokens and associated costs for each interaction with the AI models. This feature helps users manage their budgets effectively and optimize their usage of AI resources.

Native Frameworks Integrations

Seamlessly integrate with popular frameworks to enhance the functionality of AI agents. This feature allows users to leverage existing tools and libraries, making it easier to implement and manage AI solutions.

OpenTelemetry (Java, Go, custom)

Utilize OpenTelemetry for instrumentation to capture and analyze traces from various programming languages. This feature ensures compatibility with existing systems and enhances observability across different environments.

Proxy-based Logging (via LiteLLM)

Implement proxy-based logging to capture interactions without modifying existing code. This feature simplifies the integration process and allows for easy monitoring of AI agent performance.

Custom via API

Access custom logging and tracing capabilities through a robust API. This feature enables users to tailor their observability needs according to specific requirements and workflows.

Access to historical data

Retrieve and analyze historical data to understand trends and performance over time. This feature is crucial for making informed decisions based on past interactions and usage patterns.

Ingestion throughput

Manage the rate at which data is ingested into the system, ensuring optimal performance and responsiveness. This feature allows users to scale their operations according to their needs.

Prompt Versioning

Maintain multiple versions of prompts to track changes and improvements over time. This feature allows users to revert to previous versions if needed, ensuring flexibility in prompt management.

Prompt Fetching

Fetch prompts on demand to ensure that the most relevant and up-to-date prompts are used in interactions. This feature enhances the responsiveness and accuracy of AI agents.

Prompt Release Management

Manage the release of prompts to ensure that only tested and approved prompts are deployed. This feature helps maintain the quality and reliability of AI interactions.

Prompt Composability

Combine multiple prompts to create complex interactions and responses. This feature allows for greater flexibility and creativity in designing AI interactions.

Prompt Caching (server and client)

Cache prompts on both server and client sides to improve performance and reduce latency. This feature ensures that frequently used prompts are readily available, enhancing user experience.

Playground

Test prompts on real production inputs and compare models side-by-side in a controlled environment. This feature allows users to experiment with different prompts and models to find the best combinations.

Prompt Experiments

Run experiments with different prompts to evaluate their effectiveness in real-time. This feature enables users to optimize their prompts based on actual performance data.

Webhooks & Slack

Integrate with webhooks and Slack for real-time notifications and updates related to prompt management. This feature enhances collaboration and responsiveness within teams.

Protected Deployment Labels

Label deployments to protect sensitive prompts and ensure compliance with security protocols. This feature helps maintain the integrity and confidentiality of prompt data.

Datasets

Utilize datasets for training and evaluating AI models to ensure they perform optimally. This feature allows users to leverage existing data for better model performance.

Experiments via SDK

Run experiments using the SDK to evaluate model performance and effectiveness. This feature provides developers with the tools needed to conduct thorough evaluations.

Experiments via UI

Conduct experiments through a user-friendly interface to evaluate different models and prompts. This feature simplifies the evaluation process for non-technical users.

Evaluation Scores (custom)

Generate custom evaluation scores based on specific criteria to assess model performance. This feature allows users to tailor evaluations to their unique needs.

User Feedback Tracking

Track user feedback to inform model improvements and adjustments. This feature helps ensure that AI models evolve based on real user experiences and needs.

External Evaluation Pipelines

Integrate with external evaluation pipelines to enhance the evaluation process. This feature allows users to leverage third-party tools and services for comprehensive assessments.

LLM-as-judge evaluators

Utilize LLMs as evaluators to assess the quality of outputs and interactions. This feature enhances the evaluation process by providing automated assessments.

Human Annotation

Incorporate human annotation into the evaluation process to ensure high-quality assessments. This feature allows for collaborative evaluations that combine human insights with automated processes.

Human Annotation Queues

Manage queues for human annotation to streamline the evaluation process. This feature ensures that human reviewers can efficiently assess and annotate data.

Projects

Create and manage multiple projects to organize AI agent development and evaluations. This feature allows teams to work on different initiatives simultaneously while maintaining clarity and focus.

Users

Manage user access and permissions across projects to ensure collaboration and security. This feature allows teams to work together effectively while controlling access to sensitive information.

Extensive Public API

Access a comprehensive public API to interact with all features of the platform programmatically. This feature allows developers to integrate Langfuse capabilities into their applications seamlessly.

Rate limit (general API routes)

Manage the rate limits for general API routes to ensure fair usage and performance. This feature helps maintain system stability and responsiveness under varying loads.

Rate limit (datasets API)

Control the rate limits for datasets API to optimize performance and manage resource usage. This feature ensures that users can access data efficiently without overwhelming the system.

Rate limit (metrics API)

Set rate limits for metrics API to ensure optimal performance and data access. This feature helps manage the load on the system while providing necessary insights.

Batch Export via UI

Export data in batches through the user interface for easy access and analysis. This feature simplifies the process of retrieving large datasets for further processing.

PostHog Integration

Integrate with PostHog for advanced analytics and tracking capabilities. This feature enhances the ability to monitor user interactions and gather insights.

Mixpanel Integration

Connect with Mixpanel to leverage its analytics capabilities for tracking user behavior and engagement. This feature allows for deeper insights into user interactions.

Scheduled Batch Export to Blob Storage

Schedule batch exports to blob storage for automated data retrieval and storage. This feature streamlines the process of managing large datasets and ensures timely access.

Ask AI

Utilize AI to get answers and support for using the platform effectively. This feature enhances user experience by providing instant assistance and guidance.

Community (GitHub)

Engage with the community on GitHub for support, collaboration, and sharing knowledge. This feature fosters a collaborative environment for users to learn from each other.

In-app support

Access in-app support for immediate assistance with platform-related issues. This feature ensures that users can quickly resolve problems and continue their work without interruption.

Private Slack / MS Teams channel

Join a private Slack or MS Teams channel for dedicated support and collaboration. This feature enhances communication and provides a direct line to support teams.

Dedicated Support Engineer

Receive personalized assistance from a dedicated support engineer for complex issues and inquiries. This feature ensures that users have expert guidance when needed.

Onboarding & Architectural guidance

Get onboarding assistance and architectural guidance to ensure successful implementation and usage of the platform. This feature helps users maximize the value of their investment.

Response time SLO

Set service level objectives for response times to ensure timely support. This feature helps manage expectations and ensures that users receive prompt assistance.

Support SLA

Establish service level agreements for support to ensure consistent and reliable assistance. This feature provides users with clear expectations regarding support availability.

Data region

Choose the data region for storing and processing data to comply with local regulations and preferences. This feature ensures that users can manage their data in accordance with legal requirements.

Sign in with Google, AzureAD, GitHub

Enable users to sign in using their Google, AzureAD, or GitHub accounts for easier access and management. This feature simplifies the authentication process and enhances user convenience.

Organization-level RBAC

Implement role-based access control at the organization level to manage user permissions effectively. This feature enhances security and ensures that users have appropriate access.

Enterprise SSO (e.g. Okta, AzureAD/EntraID)

Utilize enterprise single sign-on solutions for streamlined authentication and access management. This feature simplifies user management and enhances security.

SSO enforcement

Enforce single sign-on policies to ensure consistent authentication practices across the organization. This feature enhances security and simplifies user access.

Client-side data masking

Implement client-side data masking to protect sensitive information during interactions. This feature enhances data security and compliance with privacy regulations.

Project-level RBAC

Manage role-based access control at the project level to ensure that users have appropriate permissions for specific projects. This feature enhances security and collaboration.

Data retention management

Manage data retention policies to comply with legal and organizational requirements. This feature ensures that data is retained or deleted according to specified guidelines.

SCIM API for automated user provisioning

Utilize the SCIM API for automated user provisioning to streamline user management processes. This feature enhances efficiency and reduces administrative overhead.

Audit Logs

Access audit logs to track user activities and changes within the platform. This feature enhances accountability and security by providing a clear record of actions taken.

Subscription management

Manage subscriptions easily through a self-serve interface, allowing users to adjust their plans and billing preferences. This feature enhances user control over their subscription details.

Payment methods

Support various payment methods for subscription fees, ensuring flexibility and convenience for users. This feature allows users to choose their preferred payment options.

Contract duration

Define the duration of contracts for subscriptions, providing clarity on billing cycles and commitments. This feature helps users understand their financial obligations.

Billing via AWS Marketplace

Facilitate billing through AWS Marketplace for users who prefer this payment method. This feature enhances convenience for users already utilizing AWS services.

Compliance

Ensure compliance with various regulations and standards, including GDPR and HIPAA. This feature provides users with confidence that their data is handled responsibly.

Contracts

Provide standard terms and conditions along with data processing agreements to ensure clarity and legal compliance. This feature helps users understand their rights and responsibilities.

Data processing agreement (GDPR)

Offer a data processing agreement to comply with GDPR regulations, ensuring that user data is handled in accordance with legal requirements. This feature enhances trust and transparency.

SOC2 Type II & ISO27001 reports

Provide SOC2 Type II and ISO27001 compliance reports to demonstrate adherence to security and privacy standards. This feature enhances credibility and trust with users.

HIPAA compliance

Ensure compliance with HIPAA regulations for users in the healthcare sector, providing peace of mind regarding data security and privacy. This feature is essential for organizations handling sensitive health information.

InfoSec/legal reviews

Conduct information security and legal reviews to ensure that the platform meets necessary compliance and security standards. This feature enhances the overall security posture of the service.