"Teammate Lang", an LLM App DevOps Tool, Enters Public Preview - All Features Free and Unlimited

RAFFLES PLACE, Singapore - Dec. 6, 2023 - PRLog -- Teammate Pte. Ltd. has started public preview of "Teammate Lang", LLM App DevOps tool. During the public preview period, all features of the $9/month Basic Plan are available for unlimited free use.

>Official Website : https://lang.teammate.as/
>Product Hunt : https://www.producthunt.com/products/teammate-lang

About Teammate Lang
Teammate Lang is an all-in-one solution from development to operation for generative AI apps. It addresses common challenges faced by developers, from enhancing the dev productivity to improving quality and security through post-release analysis tailored to LLM, which ultimately boosts the overall ROI of LLM app development and operations.

Outline

• No-code GenAI App Builder
• Prompt Management System (PMS) to combine multiple prompt chains into a single API
• Playground for testing multiple LLMs simultaneously to compare their capabilities
• Deploy and run on serverless
• Sandboxing prompts and logics to enable quicker refinement
• Available in English, Chinese and Japanese

Key features - in Development

• Easy integration and switching between different LLM models, vector databases, and APIs
• A variety of built-in AI service add-ons, such as image recognition, voice recognition, topic identification, and translation
• Playground: Simultaneously run and compare results of 20+ LLM models including GPT, PaLM, Llama, and Cohere
• GenAI-specific QA : Execute pre-launch tests to be ready for production environments through AI-generated testing patterns
• Implement security measures tailored to GenAI risks like moderation, by drag-and-drop in the workflow

Key features - in Operations

• Dashboard and analysis platform specialized for LLM Ops
• Prompt version management for quick and seamless improvements
• A/B testing and phased releases (by traffic splitting)
• Speeding up responses with Semantic similarity cache
• User feedback API to assist in collecting quality evaluations

Comments from CEO Tom Ohtsuka
Teammate Lang was initially developed as an internal tool for developing an AGI agent - "Teammate" (alternative workforce for business).
AGI development, with its unpredictability far beyond traditional machine learning models, necessitated a robust development foundation to build reliable and high-quality user experiences. However, we faced several challenges such as slow responses from GPT-4 and difficulty in pre-simulating newer models claimed to be more accurate for commercial use. We realized through overcoming these challenges that other developers might face similar issues, and our dev tool could contribute to the community. Thus, we tuned it into Teammate Lang as a public service.
We hope our product will assist LLM app developers in efficiently building reliable services, contributing to society through innovative GenAI services.