log10js
Version:
⚡ Unified LLM data management ⚡
80 lines (50 loc) • 2.47 kB
Markdown
# log10
⚡ Unified LLM data management ⚡
<!-- [](https://github.com/log10-io/log10/actions/workflows/release.yml) -->
[](https://discord.gg/CZQvnuRV94)
## Quick Install
``` bash
npm install log10js
yarn add log10js
```
## 🤔 What is this?
A JavaScript integration to manage your LLM data.
```javascript
const { Configuration, OpenAIApi } = require("openai");
const log10 = require("log10js");
const configuration = new Configuration({
apiKey: process.env.OPENAI_API_KEY,
});
const log10_OpenAIApi = log10(OpenAIApi);
const openai = new log10_OpenAIApi(configuration);
```
Access your LLM data at [log10.io](https://log10.io)
[See full example](./examples/completions.js)
## 🚀 What can this help with?
**🔍🐞 Prompt chain debugging**
Prompt chains such as those in [Langchain](https://github.com/hwchase17/langchain) can be difficult to debug. Log10 provides prompt provenance, session tracking and call stack functionality to help debug chains.
```javascript
const { OpenAI } = require("langchain/llms/openai");
const { Configuration, OpenAIApi } = require("openai");
const log10 = require("log10js");
const log10_OpenAIApi = log10(OpenAIApi);
const openai = new log10_OpenAIApi(
new Configuration({
apiKey: process.env.OPENAI_API_KEY,
})
);
let model = new OpenAI();
model.client = openai;
// Run any chain here...
```
[See full example](./examples/langchain_summarize.js)
**📝📊 Logging**
Log all your OpenAI calls to compare and find the best prompts, store feedback, collect latency and usage metrics, and perform analytics and compliance monitoring of LLM powered features.
**🧠🔁 Readiness for RLHF & self hosting**
Use your data and feedback from users to fine-tune custom models with RLHF with the option of building and deploying more reliable, accurate and efficient self-hosted models.
**👥🤝 Collaboration**
Create flexible groups to share and collaborate over all of the above features
## ⚙️ Setup
Create a free account at [log10.io](https://log10.io) to get a `LOG10_TOKEN` and a `LOG10_ORG_ID`. Please add these to your environment along with `LOG10_URL=https://log10.io`.
## 💬 Community
We welcome community participation and feedback. Please leave an issue, submit a PR or join our [Discord](https://discord.gg/CZQvnuRV94).