UNPKG

embeddings

Version:

Structure ambiguous data into discrete question:answer pairs and generate associated embeddings for similarity querying via Faiss or similar.

github.com/ChatClue/embeddings

ChatClue/embeddings

45 lines (23 loc) • 1.18 kB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
## [Unreleased] ## [0.1.0] - 2023-05-05 - Initial release ## [0.1.2] - 2023-05-05 - Proivde code completion in answer values. ## [1.0.0] - 2023-05-07 - Implement generateFromUrls to allow full scraping through screenshots-pagepixels package of webpage HTML and to generate question:answer pairs and embeddings from the webpage content. Updates constructor to pass an options hash and includes additional refinement options and verbose flag. This version is not backward compatible with previous versions. ## [1.0.1] - 2023-05-07 - Provides additional clarity and examples to the readme. ## [1.1.0] - 2023-05-07 - Ensure embedding model configuration is properly set and implement generateEmbeddingForText as a standalone function. ## [2.0.0] - 2023-05-07 - Make the method names more descriptive and provide additional documentation in readme. This version is not backward compatible with previous verisons. ## [2.0.1] - Fix verbose log. ## [2.0.2] - Fix verbose Log ## [2.0.3] - Fixed PagePixels dependency version ## [2.0.4] - Implement true tokenization for chunks using gpt-3-encoder. ## [2.0.5] 2023-07-14 - Optimize splitTextIntoChunks method.