Skip to content

GitLab

Explore

Sign in

Primary navigation

Project

LlamaIndexTS
- Activity
- Members
- Labels
- Issues
- Issue boards
- Milestones
- Iterations
- Wiki
- Environments
- Terraform modules
- Incidents
- Service Desk

Snippets Groups Projects

055b4993

Commit 055b4993 authored 1 year ago by Yi Ding

Downloads
- Patches
- Plain Diff

cjk support for text splitter (thanks @TomPenguin)

parent 48289c3c

No related branches found

No related tags found

No related merge requests found

Changes 4

Hide whitespace changes

Inline Side-by-side

Showing

packages/core/src/NodeParser.ts 6 additions, 6 deletions

packages/core/src/NodeParser.ts
packages/core/src/PromptHelper.ts 6 additions, 6 deletions

packages/core/src/PromptHelper.ts
packages/core/src/TextSplitter.ts 74 additions, 42 deletions

packages/core/src/TextSplitter.ts
packages/core/src/tests/TextSplitter.test.ts 42 additions, 23 deletions

packages/core/src/tests/TextSplitter.test.ts

with 128 additions and 77 deletions

Loading

0% Loading or .

You are about to add 0 people to the discussion. Proceed with caution.

Finish editing this message first!

Please register or sign in to comment

Strive to be the person your dogs believe you are