Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

RAGFlow streaming output suggestions #3738 #3881

Open
wants to merge 92 commits into
base: main
Choose a base branch
from

Conversation

lizheng419
Copy link
Contributor

@lizheng419 lizheng419 commented Dec 5, 2024

What problem does this PR solve?

Briefly describe what this PR aims to solve. Include background context that will help reviewers understand the purpose of the PR.

Type of change

  • New Feature (non-breaking change which adds functionality)

Feiue and others added 30 commits November 19, 2024 19:06
### What problem does this PR solve?

Add test for document

### Type of change

- [x] New Feature (non-breaking change which adds functionality)

---------

Co-authored-by: liuhua <[email protected]>
Co-authored-by: Kevin Hu <[email protected]>
### What problem does this PR solve?

_Choosing Laws Chunk Method results in an error when parsing a document.
The error is caused by a missing import in the `laws.py` file._

```
Traceback (most recent call last):
  File "/ragflow/rag/svr/task_executor.py", line 445, in handle_task
    do_handle_task(task)
  File "/ragflow/rag/svr/task_executor.py", line 384, in do_handle_task
    cks = build(r)
          ^^^^^^^^
  File "/ragflow/rag/svr/task_executor.py", line 196, in build
    cks = chunker.chunk(row["name"], binary=binary, from_page=row["from_page"],
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/ragflow/rag/app/laws.py", line 161, in chunk
    for txt, poss in pdf_parser(filename if not binary else binary,
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/ragflow/rag/app/laws.py", line 124, in __call__
    logging.debug("layouts:".format(
    ^^^^^^^
NameError: name 'logging' is not defined. Did you forget to import 'logging'

```

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
- [ ] New Feature (non-breaking change which adds functionality)
- [ ] Documentation Update
- [ ] Refactoring
- [ ] Performance Improvement
- [ ] Other (please describe):

Co-authored-by: Michal Masrna <[email protected]>
### What problem does this PR solve?

1. Remove unused code
2. Fix type mismatch, in nlp search and infinity search interface
3. Fix chunk list, get all chunks of this user.

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)

---------

Signed-off-by: jinhai <[email protected]>
### What problem does this PR solve?

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
### What problem does this PR solve?

infiniflow#3499

### Type of change

- [x] Performance Improvement
…#3508)

### What problem does this PR solve?

feat: Add Datasets component to home page infiniflow#3221
### Type of change


- [x] New Feature (non-breaking change which adds functionality)
### What problem does this PR solve?

infiniflow#3511

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
### What problem does this PR solve?

Added kb_id filter to knn. Fix infiniflow#3458

- [x] Bug Fix (non-breaking change which fixes an issue)
### What problem does this PR solve?


### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
### What problem does this PR solve?


### Type of change

- [x] Refactoring
### What problem does this PR solve?

Fix set_output type hint

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
# Conflicts:
#	api/apps/tenant_app.py
# Conflicts:
#	sdk/python/test/test_data/test.docx
#	sdk/python/test/test_data/test.jpg
#	sdk/python/test/test_data/test.pdf
#	sdk/python/test/test_data/test.ppt
#	sdk/python/test/test_data/test.xlsx
# Conflicts:
#	rag/llm/chat_model.py
…ote_lz

# Conflicts:
#	rag/llm/chat_model.py
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ci Continue Integration wip
Projects
None yet
Development

Successfully merging this pull request may close these issues.

8 participants