Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

RFC with enhancements to MultimodalQnA #208

Merged
merged 38 commits into from
Oct 17, 2024
Merged

RFC with enhancements to MultimodalQnA #208

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
38 commits
Select commit Hold shift + click to select a range
ebd4e93
Initial add of MM RAG enhancements RFC
dmsuehir Oct 3, 2024
a2b9b34
Formatting
dmsuehir Oct 3, 2024
23d554a
Minor changes to design section
dmsuehir Oct 3, 2024
5fe0eec
Initial add of MM RAG enhancements RFC
dmsuehir Oct 3, 2024
1f2026d
Formatting
dmsuehir Oct 3, 2024
c64e3c6
Minor changes to design section
dmsuehir Oct 3, 2024
144b6a8
Merge branch 'dina/mm-rfc' of github.com:dmsuehir/opea-project-docs i…
dmsuehir Oct 3, 2024
421846a
Merge branch 'opea-project:main' into dina/mm-rfc
dmsuehir Oct 3, 2024
1f9c64c
Merge branch 'main' of github.com:dmsuehir/opea-project-docs into din…
dmsuehir Oct 3, 2024
dd96c45
Merge branch 'dina/mm-rfc' of github.com:dmsuehir/opea-project-docs i…
dmsuehir Oct 3, 2024
67da09c
Added use case descriptions
mhbuehler Oct 4, 2024
9de00ef
Add WIP table of dataprep endpoints
dmsuehir Oct 7, 2024
b092b78
Added use case descriptions
mhbuehler Oct 4, 2024
8c310a7
Add WIP table of dataprep endpoints
dmsuehir Oct 7, 2024
c53fce4
Merge branch 'dina/mm-rfc' of github.com:dmsuehir/opea-project-docs i…
mhbuehler Oct 7, 2024
34833ae
Update to combine image/audio dataprep with existing endpoints and ad…
dmsuehir Oct 9, 2024
23f6723
Merge branch 'main' of github.com:dmsuehir/opea-project-docs into din…
dmsuehir Oct 9, 2024
07dc126
Adds UI section & mockups
mhbuehler Oct 9, 2024
051eca5
Add diagram and provide more detail for the gateway/embedding service…
dmsuehir Oct 9, 2024
546620b
Improved audio ingestion UI description & mockup
mhbuehler Oct 9, 2024
1b6dc36
Update dataprep endpoint paths
dmsuehir Oct 9, 2024
288cf8d
Filled out the compatiblity and miscellaneous sections and updated di…
dmsuehir Oct 10, 2024
1010066
Merge branch 'opea-project:main' into dina/mm-rfc
dmsuehir Oct 10, 2024
60516cd
Merge branch 'main' of github.com:dmsuehir/opea-project-docs into din…
dmsuehir Oct 10, 2024
0d8a423
Merge branch 'dina/mm-rfc' of github.com:dmsuehir/opea-project-docs i…
dmsuehir Oct 10, 2024
93b5ed8
Formatting
dmsuehir Oct 10, 2024
c11569f
Added TTS to the diagram and RFC for spoken responses
dmsuehir Oct 11, 2024
434ec3c
Merge branch 'main' of github.com:dmsuehir/opea-project-docs into din…
dmsuehir Oct 11, 2024
32eea00
Improved language and added UI alternative
mhbuehler Oct 11, 2024
7c692f4
Merge pull request #1 from dmsuehir/melanie/rfc_edit
dmsuehir Oct 11, 2024
f98babb
Rename file
dmsuehir Oct 11, 2024
ceeb954
PDF processing (#2)
mhbuehler Oct 14, 2024
1ea893e
Merge branch 'main' of github.com:dmsuehir/opea-project-docs into din…
dmsuehir Oct 14, 2024
5bfc86d
Update notes about compatibility (#3)
dmsuehir Oct 14, 2024
3eac196
Added Other Enhancements Section (#4)
okhleif-IL Oct 14, 2024
9e15e65
Merge branch 'main' of github.com:dmsuehir/opea-project-docs into din…
dmsuehir Oct 15, 2024
61bccd7
Minor updates and formatting (#5)
dmsuehir Oct 16, 2024
f23e413
Updated video UI image (#6)
mhbuehler Oct 16, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 3 additions & 1 deletion .gitignore
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,3 +1,5 @@
_build
.vscode
.venv
.venv
*.DS_Store

254 changes: 254 additions & 0 deletions ...ity/rfcs/24-10-02-GenAIExamples-001-Image_and_Audio_Support_in_MultimodalQnA.md
View file
Open in desktop

Large diffs are not rendered by default.

Binary file added community/rfcs/assets/multimodal_enhanced_audio_ui.png
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added community/rfcs/assets/multimodal_enhanced_chat_ui.png
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added community/rfcs/assets/multimodal_enhanced_diagram.png
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added community/rfcs/assets/multimodal_enhanced_image_ui.png
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added community/rfcs/assets/multimodal_enhanced_pdf_ui.png
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added community/rfcs/assets/multimodal_enhanced_video_ui.png
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading