Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cannot use oobabooga api to summarize #522

Closed
larders-gammas opened this issue Feb 4, 2025 · 4 comments
Closed

Cannot use oobabooga api to summarize #522

larders-gammas opened this issue Feb 4, 2025 · 4 comments
Assignees
Labels
bug Something isn't working

Comments

@larders-gammas
Copy link

Are You on the Latest version?
You did a git pull and are running the latest version/build?
Y

Please describe the bug
Cannot use oobabooga api to summarize

Is the bug reproducable reliably?
Yes

Steps to to reproduce the issue
Drag and drop a mp4 file , select ooba, process video

What was the expected behavior?
It can generate transcript but failed to connect local oobabooga
I tried 127.0.0.1:5000/v1/chat/completions and 127.0.0.1:5000/v1/completions. Both results in the same behaviour
Also I tried custom openai api. It failed too.
I do not use api key
Both chat/completions and /completions function work on my Sillytavern client.
I reinstalled my oobabooga to reset it.

Thank you very much. I am currently using your program to generate transcript and feed in my oobabooga to do RAG to summarize. It probably produce similar result but takes more time to do. I want to automate the process and believe your program will be helpful to automate the processes.

at cmd
Ooba
INFO:root:process_url_with_metadata: Starting summarization with Ooba...
INFO:root:Starting summarization process...
ERROR:root:Error in summarize_chunk with Ooba: 'generator' object has no attribute 'startswith'
Traceback (most recent call last):
File "C:...\tldw\tldw\App_Function_Libraries\Summarization\Summarization_General_Lib.py", line 1796, in summarize_chunk
if result is None or result.startswith("Error:"):
^^^^^^^^^^^^^^^^^
AttributeError: 'generator' object has no attribute 'startswith'
WARNING:root:Failed to generate summary using Ooba API
INFO:root:Summarization completed successfully.
ERROR:root:Summarization failed.
{"asctime": "2025-02-04 14:43:04,077", "levelname": "INFO", "name": "tldw_app_logs", "event": "videos_failed_total", "type": "counter", "value": 1, "labels": {"whisper_model": "distil-large-v3", "api_name": "Ooba"}, "timestamp": "2025-02-04T06:43:04.077245+00:00Z"}
INFO:tldw_app_logs:metric
INFO:root:Processed 1 videos in batch
INFO:root:Generating HTML for 1 results
{"asctime": "2025-02-04 14:43:04,079", "levelname": "INFO", "name": "tldw_app_logs", "event": "total_processing_time_seconds", "type": "histogram", "value": 1.67523, "labels": {"whisper_model": "distil-large-v3", "api_name": "Ooba"}, "timestamp": "2025-02-04T06:43:04.079483+00:00Z"}
INFO:tldw_app_logs:metric

Using Custom-OpenAI-API
INFO:root:process_url_with_metadata: Starting summarization with Custom-OpenAI-API...
INFO:root:Starting summarization process...
WARNING:root:Summarization with Custom-OpenAI-API failed: Error: Invalid API Name Custom-OpenAI-API
WARNING:root:Failed to generate summary using Custom-OpenAI-API API
INFO:root:Summarization completed successfully.
ERROR:root:Summarization failed.
{"asctime": "2025-02-04 15:47:13,111", "levelname": "INFO", "name": "tldw_app_logs", "event": "videos_failed_total", "type": "counter", "value": 1, "labels": {"whisper_model": "distil-large-v3", "api_name": "Custom-OpenAI-API"}, "timestamp": "2025-02-04T07:47:13.111512+00:00Z"}
INFO:tldw_app_logs:metric
INFO:root:Processed 1 videos in batch
INFO:root:Generating HTML for 1 results
{"asctime": "2025-02-04 15:47:13,112", "levelname": "INFO", "name": "tldw_app_logs", "event": "total_processing_time_seconds", "type": "histogram", "value": 1.653907, "labels": {"whisper_model": "distil-large-v3", "api_name": "Custom-OpenAI-API"}, "timestamp": "2025-02-04T07:47:13.112478+00:00Z"}
INFO:tldw_app_logs:metric

at web page
Using ooba
It can generate transcript at \tldw\Results\Audio_Processing, but failed to produce summary.
Progress
Processed 1 videos. 1 errors occurred.
Error processing C:\Users..\AppData\Local\Temp\gradio\6f577a54b8d5bb3653e7f890a4ba3a7308cfe32b521456b5f43ded743fbcd526\Spread Volatility Lowest Since 2023 Bloomberg Real Yield 01312025 SGvGWC8gOYc.mp4
Processing failed without specific error

Using Custom-OpenAI-API
It can generate transcript but failed to produce summary.

Progress
Processed 1 videos. 1 errors occurred.
Error processing C:\Users..\AppData\Local\Temp\gradio\6f577a54b8d5bb3653e7f890a4ba3a7308cfe32b521456b5f43ded743fbcd526\Spread Volatility Lowest Since 2023 Bloomberg Real Yield 01312025 SGvGWC8gOYc.mp4
Processing failed without specific

@larders-gammas larders-gammas added the bug Something isn't working label Feb 4, 2025
@rmusser01
Copy link
Owner

Thank you for filling this issue and posting logs, I’m currently bedridden sick but once I’m not ill look into this and get it fixed.

@rmusser01
Copy link
Owner

@larders-gammas FYI I fixed the ooba API issue, though its currently on the dev branch. You can pull from there or wait another day or so and I'll merge it into main after fixing the alternative openAI API config + Update logging settings.

@rmusser01
Copy link
Owner

@larders-gammas issue now fixed in the main branch. Do a pull and it should work.

Thank you again for filing the issue/informing me about it.

@larders-gammas
Copy link
Author

Thank you very much. I will have a look later.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants