feat(translation): Experimental integration of new YADT backend into CLI #475
Conversation
- ignore *.pdf files - ignore *.docx files
…ndency - bump requires-python to ">=3.12,<3.13" - add yadt dependency with version ">=0.0.1a15"
- bump python version to 3.12 in build workflow - update python version to 3.12 in publish workflow
- import and use `yadt_translate` for yadt backend - add `--yadt` option to enable yadt backend - implement `yadt_main` function to handle yadt translation process - download remote fonts for yadt translation - configure and use appropriate translator based on service name refactor(translator): add placeholder methods for rich text and formulars - add `get_rich_text_left_placeholder` and `get_rich_text_right_placeholder` methods - add `get_formular_placeholder` method - update `OpenAITranslator` to override placeholder methods
|
I tested locally using the following commands and the translation works fine. When no output folder is specified, the output file is placed in the same folder as the input file. Need community help to test compatibility of other supported features. Related issues are tracked at funstory-ai/yadt#20. Please note that we currently do not accept issues regarding the output PDF, such as translation quality or translation errors. For now, we only accept issues like parameter passing errors, such as direct errors that prevent completing the translation process. |
- add upper bound to yadt version to prevent breaking changes
|
3.12的限制有点太严格了，可以尝试放宽点吗 |
|
主要是用了这个特性： https://docs.python.org/3.12/whatsnew/3.12.html#pep-701-syntactic-formalization-of-f-strings ，应该是可以放宽的，不过暂时没有精力处理.. 可以暂时把yadt作为可选依赖？后续再处理这些事宜 |
|
如果要作为可选依赖的话，我可以在 #480 合入后做相应修改。 |
- expand python version range to >=3.10,<3.13 - update yadt requirement to >=0.0.1a20, <0.0.2
|
Thanks to funstory-ai/yadt#21, now supports Python 3.10 and 3.11。@Byaidu Since the latest versions of onnxruntime and numpy no longer support Python 3.9, yadt also does not plan to support Python 3.9.
|
- adjust python version to mitigate potential compatibility issues - maintain existing pip caching configuration
yadt is a new document translation backend that rewrites pdf2zh's translation backend, not intended for direct end-user use. We hope pdf2zh will be used by users who need self-deployment.
Currently, yadt is still in early development with some serious bugs, but in some cases, it can provide better translation quality than pdf2zh's original backend, and its performance is significantly better.
Breaking Changes:
Known Issues:
Major Improvements:
Usage Notes:
glm-4-flash,deepseek-chat, etc.Preview:2023 - Zhao_Xiangyu, Wang_Maolin - Embedding in Recommender Systems A Survey.zh-CN.dual.pdf