Add translators for Israel's national newspaper library, JTA news archive and Jerusalem Post - #3456
Add translators for Israel's national newspaper library, JTA news archive and Jerusalem Post#3456Execrit wants to merge 29 commits into
Conversation
…anything and there does not appear to be a way to check the article's language)
|
note: this translator can probably be applied to all veridian-ran newspaper websites with a little bit modification |
|
@AbeJellinek kind reminder |
|
I cannot add test cases due to cloudflare |
|
@alex-ter Could you take a look? |
|
I certainly could, but just to make it clear - I'm not a maintainer here, so won't be able to merge, but hopefully the feedback will be helpful in achieving that. I'll do a proper review later, but a few items after a quick scan. If you need help with any of the below, let me know. I could do that myself or guide you.
|
@alex-ter Oh sorry, my bad. But if you are already offering help, I have reached a conclusion that I have no idea how to fix the CRLF and LF, despite trying multiple methods. I also can't add tests to Israel's national library, perhaps you know how to do it despite the Cloudflare system. here is an example article |
|
CRLF issue: LLMs: We have nothing against using LLMs for translator development. Scaffold includes code completion (currently behind a hidden pref - set Tests: Probably won't work. I'm getting a Cloudflare captcha loop in Z8. I'll see if there's anything we can do to look less suspicious to CF, but for now, we'll need to test manually in the browser. (It looks like you closed your fork - you may need to open a new PR after undoing that.) |
|
@AbeJellinek I opened a new one because this one was convoluted. See it here. I have fixed everything. I used scaffold with LLM, so everything should be fine |
Add translator for Israel's national newspaper library
Here are example articles:
https://www.nli.org.il/en/newspapers/israelsmessenger/1921/06/10/01/article/26/?e=-------en-20--1--img-txIN%7ctxTI--------------1
https://www.nli.org.il/en/newspapers/kentuckyjc/1938/08/19/01/article/14/?e=-------en-20--1--img-txIN%7ctxTI--------------1