I want the library to provide a Persian Lemmatizer API that I can use as lemmatizer =…
I want the library to provide a Persian Lemmatizer API that I can use as lemmatizer =…: a task in MiMo-V2.6-RL-harbor-code: MiMo-V2.6-RL Code (Harbor) (Harbor dataset). With the default data, lemmatizer.lemmatize('کتابها') should return 'کتاب' , lemmatizer.lemmatize('آتشفشان') should return…
The task
With the default data, `lemmatizer.lemmatize('کتابها')` should return `'کتاب'`, `lemmatizer.lemmatize('آتشفشان')` should return `'آتشفشان'`, and unknown tokens that cannot be normalized should be returned unchanged. It should recognize conjugated Persian verbs from the verbs data and return the dictionary form as…
Part of FineEnvs/MiMo-V2.6-RL-harbor-code.