Job Description: Korean Lyric Transliteration Evaluator

Employment Type: Freelance

Position Overview

Welo Data, a Welocalize brand, partners with technology companies to provide high-quality, ethically sourced, relevant, diverse, and scalable datasets for AI models. With over 25 years of experience and a global community of over 500,000 AI training and domain experts, WeloData offers services in:

• ANNOTATION & LABELLING: Transcription, summarization, image and video classification and labeling.
• ENHANCING LLMs: Prompt engineering, SFT, RLHF, red teaming and adversarial model training, model output ranking.
• DATA COLLECTION & GENERATION: From institutional languages to remote field audio collection.
• RELEVANCE & INTENT: Culturally nuanced and aware ranking, relevance, and evaluation to train models for search, ads, and LLM output.

We are seeking a Korean Speaker to evaluate machine-transliterated song lyrics. Your primary focus will be on assessing the quality and accuracy of Korean transliterations into other languages. Your feedback will directly contribute to improving automated transliteration systems.

Main Responsibilities

• Review and assess machine-transliterated lyrics for meaning, fluency, and naturalness.
• Provide quality ratings based on predefined evaluation criteria.
• Identify and correct issues such as inaccurate transliterations and mistranslated words.
• Maintain consistent and objective judgment throughout the review process.

Job Requirements

• Native-level or near-native proficiency of Korean into other languages. (Please see the list of languages when you apply.)
• Great Korean linguistics skills, including expressions and cultural context.
• Excellent attention to detail.
• Ability to maintain concentration while working on a large volume of content.
• While no previous experience is needed, experience in localization or linguistic evaluation will be a plus.
• Having a music interest will be very beneficial if you can differentiate genres and lyrical styles, but not mandatory.
• Experience using online evaluation tools or platforms will be an advantage.

Project Details

• Start Date: ASAP
• Location: Remote
• Working Hours: Flexible (average of 4 hours per day)
• Employment Type: Freelance
• Duration: Indefinitely
• Pay Rate: $13 per hour

Ready to Join Us?

This is a great opportunity to contribute to the evolution of AI and language technology, especially in the music space, while working flexibly remotely. You will gain experience in the growing field of linguistic evaluation and have the chance to work on a very exciting project that blends language, culture, and technology.

Job Reference: #LI-JC1