Prompt Engineer

Prompt Engineer (LLM Automation for Data Labeling & Localization) Join to apply for the Prompt Engineer (LLM Automation for Data Labeling & Localization) role at Synodex. About The Role Innodata is building a team of prompt engineers to harness the power of LLMs to automate data annotation and human evaluation workflows. The goal is to facilitate accurate, localized, and culturally adapted data labeling and translation processes through effective prompt design and implementation. The team will collaborate with a leading technology client partner to identify opportunities for automation, design solutions, and drive measurable improvements. Key Responsibilities Collaborate with data scientists, linguists, and localization experts to ensure accuracy and cultural relevance. Prototype and validate AI models to demonstrate initial feasibility, potential impact, and overall effectiveness. Design, develop, and implement prompts for data labeling and localization processes within software applications. Understand the current components of the software stack, use cases, and problems, and iterate on solutions leveraging a solid knowledge of data structures, formats, and modeling. Conduct user testing and feedback analysis to optimize prompt design for data accuracy and linguistic consistency. Analyze model performance using key metrics, ensuring AI models meet customer acceptance criteria and deliver high‑quality outputs. Communicate technical findings and solution strategies to both technical and non‑technical stakeholders, including presenting model performance and actionable insights. Collaborate on data pipelines and workflows that integrate LLMs into automated systems, enhancing the efficiency and effectiveness of data annotation tasks. Create guidelines and training materials for prompt usage in data labeling and localization projects. Stay informed on industry trends and tools to enhance prompt engineering techniques. Technical & Required Skills Deep understanding of LLMs (e.g., transformer‑based architectures). Demonstrated experience programmatically using LLMs to automate data labeling, classification, localization, and annotation tasks. Strong expertise in Python for NLU, data processing, transformation, and statistical analysis. Familiarity with JSON, JavaScript, or XML. Experience with popular ML frameworks and libraries such as TensorFlow, PyTorch, Jupyter, and other AI/ML tools. Familiarity with APIs and platforms for working with LLMs (e.g., OpenAI, Hugging Face). Knowledge of localization best practices and cultural nuances for different languages and regions. Strong understanding of LLM evaluation metrics and the ability to assess model reliability, bias, and generalizability. Experience working with data pipelines, automation tools, and integrating models into production systems to ensure scalable, reliable solutions. A collaborative mindset with the ability to solve complex technical challenges and work independently. Exceptional attention to detail and a commitment to delivering high‑quality, reliable AI solutions. Appreciation for issues of Diversity, Equity, and Inclusion in AI. Preferred Skills And Experience 2 years of prompt engineering / LLM fine‑tuning or related AI/ML roles. Familiarity with tools/platforms for annotation and human‑in‑the‑loop workflows (e.g., Labelbox). Experience designing and automating data annotation workflows. Knowledge of data annotation and the challenges of scaling human‑in‑the‑loop workflows. Familiarity with cloud platforms, containerization, and model deployment. Knowledge of another language. Minimum Education Requirements Bachelor’s degree or higher in Computer Science, Artificial Intelligence, Machine Learning, Linguistics, Localization, or a related field. Seniority Level Entry level Employment Type Full‑time Job Function Engineering and Information Technology Industries Information Services Location Toronto, Ontario, Canada Referrals increase your chances of interviewing at Synodex by 2x. #J-18808-Ljbffr