Background
Concordia AI is committed to identifying and addressing the most pressing safety risks arising from frontier AI development. As frontier large models and agent systems grow increasingly complex, how to translate safety principles into efficient, stable, and automated infrastructure has become the core challenge in putting AI safety technology into practice. We are looking for engineers who combine solid foundational technical skills with architectural thinking to join us and lead the development of automated evaluation frameworks, risk monitoring platforms, and safety products, building a solid safety foundation for AI systems.
Responsibilities
As a core team member at Concordia AI, you will focus on building evaluation frameworks and integrating evaluation benchmarks for frontier large models and AI agent systems. You will also lead the product development of safety evaluation and remediation tools, deploying them across frontier large models and agent systems to strengthen the safety of AI technologies.
- Evaluation Platform Development: Build automated evaluation platforms for large models, multimodal models, harnesses, AI agents, and multi-agent systems. Drive core platform capabilities, including model integration, benchmark integration, harness integration, request routing, task scheduling, error handling, cost optimization, and data analysis.
- Benchmark Integration: Integrate open-source and inhouse benchmarks into the evaluation platform, ensuring feature completeness, result accuracy, and operational stability.
- Safety Product Development: Productize frontier AI safety technologies—including evaluation, risk modeling, alignment, and monitoring—to build our public risk-monitoring platform as well as commercial safety evaluation and remediation products. Continuously optimize product functionality, performance, usability, and stability.
- Safety Service Deployment: Partner with leading domestic and international large model and AI agent developers in China and internationally to deliver safety products as services. Provide high-quality implementation plans, evaluation reports, vulnerability assessments, and improvement recommendations to secure client AI systems.
Qualifications
Required
- Alignment with Concordia AI’s mission, along with a strong sense of responsibility, risk awareness, and a proactive mindset; Ability to work independently while collaborating effectively within a team.
- Bachelor’s degree or above.
- A fast learner who continuously tracks and applies state-of-the-art technological advances
- Proficiency in Python with a strong command of data structures and algorithms.
- Proficiency with Linux CLI and DevOps/development tools such as Git, Docker, and Kubernetes.
- Practical experience with large model API integration, model deployment, and benchmarking.
- Excellent logical reasoning and technical documentation skills to articulate system designs and technical reports.
- Strong Chinese reading and writing skills, with proficient spoken Chinese for smooth communication.
Preferred
- Degree in Computer Science, Machine Learning, Artificial Intelligence, Software Engineering or a related field.
- 2+ years of research or industry experience on large models, AI agents, evaluation platforms, or other software systems.
- Experience with complex software engineering, agent development, or contributions to open-source projects.
Location
Beijing/Singapore
For detailed information, please see: https://mp.weixin.qq.com/s/QIunhlvvq3OKpIDZE-1ZiA