(Senior) Machine Learning Scientist (Modeling & Evaluation)

Appier · Taipei, Taiwan · Posted Oct 7, 2026


Transparency

Dead

Online for 6 weeks and never reposted. Jobs this old or reposted this often rarely lead to a hire. It may be filled already.

First seen
Oct 10, 2026
Offered for
44 days

Overview

Category
AI & machine learning
Employment type
Permanent
Workplace type
On-site
Country
Taiwan
Seniority
Senior
Schedule
Full time

Key skills

End-to-end ML model development
Design, build, and deploy machine learning models from problem definition through production.
LLM evaluation methods
Create reliable metrics and evaluation pipelines for large language model outputs.
Experiment design and A/B testing
Form hypotheses, design experiments using real traffic, and interpret results.
AI‑native development with coding agents
Work daily with autonomous coding agents, set scope, and review generated code changes.
Statistical analysis for business impact
Apply statistical techniques to quantify model performance and link it to ROI.

Key phrases

  • ML models
  • classification, regression, ranking, and retrieval
  • LLM-as-a-judge
  • optimization solutions
  • product goals
  • customer needs
  • A/B tests
  • real traffic
  • latest research
  • in-house
  • AI-native development
  • coding agents

From the posting

About Appier 

Appier (TSE: 4180) is an AI-native Agentic AI as a Service (AaaS) company that empowers businesses to create value through cutting-edge AdTech and MarTech solutions. Founded in 2012 with the vision of “Making AI Easy by Making Software Intelligent,” Appier helps businesses turn AI into ROI through its Ad Cloud, Personalization Cloud, and Data Cloud—each powered by Agentic AI that enables autonomous, adaptive, and real-time decision-making. Today, Appier operates 17 offices across APAC, the US, and EMEA, and is listed on the Tokyo Stock Exchange. Learn more at www.appier.com.

 

About the Role
We are looking for a Machine Learning Scientist (Modeling & Evaluation) to join the Enterprise Solution Science Team and help enterprises turn AI into real ROI.
In this role, you will be responsible for end-to-end development, from problem definition to driving models and solutions into production.

What You'll Work On

  1. Design, develop, and deploy optimization solutions built on ML models and evaluation, to improve efficiency and quality.
  2. Work with PMs and engineers to turn product goals and customer needs into clear problems and priorities, and integrate validated methods into the product.
  3. Build reliable evaluation methods for LLM output to measure the quality and impact of solutions, and decide if the results apply to real-world conditions.
  4. Form your own hypotheses, then design A/B tests that use real traffic to validate them.
  5. Follow the latest research and industry solutions, evaluate them in our own context, and propose new approaches. Decide what to build in-house and what to adopt.
  6. Monitor solutions after launch, and proactively communicate risks, trade-offs, and progress.
  7. (Optional) Mentor junior scientists and interns, if the need arises.

What We're Looking For (Minimum Qualifications)

  1. Master's or PhD degree in Computer Science, Machine Learning, Mathematics, Electrical Engineering, or related fields
  2. At least 2 years of experience in machine learning or engineering roles (5+ years preferred)
  3. Hands-on experience with ML models (including classification, regression, ranking, and retrieval) and quality evaluation (including LLM-as-a-judge), a solid foundation in statistics, and the ability to explain how these techniques relate to business impact
  4. Impact-driven mindset: able to judge task priority, collaborate across functions, and proactively drive work forward and surface risks
  5. AI-native development: work daily with coding agents that read the codebase, run tests, and iterate on their own, while you set the scope and review the diffs. Can explain and correct what the agent produced

Preferred Qualifications

  1. Experience leading projects
  2. Ability to form hypotheses and validate them: design experiments and A/B tests, interpret results, and take ownership of conclusions
  3. Background in embeddings and causal inference
  4. Engineering experience with AI / LLM applications (for example, serving and integration)

 

 

#LI-TC1

More jobs at Appier

Technical Support/Solution Engineer - Enterprise Solutions - JP

Appier · 3 days ago | Tokyo, Japan | On-site · Junior · Full time

Create CV

Software Engineer Intern, Ads Live Testing

Appier · Last week | Taipei, Taiwan | On-site · Intern · Full time

Create CV

Strategic Account Manager, Türkiye, Advertising Solutions

Appier · 2 weeks ago | Istanbul, Türkiye, Amsterdam, the Netherlands, Berlin, Germany +2 | Remote · Senior · Full time

Create CV

Campaign Management Team – Operations Assistant (Part-time)

Appier · 3 weeks ago | Taipei, Taiwan | On-site · Junior · Part time

Create CV

Technical Solution Engineer

Appier · 4 weeks ago | Seoul, South Korea | On-site · Mid level · Full time

Create CV
See all 65 jobs at Appier