Technical Experts needed to stump AI Models
Help build a benchmark of real, expert-level problems that today’s best AI agents still can’t solve. Experts take a genuinely hard problem from their own field and turn it into a task an AI must solve from scratch in a Linux terminal.
The goal: stump the model. A task counts only if, when three frontier AI models each try it three times, they mostly fail. It’s not annotation — contributors design the problems that expose where AI still breaks.
Who we need:
-
Masters degree or higher
-
10+ years of professional experience in a technical domain
-
At least one publication (academic or professional)
Domains in demand:
-
Coding
-
Machine Learning
-
Systems
-
Security
-
Hardware
-
This is an ongoing project — at least 7 weeks
-
Onboarding process is approximately 90 minutes total
This enterprise client helps the world’s most innovative companies improve their AI models by providing human feedback.
About Lifted (an Upwork Company)
Lifted is a contingent workforce management platform owned by Upwork that provides enterprises with a unified solution to source, contract, manage, and pay contingent talent globally.
The platform addresses the fragmentation in contingent work by combining technology and global services into a single system, enabling organizations to hire faster, operate with compliance confidence, and gain real-time visibility across all external talent regardless of location or contract type.
Lifted focuses on reducing inefficiency, mitigating compliance risks, and providing transparency in the management of non-traditional workforce arrangements across any geography.
Human Resources Technology
Explore the company