Job alerts, saved jobs and deadline reminders on your phone

Open app

Python Code Expert Evaluator for AI Training

Python Code Evaluator

Posted Nov 18

Key facts

Remote Python expert project reviewing AI-generated code; minimum commitment is 17–20 hours weekly.

Where and how
GlobalFreelance
Work model
On-siteHybridRemote
Level
Languages required
English
Education
Bachelor

Job description

Period – Project based Location – 100% remote We are looking for sub-contractors who can bill their hours. Project Description This project involves reviewing AI-generated responses, evaluating technical accuracy and best practices, and providing expert feedback that trains AI systems to write better code. You’ll work with various programming languages and coding challenges, ensuring AI outputs are functional, efficient, and follow industry standards. Hiring Profile BS, MS, or PhD with significant focus on Computer Science (Required). Expert in Python, with a strong grasp of algorithms, data structures, and debugging practices. Expert-level English proficiency with excellent writing skills. Expert at fact-checking information using public sources across multiple domains. Significant experience using large language models (LLMs). Strong analytical and structured thinking skills. Ability to explain complex programming concepts clearly and accurately. Prior experience with RLHF annotation (preferred). Prior Software Engineering work experience (strongly preferred). Expertise in additional programming languages (nice to have): C#, Java, SQL, C++, TypeScript, PHP, C, Go, Bash, PowerShell, Rust, R. Application & Onboarding Process Qualification exam (1–2 hours): evaluates your role-specific expertise. Compensation provided upon passing. Project exam (1–2 hours): evaluates your adherence to project guidelines and ability to produce Python-specific deliverables. Compensation provided upon passing. Commitment We expect a minimum of 17–20 hours per week; however, considering the project scope and timelines, the preferred and recommended commitment would be 8 hours/day.

About the role

Summarised by JobCrawls from the job ad above.

Requirements

  • BS, MS, or PhD with significant focus on Computer Science
  • Expert Python skills
  • Strong grasp of algorithms, data structures, and debugging
  • Expert-level English and excellent writing skills
  • Expert fact-checking using public sources across multiple domains
Show 4 more
  • Significant experience using large language models
  • Strong analytical and structured thinking
  • Ability to explain complex programming concepts clearly and accurately
  • At least 17–20 hours of weekly commitment

Responsibilities

  • Review AI-generated responses
  • Evaluate technical accuracy and best practices
  • Provide expert feedback to train AI systems to write better code
  • Assess code across programming languages and coding challenges
  • Ensure AI outputs are functional, efficient, and follow industry standards

Skills & technologies

PythonAlgorithmsData StructuresDebuggingFact-checkingLarge Language ModelsRLHF AnnotationC#C#
Show 11 more
JavaJavaSQLC++TypeScriptPHPCGoBashPowerShellRustR

Benefits & perks

Recruitment process

  1. Complete a 1–2 hour qualification exam; compensation is provided upon passing.
  2. Complete a 1–2 hour project exam; compensation is provided upon passing.

About MultiMind Bemanning AB

MultiMind Bemanning AB logo
MultiMind Bemanning AB · 2 open roles
View company
About the employer

MultiMind offers collective-agreement employment terms covering salary, vacation, pension, insurance, and sick leave, along with a dedicated consultant manager, varied assignments, networking events, and wellness benefits.

Never miss a new Python Code Evaluator job in Remote - Global

Weekly or daily digest. Unsubscribe anytime.

or

We'll email you a link to confirm. Confirming creates a free JobCrawls account for this address so you can manage your alerts. No password. Unsubscribe or delete it any time.