About the job
Company Description:
MillionLogics is a trusted Oracle Partner and global leader in IT solutions, with operations in London, UK, and a development hub in Hyderabad, India. Specialising in innovative and scalable services, MillionLogics empowers enterprises through data & AI, cloud solutions, IT consulting, and custom application development. With a team of 55+ technology experts, we deliver tailored solutions that foster digital transformation and operational excellence. We're committed to client success. We blend world-class technical expertise with strategic insight to deliver results.
Role Overview
We are looking for PhD level computer science experts to help fine-tune and evaluate large language models, including systems similar to ChatGPT. The role focuses on designing challenging, conceptual computer science problems that test advanced AI reasoning across topics such as algorithms, systems design, cybersecurity, theory, databases, networks, and other undergraduate to PhD-level computer science domains.
Offer Details:
- Pay: $250 Per task
- Mode of work: Fully Remote
- Commitment: 8 hours per day with an overlap of 4 hours with PS
Key Responsibilities
- Design advanced computer science problems that test AI model performance across conceptual and reasoning-heavy topics, including systems design, algorithms, cybersecurity, and other advanced CS areas.
- Develop clear, step-by-step reference solutions with rigorous logic, well-structured explanations, and defensible reasoning.
- Evaluate AI-generated responses for correctness, reasoning quality, completeness, clarity, and alignment with the intended problem requirements.
- Identify flaws, gaps, edge cases, and near-miss reasoning patterns in AI outputs.
- Collaborate with researchers to refine benchmarks across undergraduate, graduate, and PhD-level computer science topics.
- Provide structured feedback to improve problem quality, benchmark reliability, and model evaluation standards.
Required Qualifications
- PhD, completed or pursuing, in Computer Science or a closely related field.
- Strong computer science reasoning and problem-solving skills across advanced domains.
- Ability to design challenging conceptual problems that require deep understanding rather than straightforward recall or coding.
- Excellent written communication skills, with the ability to explain complex technical ideas clearly and logically.
- Strong attention to detail in evaluating reasoning, assumptions, definitions, edge cases, and solution validity.
- Ability to provide structured, high-quality feedback on AI-generated responses.
- No prior AI experience required.
Offer Details
- Commitments Required: at least 4 hours per day and up to 40 hours per week with 4 hours of overlap with PST.
- Engagement type: Contractor
- Duration of contract : 12 months
Evaluation Process
- Approved candidates will be sent a Job Interest Form.
- After the profile review, an assessment will be shared, which must be completed within 24 hours.
- Based on the assessment outcomes, shortlisted candidates will be contacted to schedule an interview.
How to Apply?
- Please apply over LinkedIn or send us your updated CV to CV@MILLIONLOGICS.COM with 79004 Computer Science - Domain experts in your email subject.