referry - Job Search Platform Logoreferry
查看所有职位

Finance & Business Master’s/Ph.D. Research Report Evaluator (USA/Canada - Remote)

3 小时前发布|Canada, United States|$23-$38/h|Freelance|<3 years|Turing
Financial StatementsFinancial Analysis

💡 申请小贴士: 点击下方按钮会跳转到 Braintrust 官网申请。完全免费,同时也支持我们平台运营。
⚠️ 翻译说明: 本职位信息由AI翻译,如有任何不准确或歧义之处,请以英文原版为准。

Role Overview

This is a full-time if USA based (8 hours/day - 40 hours/week commitment) or part-time if Canada based(4 hours/day - 20 hours per week commitment) with at least 4 hours per day and a minimum of 20 hours per week, with a 4-hour overlap with PST. Contract duration is set to an initial 1 week.

About Turing:

Based in San Francisco, California, Turing is the world's leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing supports customers in two ways: first, by accelerating frontier research with high-quality data, advanced training pipelines, plus top AI researchers who specialize in coding, reasoning, STEM, multilinguality, multimodality, and agents; and second, by applying that expertise to help enterprises transform AI from proof of concept into proprietary intelligence with systems that perform reliably, deliver measurable impact, and drive lasting results on the P&L.

Role overview:

  • We are conducting an initiative that involves evaluating deep research reports generated by AI systems. Evaluators will read and assess reports across multiple quality dimensions using a structured rubric, providing both numerical ratings and written justifications.
  • This is a one-pass evaluation: each report is reviewed by a single general evaluator. The project covers hundreds of reports spanning diverse domains including technology, healthcare, education, science, economics, social sciences, arts, and more.

What does day-to-day look like:

  • Read the research query to understand the intent and scope of the assigned report.
  • Read and annotate the report using a PDF reader (Adobe Acrobat), highlighting key evidence and flagging issues such as broken links, weak sources, and claim-source mismatches.
  • Score the report across 10 dimensions on a 1-5 scale using the provided rubric.
  • Write justifications for each rating, referencing specific evidence from the report.
  • Submit results via a survey and return the annotated PDF.

Requirements:

  • Graduate student (Master's or PhD candidate).
  • Professionals with 1-3 years of experience in a relevant or adjacent domain.
  • Regularly reads and consumes research reports, white papers, or analytical documents.
  • Strong English reading comprehension and written communication skills.
  • Based in the USA or Canada.
  • Comfortable working with PDF annotation tools (Adobe Acrobat) and online surveys.
  • Familiarity with one or more of the report domains: technology, healthcare, education, science, economics, social sciences, or related fields.
  • Experience with quality evaluation, annotation, or data labeling tasks.
  • Attention to detail and ability to provide clear, evidence-based written feedback

What Turing is NOT seeking from your expertise:

  • Confidential or proprietary information from any employer or university.
  • Trade secrets or internal company or university data.
  • Specific client information or case details.
  • Any information that would violate NDAs, employment agreements or other confidentiality obligations.

获取个性化职位推送

💰 246 个高薪职位

绝不发送垃圾邮件
随时可以取消订阅
来自顶级平台的职位