Certified Inpatient Coder Remote Job at YO AI Labs, New York, NY

cjE4VW4yWFJvVXhMSzI2eTJCSzIxYXhWZWc9PQ==
  • YO AI Labs
  • New York, NY

Job Description

Job Description: Evaluation Specialist / Recent Graduate

Role Type: Contractor
Location: Remote

Job Summary

We are seeking motivated Evaluation Specialists and recent graduates to contribute to a high-impact project focused on advancing artificial this role you will use your research analytical reasoning and writing skills to develop challenging questions and evaluate AI model performance.

You will create original question-and-answer pairs conduct in-depth research verify information across multiple sources and provide clear explanations supported by reliable citations. No prior AI experience is required. Strong research abilities critical thinking and subject-matter knowledge are the key requirements.

Scope of Work

  1. Develop original challenging question-and-answer pairs designed to test the capabilities of advanced AI models across diverse subject areas.
  2. Conduct in-depth research and cross-verify information using multiple reliable sources to ensure accuracy completeness and strong supporting evidence.
  3. Create multi-step questions that require analytical reasoning synthesis and critical thinking rather than simple information retrieval.
  4. Test questions against AI models analyze their responses and refine the questions to adjust or increase their difficulty.
  5. Document research processes and provide clear citations evidence and logical explanations to support each answer.
  6. Revise and improve content based on reviewer feedback while ensuring compliance with project guidelines and quality standards.
  7. Maintain consistency accuracy and clarity across all submitted tasks.

Preferred Qualifications

  1. Strong ability to conduct independent research and critically evaluate information from multiple sources.
  2. Excellent English writing skills with a high level of precision and clarity. English fluency is required but does not need to be your first language.
  3. Ability to create nuanced well-structured questions that assess deep understanding and complex reasoning.
  4. Strong analytical thinking problem-solving and information-synthesis skills.
  5. Self-motivation reliability and accountability when working independently in a remote environment.
  6. Interest in emerging AI technologies and evaluating the capabilities and limitations of advanced AI models.
  7. Previous experience in AI training model evaluation research or content creation is an advantage but is not required.
  8. Open to recent graduates advanced-degree holders and candidates from diverse academic or professional backgrounds who demonstrate strong research and writing abilities.

Compensation Structure

Compensation is output-based with payment provided for tasks that meet the projects specifications and quality requirements. The time required to complete each task may vary depending on experience and workflow. Minimum submission requirements apply and contributors are expected to complete a specified number of tasks each week.

Start Timeline and Availability

  • Hiring Timeline: Positions are typically filled within 48 hours.
  • Availability: Candidates should be ready to begin promptly.
  • Project Start: Selected candidates are expected to start their first tasks within 2448 hours of completing onboarding.

Ideal Candidate Profile

The ideal candidate is a detail-oriented researcher and critical thinker who can develop challenging questions verify complex information and communicate findings with clarity and precision. They should be comfortable working independently adapting to feedback and maintaining high-quality standards while contributing to the evaluation and improvement of advanced AI systems.

Job Tags

Full time, For contractors, Remote work

Similar Jobs

California's Great America

Auto Mechanic Job at California's Great America

 ...quality seamless service. Maintains and monitors inventory levels for the gasoline, diesel and propane fill stations and associated tanks and refills small propane tanks as needed. Monitors, inspects, repairs, and tests all emergency back-up generators per schedule... 

Southern Illinois University School of Medicine

Pediatric Orthopedic Surgeon (Assistant or Associate Professor) SMS-3500 Job at Southern Illinois University School of Medicine

 ...academic position in the practice and teaching of orthopaedic surgery to medical students residents and allied health professionals providing...  ...a role model as a teacher in orthopaedics and rehabilitation pediatric orthopaedic surgery. III. Research 15% A. Stimulate and... 

Kah Landscaping

Landscape Designer Job at Kah Landscaping

 ...Kah Landscaping, with over 74 years of experience, is recognized for creating exceptional outdoor environments that blend artistry and functionality. As a Landscape Designer, you will have the opportunity to bring creative visions to life, working closely with clients... 

Virginia’s Community Colleges System Portal

English as a Second Language Adjunct (2027 Academic Year) Job at Virginia’s Community Colleges System Portal

 ...Job Description Germanna Community College is a public open access institution of higher education in the Virginia Community College System. The College is a dynamic learning organization that serves as a Germanna regional leader and preferred partner where quality... 

Haemonetics

Product Application Specialist Job at Haemonetics

 ...Haemonetics seeks a Product Application Specialist to provide technical support for medical device customers across North America. The role involves addressing product inquiries, delivering training, supporting new implementations, and collaborating across departments...