What is a managed human feedback team?+
A dedicated group of verified raters who rank model outputs, score responses, test AI agents and write feedback against your rubric. The same people work your program week after week, under a named program lead, with QA audits, calibration and a weekly report.
Where are Etech's raters located?+
In our delivery centers in the United States, Jamaica and India. Programs can be staffed from one country, for example when US demographic fit or US data residency is required, or blended across countries for coverage and scale.
How does Etech verify that raters are real and fit the task?+
Every rater passes an identity and address check, a skills test, a live onboarding call and a short writing sample. A structured intake records domain experience, languages, location and demographics, and each rater is matched to the profile your task needs.
How do you stop rushed or AI-written feedback?+
Raters agree to a no-AI-assistance rule, work only in the tools you approve, and are audited every week. QA analysts check a sample of each rater's tasks for specific reasoning, real effort and signs of AI-written text. Gold items mixed into live work show whether accuracy holds up over time.
How do you measure feedback quality?+
Through qualification tests before live work, gold checks, weekly QA audits, calibration sessions and inter-rater agreement (IRR) measured with Cohen's kappa or Krippendorff's alpha. Targets are agreed with you at kickoff.
Which annotation tools do you work in?+
Your in-house platform, or a commercial annotation tool you license. Raters work only in tools you approve. ETS Labs can connect to your tool's API to bring daily output and quality data into the weekly report.
Who owns the data and the feedback?+
You do. Prompts, rubrics, model outputs and all ratings, rankings and written reasons belong to you. Etech does not use client data to train models, and data is returned or deleted at program end on your instructions.
How is a program priced?+
On delivered hours or on a single all-inclusive monthly rate that covers raters, team leads, QA, workforce management and reporting. There are no separate line items for supervision or quality review.