Prolific connects researchers and developers with a global pool of vetted human participants. Using the Prolific API, you can recruit participants in minutes to power workflows that require real human input, including:
- Post-training
- Model evaluations
- Red-teaming
- UX research
- and other human-in-the-loop tasks.
This GitHub organization contains open-source repositories, examples, and developer tools to help you integrate with and build on top of Prolific.
- 📚 Documentation: https://docs.prolific.com/
- 🌐 Learn more: https://www.prolific.com/
- CLI: Command-line tools for interacting with the Prolific API.
- Prolific Survey: A Python getting-started example showing how to use the Prolific API to launch a survey and collect high-quality human participant data for AI, research, and more.
- Prolific AI Task Builder: A streamlined workflow for collecting pairwise human preference data at scale for preference tuning and AI alignment research.
- Prolific External Study Link: A minimal, end-to-end example showing how to create and run a Prolific study that links participants to an external survey or application.
- Prolific Secured External URL: Minimal Python/Flask demo for running a Prolific study with full Secured External URL JWT verification. Deploys to Vercel and includes a live results dashboard.
- Post-Training with Prolific: End-to-end HITL post-training pipeline using Prolific for human data collection: SFT and DPO with real participant feedback.
- RLHF Data Collection Pipeline: Example for building, managing, and scaling preference data collection for AI using Prolific's AI Task Builder
- The Missing Red Line: How Commercial Pressure Erodes AI Safety Boundaries: Home for commercial pressure evaluations and the paper "The Missing Red Line".