Creating Projects
Set up annotation projects to crowdsource taste data from our network of qualified annotators.
What is a Project?
A project is a container for frames and taste profiles. When you activate a project on the marketplace, annotators can earn money by labeling your frames and making comparisons.
Organize Content
Group related frames and profiles together for focused annotation tasks.
Set Payment Rates
Configure per-label and per-comparison payment rates.
Content Modality
Support for images, text, code, websites, audio, and documents.
Annotation Types
Choose from labels (good/bad), comparisons (A vs B), or ratings.
Creating a Project
Via Dashboard
- 1Navigate to Projects in the dashboard
- 2Click New Project
- 3Enter a name and description
- 4Configure payment settings
- 5Click Create Project
Via API
curl -X POST https://api.commandAGI.com/api/projects \
-H "Authorization: Bearer YOUR_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"name": "Video Thumbnail Quality",
"description": "Rate video thumbnails for visual appeal",
"modality": "image",
"annotationType": "compare",
"centsPerLabel": 1,
"centsPerComparison": 2,
"platformFeePercent": 20
}'{
"project": {
"id": "proj_abc123",
"name": "Video Thumbnail Quality",
"description": "Rate video thumbnails for visual appeal",
"modality": "image",
"annotationType": "compare"
}
}Project Settings
| Field | Type | Description |
|---|---|---|
| name | string | Required. Project name (max 255 chars) |
| description | string | Optional. Project description (max 5000 chars) |
| modality | enum | Content type: image, text, code, website, design, audio, document |
| annotationType | enum | label (good/bad), compare (A vs B), or rate (1-5 scale) |
| centsPerLabel | number | Payment per label in cents (1-10000, default: 1) |
| centsPerComparison | number | Payment per comparison in cents (1-10000, default: 2) |
| platformFeePercent | number | Platform fee percentage (0-100, default: 20) |
Content Modalities
Choose the content type that best matches your annotation task:
imagePhotos, graphics, thumbnails, artwork. Supports JPEG, PNG, WebP, GIF.
textWritten content, marketing copy, product descriptions.
codeCode snippets with syntax highlighting.
websiteWeb page screenshots or live page embeds.
designUI designs, wireframes, mockups.
audioSound clips, music samples, voice recordings.
Annotation Types
Label (Good/Bad)
Annotators classify each frame as "good" or "bad" based on your criteria. Best for building initial training data.
Compare (A vs B)
Annotators choose which of two frames better matches the taste criteria. Produces pairwise preference data for Bradley-Terry ranking.
Rate (1-5 Scale)
Annotators assign a numeric rating on a scale. Useful for measuring perceived quality or preference strength.
Activating for Marketplace
Projects must be activated to appear in the marketplace. Before activating:
- ✓Upload frames for annotation
- ✓Set appropriate payment rates
- ✓Add budget to your project
- ✓Provide clear annotation guidelines
Toggle the project's isActive flag to make it visible to annotators.