Example projects (project hub)

Potato aims to improve the replicability of data annotation and reduce the cost for researchers to set up new annotation tasks. Therefore, Potato comes with a list of predefined example projects, and welcome public contribution to the project hub. If you have used potato for your own annotation, you are encouraged to create a pull request and release your annotation setup.

Dialogue analysis (span + categorization)

yaml config

[launch] python3 potato/flask_server.py example-projects/dialogue_analysis/configs/dialogue-analysis.yaml -p 8000
[Annotate] http://localhost:8000
The log-in screen has an account creation button on the bottom right, circled in red.

Sentiment analysis (categorization)

yaml config

[launch] python3 potato/flask_server.py example-projects/sentiment_analysis/configs/sentiment-analysis.yaml -p 8000
[Annotate] http://localhost:8000
The log-in screen has an account creation button on the bottom right, circled in red.

Summarization evaluation (likert + categorization)

[launch] python3 potato/flask_server.py example-projects/summarization_evaluation/configs/summ-eval.yaml -p 8000
[Annotate] http://localhost:8000/?PROLIFIC_PID=user
The log-in screen has an account creation button on the bottom right, circled in red.

Match findings in papers and news (likert + prescreening questions + multi-task)

yaml config | Paper | Dataset

[Setup configuration files for multiple similar tasks] python3 potato/setup_multitask_config.py example-projects/match_finding/multitask_config.yaml
[launch] python3 potato/flask_server.py example-projects/match_finding/configs/Computer_Science.yaml -p 8000
[Annotate] http://localhost:8000/?PROLIFIC_PID=user
The log-in screen has an account creation button on the bottom right, circled in red.

Match findings in papers and news (prestudy test)

yaml config

[launch] python3 potato/flask_server.py example-projects/match_finding_with_prestudy/configs/match_finding.yaml -p 8000
[Annotate] http://localhost:8000/?PROLIFIC_PID=user
The log-in screen has an account creation button on the bottom right, circled in red.

Textual uncertainty (likert + categorization)

yaml config | Paper | Dataset

[launch sentence-level] python3 potato/flask_server.py example-projects/textual_uncertainty/configs/sentence_level.yaml -p 8000
[launch aspect-level] python3 potato/flask_server.py example-projects/textual_uncertainty/configs/aspect_level.yaml -p 8000
[Annotate] http://localhost:8000
The log-in screen has an account creation button on the bottom right, circled in red.

Immigration framing in tweets (Multi-schema categorization)

yaml config | Paper | Dataset

[launch] python3 potato/flask_server.py example-projects/immigration_framing/configs/config.yaml -p 8000
[Annotate] http://localhost:8000/
The log-in screen has an account creation button on the bottom right, circled in red.

GIF Reply Appropriateness (video as label)

yaml config | Paper | Dataset

[launch] python3 potato/flask_server.py example-projects/gif_reply/configs/gif-reply.yaml -p 8000
[Annotate] http://localhost:8000/
The log-in screen has an account creation button on the bottom right, circled in red.