HackerTrans
TopNewTrendsCommentsPastAskShowJobs

georgeutsin

no profile record

Submissions

Ford splits business into separate EV and combustion units

engadget.com
3 points·by georgeutsin·4 yıl önce·0 comments

Deep Floor Plan Recognition Using a Multi-Task Network with Boundary Attention [pdf]

openaccess.thecvf.com
5 points·by georgeutsin·4 yıl önce·0 comments

comments

georgeutsin
·5 yıl önce·discuss
Those skills are typically built through training anyway, but MTurk doesn't seem to have the necessary training pipeline.
georgeutsin
·5 yıl önce·discuss
How do you deal with respondents who just created their account?
georgeutsin
·5 yıl önce·discuss
Even with more pay, there aren’t any real repercussions for doing bad work. Sure there are different “tiers” of turkers, but realistically anyone could recreate their account once their rating gets low enough.
georgeutsin
·5 yıl önce·discuss
The problem of providing quality control is that there are a lot of edge cases; even known “high accuracy” turkers may have bad judgement sometimes, which means that every piece of data needs to be validated anyway, whether it be the researcher themselves or another paid contractor.

My undergrad thesis was to build https://tagbull.com, where we tried to have turkers validate the work of other turkers by breaking up a label into sub tasks, and getting multi-turker consensus on those before moving forward.

The main issue we ran into is that the incentive system is incredibly misaligned with the responsibility that the turkers have. It’s very difficult to build trust, especially with a crowd of people who haven’t signed contracts, and who face virtually no repercussions for doing bad work, whether intentionally or unintentionally.
georgeutsin
·5 yıl önce·discuss
Relevant xkcd https://xkcd.com/2341/
georgeutsin
·5 yıl önce·discuss
Looking forward to using this tool! Are there plans to make this open source?
georgeutsin
·5 yıl önce·discuss
This sounds like an echo chamber