Shop Mobile More Submit  Join Login

:iconfeedbackfrenzy: More from FeedbackFrenzy

More from DeviantArt


Submitted on
July 10, 2012


5 (who?)

What did you think of Feedback Frenzy?

Tue Jul 10, 2012, 12:01 AM by ziinyu:iconziinyu:
Hello everybody, and congratulations on a great week! The last of the notes are trickling in with all your great comments + critiques. Pretty soon the admins will be cloistered away rating them all - but first we wanted to see what you thought about the contest!

Your Experience with Feedback Frenzy?

The first ever Feedback Frenzy contest is officially over!
We feel it was a pretty great success, what do you think?










We've been promising that we'll run another contest like this one, and we certainly will! To that end we'd really like to get your feedback on this one - what did you like and where were places where you see room for improvement? Let us know in the comments below!
We've put together a few questions to get the discussion going!
  1. What was your overall impression of the contest? Did you like enjoy being a part of it?

  2. Teamwork was a big piece of this! What did you think of being paired with different artists?

  3. This contest was about both giving and receiving feedback - how was the balance?

  4. How did this experience compare to other competitions you've seen on deviantART?

  5. What was your favorite part of the week?

  6. Your turn to be admin! What would you do differently?

  7. Next time we run this contest, will you play again?


We all put a lot into this (admin and participant alike) - and we got quite a lot out of it too! We asked for the best comments deviantART had to offer, and you delivered! So now we want to hear from the group and find out what everyone thought of the experience!

Update No. 1

Common suggestions and our thoughts on implementation!
It's only been a day since we posted this, and already we have lots of fantastic feedback from all of you! What else could we expect from this group? We've updated this blog to list some of the common suggestions we've heard, and our thoughts about them.

  • No teams at all! Individual contest.
    While we agree that teams are not strictly necessary for this competition, we had our reasons for including them! Part of our goal was to encourage the development of a critiquing community (that means more than just a one-on-one interaction with the artist)!

    • A system where individuals give and receive feedback among their peers.

    • Close interaction with other critics in a critiquing environment.

    • Friendly competition based on quality of constructive criticism

    • Some interdepence on other critics, motivation based on responsibility.

    Enough people enjoyed the team aspect that we will likely keep it around in some capacity. However, we'll definitely be sure to include major individual opportunities as well! Read below for some possible solutions!
  • Sign up as either an individual or a team.
    What if for future competitions, you could choose to play individually OR opt to be placed in a team? This way each participant can choose their own competitive environment!
  • Create your own teams!
    Another great idea! We thought about doing this for the first one, but thought that it might stack the deck too much. However by putting your own teams together you ensure that you are with a good group of people!
  • Group by medium/timezone.
    The goal for this contest was to group you by different media as there's a lot to be said for a fresh perspective! In the future though, we'd love to try some medium-centric teams! As for timezones, we'll be running monthly chat events with ProjectComment at different times of the day! This will be a great way to meet people from your part of the world and perhaps put together a team!
  • Larger teams (5 to 6 people).
    Definitely taking this one into consideration, it will help dilute the effects of inactivity but still make for a close group.
  • Require intra-commenting between team members.
    We didn't want to put too many requirements on this iteration, but we definitely hoped that deviants would start by critiquing their team!
  • More focus on team communication + activities.
    For future team-based contests (and individual ones) this will definitely be at the top of our list! We had a lot of team-focused events and activities planned, but didn't have time to get to them all with how busy projecteducate was! Here are some of the things we had planned (and will include at some point).

    • Introductions - A thread for the meet and greet! Introduce yourself to your team members and say why you like to comment!

    • Flash Feedback - All team members comment on a deviation together, group critique style.

    • Critique-Off - Pair up with another team and critique each other's work! A battle to the finish!
  • Sort them better (by medium or team)!
    This one is all ziinyu's fault! We only realized that we wanted a sorted collection about 6 hours before the start of the contest, and by that time it was too late to do them all by hand! So instead we just converted our participant list (where we had sorted you based on self identified medium) into the thumbnail post. Next time better organization for sure!
  • Ensure better distribution of critiques.
    This is by far the most difficult part of running a contest like this! We'd like to ensure that everyone receives comments evenly, but we have very little control over what you guys choose to critique! Most solutions involve limiting the amount of comments you can give, and we didn't really want to do that! Some possible options below.
  • Limit number of critiques for each piece.
    We debated a version of this for a long time in the back room before ultimately deciding against it. We came to the conclusion that we didn't want to do anything to limit your ability to critique. If you see a piece you want to critique, you critique it. It has to be that simple.
  • Include questions/concerns in the deviation description.
    A fantastic suggestion, we will definitely be including it in the next version!
  • Shuffle the order in the gallery.
    Logistically, this one is tricky, but if we come up with an easy way to do it, we'll implement it for sure! In the meantime, we'll more heavily promote other methods of viewing deviations.
  • Highlight non-critiqued deviations.
    We are developing a method of doing this as we speak! Ideally we'd be able to update a blog once a day with the deviations ordered by critiques received (so that it's easy to find the under-commented ones)! More information below.
  • Award individuals too! MVP recognition.
    Mum's the word on this one - wait until prizes are announced for this contest first!
  • Rate based ONLY on quality (not quantity).
    Part of the fun of this contest (we feel) is the intensity of it! For this reason, we do want to encourage people to write a lot of comments! HOWEVER, we would like to stress that quality means significantly more than quantity. The possibility is still open of doing a version of the contest where quantity is controlled or doesn't matter at all.
  • Bonus points for rating empty deviations.
    The difficulty with this kind of incentive is that the early bird gets a pretty big worm - it will be hard to balance it for those that start later.
  • Bonus points for critiquing outside of your medium.
    We'll need to figure out how to implement it, but this is a great idea for encouraging more cross-media feedback!
  • Make the rubric more transparent.
    Good idea! We don't want it to be so obvious that it becomes a checklist - but we would like to talk a bit more about what we are looking for in your critiques!
  • Participation reward for number of critiques.
    There's no accounting for quality here! We like the idea of participation being rewarded, but have to figure out a good system for it first.
  • Greater variety (in medium).
    This is all dependent on who signs up! If you'd like to help promote it to the smaller communities, we would be very thankful!
  • Longer time limit than a week!
    Definitely something that we will be playing around with in the future (in both directions). Some events might be two weeks, while others might be 24 hours or less!

So what's the end result of this? We have a lot of wonderful suggestions and a lot of possible directions to take future contests! It's looking like each contest will be a little different. Variety is the spice of life right? So we'd like to keep it interesting by continuing to develop the structure as we go, and offering you different opportunities with each competition!

Some might be individual only, others might have a strong focus on teams! We might take one and split it based on medium, or run another one rewarding exploration outside your field! There are a lot of fantastic things to come at FeedbackFrenzy and we'd like to continue hearing your thoughts and ideas!
Lastly we'd like to talk about a big development that's been happening in the backroom in the past few days. Originally created to help with the rating process, ziinyu (with the guidance of parallellogic) has put together a method of quickly and efficiently gathering data around deviantART (specifically within this group). We are now capable of obtaining near real time data on the comments you are leaving! What does this mean? A number of things!
  • The next time we run this competition, we won't need you to keep track of your [links] to comments, we can find them automatically!
  • Since we can track which deviations are receiving critiques, we can help highlight those that are still in need of them!
  • We will be able to provide statistics/counts for the ongoing competition!
  • This also opens the door to help facilitate more complicated contest structures!

Don't forget, we have a new contest all about using the feedback you received! Before & After @ FeedbackFrenzy

Add a Comment:
JamminJo Featured By Owner Jul 17, 2012  Hobbyist Photographer
Added to #DevNews posting later today ~ July 17, 2012.
Aeirmid Featured By Owner Jul 17, 2012   Digital Artist
Thank you! :heart:
GrauWeiss Featured By Owner Jul 14, 2012
Thank you all for this wonderful opportunity. I received a lot of constructive critique and met quite a few interesting deviants. Thank you for the organization and for the way you took care of all things. Below is the answer to your questions:

1. The contest was highly original and something the community from dA needed. There are many contest which encourage you to be creative but there are far fewer which focus on giving feedback.

2. being paired with different artist resulted in being able to split up the work and meeting new people. I have a few new watchers now and watched myself other persons.

3. The balance was surprising. I usually give a lot of feedback and receive much fewer in return. This time it was the other way around: I received more feedback than I gave. :faint:

4. In comparison to other contest, this one was very well organized and it seems that you took care of all details. It was clear from the beginning what each of us had to do and how.

5. Favorite part of the week? I think it was the 2. July when you announced the rules. I was really looking forward to that as I was eager to start the contest :D

6. If I were admin ... Hmm ... I don't think there is anything I could / want to change: You provided guidelines to what & how we have to structure our critiques. You gave us examples. You divided the deviations in categories so that we could find our way easier. You even grouped us based on our profiles so that a team is made out of a variety of individuals, not all belonging to the same medium. So nope, I don't think there is anything left to change.

7. Will I participate again? Definitely. Surely. For certain. Yes :eager:
I can barely wait for the announcement ;)
NominalFees Featured By Owner Jul 12, 2012  Hobbyist Photographer
This was an AMAZING contest, and I had a great time being a part of it! I have to speak to a couple of these discussions questions first, then I think I have an idea or two.

So while being part of a team was a really cool idea, I felt like I actually didn't have much contact with my team over the course of the week. While I ended up sending a lot of reminder notes to people (make sure you're linking, guys!) weirdly enough, I didn't receive that much talk back. I think that oddly enough, dA is made in a way that it mostly supports and artist's interaction with individual artists or the world, and no real happy medium except groups. Our teams didn't fit any of those profiles, so I found that I didn't know my team very well at the end! If you guys could find some way around this, for teams to chat as a group, that would be awesome.

I don't think that choosing teams is a fair idea. There are new artists and old artists around dA, and we can't limit the younger ones who have less connections. Also, while anyone can give a great critique, as a general rule, your ability to critique improves with your understanding of artist's technique, which mostly comes with experience. Therefore, I think it's important that we have teams of random and mixed skill levels to balance this out.

I think the best part of this contest is it's a really good chance for people to put themselves out there as artists and get people who'll follow their work, mostly because it's such a streamlined process. I was so happy to see the amount of comments on the deviations I put in when this contest was over. It was a magnificent experience!

I will definitely participate in the next round.

Here are some things I have to insert opinion on:

:bulletblue: Don't add incentives. I was a feedback-oriented critiquer; I think I wrote under twenty critiques by the time the contest was finished, but while my critiques were few, they were thorough. I think if anything, incentive should be offered for better critiques, and in fact it already is: more points. :P Basically, I think incentive tips the scale unfairly. People will critique however they choose. That's better.

Actually, I think that's it. For now, at least. :D
miontre Featured By Owner Dec 8, 2012  Hobbyist Photographer
Hey! :)
Just to let you know, in case you missed it - we've started the sign-up period for Feedback Frenzy 02! :la:
GabrielleIsabeau Featured By Owner Jul 12, 2012  Professional Photographer
For me, teams were a huge part of it . I'm not the type of personal who can motivate myself, so having a team relying on my participation as well, really helped me with the effort I put into the contest . Had the team not been there, I honestly would have given up after 4 Critiques . Thanks to them, I pulled out 18 long, in-depth critiques.!

As for the 'balance', I'm not sure how many I got apposed to how many I gave . I know I received about 25+ comments, but I feel like the quality of them wasn't always there . A few exceptions were ofcaurse noticed, but overall, I feel like I was getting less thought-out comments than actual critiques :/ I had put every effort I had in giving my 18 critiques, & I just wish others had put as much effort into the ones they did for me .
This also follows a point my teammate had stated in a previous comment on here : about the quality over quantity . If a team put out 30+ poorly thought-out comments (each), than even if the quality isn't there, the points will surely add up for them anyways.? I'm not 100% sure how the grading is done, but if another team only manages 30- critiques between them, then it seems mathimaticaly unlikely, regardless of the quality, that they'll win .

That's my only concern really ...

If the contest were to happen again, I'll definitely participate . I think dA can benefit from as many of these types of community projects as possible :]
miontre Featured By Owner Dec 8, 2012  Hobbyist Photographer
Hey! :)
Just to let you know, in case you missed it - we've started the sign-up period for Feedback Frenzy 02! :la:
ziinyu Featured By Owner Jul 12, 2012  Student Interface Designer
Glad to hear your insight on the teams as motivation - that sort of thing is very useful for us to know! As for the scoring, ^SanguineVamp is our resident statistician, and she's put together a system where quality means significantly more than quantity. I don't want to go into too many details, but it's sort of like quality is the primary factor, and quantity is bonus points, or icing on the cake.

We have a few plans in the works to highlight quality even within this competition! Whether that means additional prizes, features, etc. - we don't want to reveal yet. One thing is for sure though, we won't let high quality critiques go unrecognized. :heart:
GabrielleIsabeau Featured By Owner Jul 13, 2012  Professional Photographer
Glad to hear.! ^^
kampfly Featured By Owner Jul 12, 2012  Student Artisan Crafter
update comment: my only problem is with the teams thing. i mean, i'm SUPER happy you guys came up with all these changes so fast, and they really sound like they'll improve the game, but the teams section is just hard to define. i think if we let people choose whether to be individuals or teams, then individuals are basically screwing themselves, because you'd always have more advantage with more people when it comes to numbers like this. also, i'm uncomfortable with the idea of choosing my own team, because i'm usually on the short end of that stick, where i try to form a group but most everyone's already in one ^^;

just some thoughts. hope you don't mind - i know you guys work hard!
Add a Comment: