NOV13 - Feedback

This thread is to discuss the overall experience of the November Challenge 2013. Feel free to express your views/feedback.

7 Likes

we have end sem exams in our colg and so cudnt spend much tym on november challenge… although the number of submissions for the problem PRETNUM has gone quite high now, it was a nice question for me to solve, implementing the segmented sieve for the first tym… i really wish i cud have spent a little more tym on CHEFGM… it was a really nice problem… what was disheartening though was that the five easy questions all had over a 1000 submissions, CHEFGM had 308, and the rest of the 3 problems 23, 21 and 9… it would have been better to have questions with gradual progressive difficulty… i really wish to be a part of a contest in which the number of submissions would be roughly as follows (1 being the easiest):

  1. 3000 (a beginners question)
  2. 1000 (easy implementation)
  3. 700-800 (medium adhoc implementation)
  4. 400-600
  5. 200-400
  6. 100-200
  7. 50-100
  8. 20-50
  9. 1-10

of course, its just my point of view… many of u wud obvsly differ…

17 Likes

I had a bad experience with one question in this November challenge.The question Yet Another Nice Girl took me a whole day to find an efficient way to solve it.It took me a lot of time to derive the formula and compute an efficient way since the constraints were huge…My solution involved not only ,Segmented Sieve but also Prime factorization to find the perfect square and hence I had to be extra careful with optimisations… It took me a whole day.
However. I was really put off when one of my associate just put up a few ist numbers of the sequence and after putting it in OEIS.com instantly came to know the formula i.e p^(q-1) where both p and q are prime numbers.This is not fair at all.Please its an earnest request to not put such questions whose formula can be easily found in OEIS.

@deepai_dutta i too spent more than a day on that problem… maybe that associate of urs submitted it in pretty quick tym… but i guess u must have had a lot of satisfaction after having solved it… i can say for myself that i was happy…

2 Likes

Yes as far as I am concerned I am really satisfied :slight_smile: got to learn really awesome things like how to do fast factorization even when numbers are greater than range of 10^6 :smiley:

this is what the motto of the contest is… that u learn new things, new algos… we shouldn’t be bothered by what others do :slight_smile:

1 Like

@deepai_dutta that p(q-1) thing is basic combinatorics, i learnt it in +1 only… :slight_smile:
so it was pretty easy…

3 Likes

1)Both the problems Superpowers of 2 and Missing some chairs were more or less based on fast exponentiation. I think problems should be from different areas as it helps to gain exposure to more topics.

2)The easy questions were too easy. There were 4 problems with almost 2000 submissions or more. I think there should be only around 2 and the other 2 problems should be around 1000-1500 submissions.

3)Problem Statements:
a)the problem statement for Chef Game had one very important piece of information missing. It should have been explicitly mentioned that “all numbers in the pile are unique”. b) The problem statement for Sereja and vectors was very difficult to understand and poorly worded. I hope more effort is put in framing of problems from next contest.

  1. If possible there should be another problem like Chef game with around 200-300 submissions. Most people got stuck on 6 problems as the problems ahead were very tough.

  2. Something should be done about comment moderation during the contest. Some user called mojojojo7 had put up link to a solution for Pretnum on a chinese website. Although it was deleted by @bruno_adm quickly, a fair number of users might have had access to it. Hope that was not the reason for the increase in submissions for pretnum towards the end!!

  3. There is a lot of confusion about the rejudging process for the challenge problem. I think the process should be explained or atleast we should be updated regularly about the current state of rejudging and when the process will be complete.

Overall it was a decent contest and Pretnum and Chefgame were really nice questions.

9 Likes

Very easy and very tough problems.

There is no moderate problems … Two easy problems should be replaced with moderate problems.
Most of the contestants solved 5 problems … While these contestants have huge difference between each other.

2 Likes

I liked the problem set, as I do every month, but as mentioned by @predator0 the problems were kinda “one sided”. I am using codechef for over a year now and it’s a wonderful site with lots of support, editorials, a good community and a lot of diverse algorithm problems but there are some issues that seem to be increasing contest after contest.

TEST CASES: In certain problems the test cases seem to be sort of weak.

Most users have experienced the consequences of not addressing this issue properly. If it’s caught early during the contest the submissions are re-judged and of course some solutions fall and it can be a frustrating experience for obvious reasons. If it’s caught close to the end of the contest, re-judging stops being an option because this approach doesn’t give enough time for the users to strike back but it still doesn’t feel right because wrong solutions were able to pass. What I suggest should be done is to put a little more work into generating test cases or to implement a system similar to what is used in codeforces and topcoder which is challenging submissions after the end of the contest, the later being my favorite option.

PROBLEM STATEMENTS: Some problem statements are kind of complicated to understand and unpleasant to read not just because of mathematical reasons and a few ones don’t have enough specifications.

A large part of the community doesn’t have English as their native language (that includes me) but since it is by far the language most used in IT it only makes sense to use it as a means of communication among the community. Of course grammar mistakes are expected but that doesn’t serve as an excuse to neglect in writing problem statements, grammar mistakes are not the biggest issue here. Some problems lack specifications which feels like an handicap to users trying to solve them. This is a very minor issue because it’s very rare and can usually be safely corrected during the contests but still I mentioned it just to be out there and on the mind of the problem setters.

COMMENT SECTION: There are some useful comments but sometimes it feels like a place of crying for help, providing test cases or to brag.

This issue bothers me a lot, even more than cheating and I’ll explain why in a moment. First of all, the comment section is to provide some feedback, regarding something that can’t be understood in the problem statement or some weird behaviour in the evaluation of submissions and it has been useful to correct some mistakes or to add important specifications in the problem statement itself but often it becomes a debate place and this is not entirely users fault. Usually, the users that post such comments are unfamiliar with the rules and/or don’t realise what they’re doing. What I don’t understand is why this is more strictly addressed in the cook offs. One of the rules in the cook offs is that admin will only publish the comment if the comment is appropriate, why can’t the same be done in long contests? I mean, it would make even more sense to apply this in the long contest rather than the cook offs. A cook off usually lasts 2 hours, give or take. A long contest usually lasts 10 days. Inappropriate comments can cause a lot more damage in 10 days. And since in every contest users get to “debate” the problem in the comment section it is becoming acceptable. This annoys me more than cheating because cheaters choose to do so, they are aware of the rules but choose to cheat, it’s not the community or admins fault but the comment section is supposed to be controlled to prevent the usual behaviour. I’ve often seen users provide hints right after solving the problem. That just takes the fun out of solving the problem, by providing hints we’re just preventing the other ones to learn something by themselves and we’re being unjust to the users who have already solved the problem. I believe that’s mostly to brag, showing that you solved the problem and somehow you’re the one who can help other users solve it too.

================================

So far I’ve only made critics but don’t get me wrong, I love codechef, the problems, the community, I truly think is an amazing place to connect with other programmers, to learn interesting stuff and to compete. I’m not trying to point fingers here and I don’t have any kind of hatred feeling towards anyone, everybody makes mistakes. The problem setters are doing an amazing job, I couldn’t dream that there were so many different problems with so many approaches, the little I know about algorithms I mostly owe it to codechef. I’m aware that the issues mentioned above are not easily solvable for numerous reasons: lack of people, lack of time and so on… I’m not an expert but I’m not useless either so I could provide help in assisting with the 3 issues mentioned. The reason I don’t want do so is because I would hate to miss a contest, since helping with the issues mentioned would give me an unfair advantage over the other competitors during the contest. As I said before I owe a lot to codechef, so I could eventually “sacrifice” a couple of contests to help out with what I can. I’m not trying to offend anyone, really, and nothing I’ve written here is final so if you disagree with me feel free to downvote but please comment as to why and give me a chance to either change my point of view or to provide a good argument to defend it. Oh and I know this thread is about NOV13 but I had to generalise because those things happen almost every contest.

5 Likes

At the moment I agree with point 6. The rejudging process for the challenge problem MUST be more transparent. The rejudging is currently not over and it’s not even sure that submissions are still being rejudged. The contest is not over until the rejudging of the submissions for the problem SEAVEC is over, so I prefer not to write any (more) feedback until the contest is really over.

@mugurelionut It seems that CodeChef announced on Facebook that the rejudging is done. I don’t believe it.

@admin Please look into the scores for the challenge problem as soon as possible. There is a lot of confusion whether all the submissions have been rejudged or not and the solutions are showing different scores in the practice section. Please clarify this immediately.

1 Like

@kevinsogo: Thanks for the link. I wasn’t aware of that. Yes, the rejudging is NOT over. But I am very disappointed to see that not even the admins have a method of knowing if the rejudging is over or not. I think now that this post-contest rejudging was a very poor decision, because it seems that the existing infrastructure is not sufficient for a smooth post-contest rejudging process.

6 Likes

@admin: As others have mentioned, please check if the rejudge had been run against all submissions or only the ones with TLE & WA? While the rejudge was going on, I noticed that only my submissions which were TLE were rejudged (inferred from the animated icon during submission judging) while the AC ones were not.

@deepai_dutta Just curious, whats with p^(q-1)? Is it that numbers of this form have prime number of factors? Please correct me if I am mistaken.

@beethoven yes. number of the form p^(q-1) have prime no. of factors provided both p and q are prime

  1. with the confusion surrounding the rejudging of challenge problem,
    serious thoughts must be put into this regard, looks like judging scheme was changed too soon, seems to be a bad decision specially right now.

  2. Regarding the question set there was wide difference in difficulty level of problems,
    ques GERALD2, MONOPLOY, QPOINT got less than 25 AC solutions each
    ques CHEFGM got 300 odd AC submissions.
    while other problems each got > 1000 AC solutions.
    What I want to say is that, there could have been more problems in CHEFGM difficulty level.(MEDIUM)
    Nothing needs to be said for challenge problem, it has got issues of its own :frowning:

5 Likes

When I started with Codechef, I don’t think questions (barring the first one or two) were this easy. In Nov’13, any beginner could solve atleast 4 questions, if not 5, quite easily and that too within the span of one or two days. This is not what the Long contest is meant for. If this be it, then better organize multiple short contests rather than a Long contest because it has started to become a bit boring. The first five questions (based on difficulty) are always based on implementation or Number Theory.
It would not be wrong to say that the first five questions (based on difficulty) could have easily appeared in a short contest and yet be solved by almost everyone who has basic knowledge of Number Theory.
That being said, I always look up to the Codechef Long contest. But it’s time the difficulty level is increased for the first few questions.

This is what I suggest as the pattern for Long contest: 1 cakewalk problem, 1 easy problem, 2 easy-medium problems, 2 medium problems, 1 medium-difficult problem, 2 difficult problems and of course, 1 challenge problem.

Another suggestion: Please show personal rank (Global and Country) on the contest page itself. We need to either search our name on contest ranking page (which is again messed up as it takes time of submission into account) or keep clicking on Next until we reach our name on the contest page.

6 Likes

There is an issue in the rejudging of challenge problem of November Long 2013. We are looking into this. We will let you know once we figure out the issue and do a rejudge again. Please bear with us.

We regret the inconvenience caused.

1 Like