How to assess the qualifications of a programmer within the framework of the competition so as not to violate 223-FZ?

Question

Law in IT

Hello Toaster!
There is software (custom development) that needs to be finalized, which means that since we do not have our own developers, we will make a competition.
The tender documentation must specify how the Bidder's qualifications will be assessed. Company with state participation, which means we will not pass by 223-FZ.

• It will not be possible to give a piece of code for code review, receive a report and evaluate, communicate with the Participant's team - the evaluation criteria are specific, subjective, there may be complaints to the FAS.
  
• Ask for copies of documents confirming qualifications - you yourself know how these documents are made in 1 day if necessary.
  
• To say: "Optimize the code", - to receive a complaint to the FAS with the words: "Why is my optimization worse than it?", - and so on,
  

What are your thoughts, colleagues? All criteria must be clearly stated in the tender documentation.
So far, there is only one thought in my mind: to make intentional errors in the code, including critical ones (because of which the software will not work) and ask them to be fixed. Look at the corrected and commented code and evaluate only by the number of errors found and fixed.

Answer 1

The presence of diplomas, certificates, reference list - everything that can be documented.

Answer 2

Give a piece of code for the purpose of optimization. You receive the optimized code from the candidate and run it through tests for speed of execution, code quality, and whatever your heart desires. Isn't there going to be some kind of evaluation commission of experts?

Answer 3

I will add only one point, that critical errors should be such that they will not be instantly found by a static code analyzer.
And I repeat my advice, which I already gave to someone here: if you have specific performers in mind that you cannot hire because of the stubbornness of the bureaucratic machine, then contact these performers so that they themselves participate in the preparation of the TD. They know better how to sell themselves more profitably.

Answer 4

Take a piece of code from your system. The code must either be smelly (see "Clean Code" by Robert R. Martin) or not fully solve your problem.
Let us have some kind of system module that must simultaneously process 1 million requests from users. When this module was originally written, they counted on 100 thousand, and at this point it works out in 2.3 seconds, however, with an increase in load, its operation time became more than 30 seconds.
The task and evaluation criterion is to rework this piece of code in such a way that for 1.5 million requests from users this code will work out in a minimum time that is lower than the current one.
When any of the participants applies to the FAS, you can get a piece of the code of the contractor with whom you signed the contract and show both the inspector and the offended participant that his decision is not the best of those that were obtained as a result of the tender, which is the reason for your the decision is not in his favor.
I foresee the question, what to do if the results of all participants are approximately the same (scatter range is not more than 10%)? To do this, in your evaluation task, you must provide for the second / third / fourth, etc. criteria for evaluation.
Set a sane quantitative indicator that can be measured: execution time for a given load, number of lines of code, a set of technologies used, the experience of team members, etc.

Answer 5

As usual, the state is insured. companies:
On paper, that is, request copies of diplomas in the specialty, all kinds of certificates on advanced training courses, etc.

Answer 6

If your task is to have a minimum of violations, and there is a desire to motivately butt heads with the FAS (this may happen), then each "thing" must be documented, i.e. legislated and justified. Only this is a weighty argument in the proceedings with the FAS and other regulatory authorities. So, we are trying to figure out what a qualification is and how it is objectively confirmed: diplomas, state-recognised certificates. According to diplomas, you can make requests to universities and the organizations that issued them and check for authenticity. But there is no way for the 44-fz and 223-fz to independently come up with some kind of testing or certification procedure for the customer.