Preparations for cmme Evaluation

Evaluation practices prove that a correct evaluation plan should be developed and documented before the cmme evaluation, it is essential to ensure that an experienced, trained and appropriately qualified team can be used for evaluation to prepare for the implementation of the evaluation process.
Me
Results of the documented assessment plan, including requirements, agreements, valuation, risks, tailoring methods, and actual considerations related to the evaluation (such as schedule, logistics, organization background information ). In addition
Formal approval by the initiator for the evaluation plan should be obtained and documented. Prior to the development of an evaluation plan, the Protocol documented in the evaluation input should be used to facilitate the co-occurrence of evaluation objectives and key evaluation plan Parameters
Same understanding. Based on a common understanding of the key parameters in the driving plan process, the evaluation initiator and the scampi chief evaluators should reach an agreement on the evaluation plan; the initiators and evaluation team leaders should
Technical and non-technical details are agreed upon during the evaluation. This plan needs to be further refined in the execution of other plans and preparation phase activities.
Through the preparation of the evaluation team, an experienced,
Trained and precisely positioned teams are ready to perform evaluation tasks. Members of the group should have the knowledge necessary to complete their respective tasks, or their previous knowledge is proven sufficient to complete relevant tasks.
Service. The evaluation team leader has given each person the opportunity to practice the skills required to complete their respective tasks, or confirms that these skills have been demonstrated in the past. The group members understand each other.
Plan how they work together. It should also be done: the prepared Team serves the evaluation objectives, the team members have provided training and the training results are recorded, and what they do when necessary
Remediation has been completed due to insufficient knowledge or skills. We believe that no matter whether the evaluation team leader is training a brand new evaluation team from scratch, or by selecting a group from a rich team member,
It is their responsibility to ensure that they and the evaluation team leaders can form a successful group.
In order to illustrate our points of view, the preparations related to the cmme evaluation are listed in the actual operation sequence below.
1. Make appropriate tailoring
Because scampi is designed to meet a wide range of evaluation applications, tailoring is an activity worth careful attention. Scampi tailoring methods include: Selecting opportunities in required practice, setting parameters that can be changed during parameter and restriction evaluation, and including optional practices.
During the cropping process, note the following:
1. evaluate and select the cropping part in the practice required for each activity;
2. When expected changes occur, evaluate and set parameters within an acceptable range;
3. evaluate and select appropriate practices;
4. Ensure that the cropping results are consistent at the beginning and end, and are appropriate based on the evaluation objectives and constraints;
5. Generate the cropping result document.
MDD
The structure of scampi clarifies the characteristics of scampi, either as a direct derivation of the arc requirement or as a scampi requirement. Parameters and restricted zones are described in detail in the requirements of these methods and can be recognized
. The crop wizard and execution wizard are used to help adjust methods to adapt to the evaluation initiator goals and evaluation constraints. To some extent, the cropping method and the execution part must ensure that there is no need to violate the scampi
Practice.
2. Identify the resources required for evaluation
This activity is related to the evaluation and evaluation of the resources required for the evaluation. The resources required for the evaluation include personnel, equipment, tools, and information that is usable. Specific actions include:
1. Determine members of the Evaluation Team;
2. Determine the evaluation participants;
3. Determine devices and tools;
4. determine other required evaluation resources;
5. Documented resource resolutions in the evaluation plan.
This
In addition, the detailed level of resources required during the appraisal process must be sufficient to support the implementation of the evaluation plan. For example, determine the leaders of the evaluation team, the names of the candidates to be interviewed, and the names of those qualified members of the Evaluation Team.
The affiliation between the organization and the project, the location used by the evaluation team, the seat capacity and the Housing shape, and the special equipment required (such: high-camera projector, laptop projector, video conferencing ).
3. determine the cost and schedule required for the evaluation
This activity includes and lists a list of the maximum costs and schedules in the evaluation plan. Specific actions include:
1. Estimate the duration of critical events and use this as the basis for preparing a comprehensive schedule;
2. Estimate the efforts required by the personnel involved in the evaluation;
3. Appropriately estimate the cost of using tools and equipment;
4. estimate the costs of the event (for example, travel, accommodation, and meals );
5. Documented detailed estimation progress in the evaluation plan;
6. Document detailed estimates in the evaluation plan.
The achievement of the evaluation results depends not only on the evaluation team, but also on the expected participants in the Organization (for example, visitors, persons responsible for device management, attendees and supporters of the briefing ). Therefore, we must plan each day of the evaluation process.
4. Manage the logistics plan
This activity emphasizes that the logistics support details of each corresponding part of the evaluation process should be consistent and documented after negotiation. The evaluation team lead should obtain the support of the organization coordinator, manage the planned tasks in the document, and coordinate with the logistics support plan. Inspection systems and action tracking mechanisms are very useful organizational structures used to manage these tasks. Specific actions include:
1. Document the logistics support plan to enhance its reliability;
2. maintain communication channels with supply conditions;
3. specify responsibilities for tracking logistics support issues.
We know that an effective plan depends on the foresight of the change to the logistics support problem that may occur during the evaluation. These sometimes overlooked problems include:
1. Determine the hotel in the evaluation;
2. Provides workstation support;
3. Manage meals;
4. device interaction at a specific time point;
5. Meeting Security/grading requirements;
6. Provide a seal or management for the escort of a limited device.
5. Manage risks and document them
As any project depends on events, people, and other resources, risk management is an important factor in its success. The evaluation team lead is responsible for communicating risks and related risk mitigation plans between the initiators and evaluation team members, and generating documents. Specific actions include:
1. determine risk assessment;
2. propose mitigation plans for key risks during the assessment process and execute these plans as necessary;
3. Record the positions of risk assessment initiators and other risk initiators in risk assessment.
Risk Factors and mitigation plans identified through management of activities are essential elements of the evaluation plan. In the evaluation plan, most leaders should have the title of "Risk Management", and the level of effort focused on risk management activities is required by the evaluation team leaders to adapt to the upcoming situation.
6. obtain the permission for the evaluation plan
The evaluation plan should obtain the promise of the formal initiator. Since the Protocol is so formal, the evaluation plan needs to sign a contract between the evaluation initiator and the evaluation team lead. Specific actions include:
1. documented evaluation plan;
2. Review the evaluation plan with the evaluation initiator and obtain formal approval from the initiator;
3. provide assessment plans for risk owners for review.
The evaluation plan must include at least the following items:
1. Evaluation input;
2. Activities Performed in risk management;
3. resources required for risk management;
4. used to estimate the cost and progress required for completing the evaluation;
5. Logistical Support for evaluation;
6. Risk factors and mitigation plans related to implementation evaluation;
7. If the evaluation initiator requires that the inspection standards meet the requirements of ISO/IEC 15504.
This
In addition, we must provide a signature area for the evaluation team leaders and initiators to indicate their respective obligations in the evaluation plan. Of course, if there are other secondary supplementary materials for the evaluation plan, there is no need to re-sign the plan
Name, unless one or more evaluation input elements are changed. At least, members of the evaluation team should have taken into account the risk owner and should receive a response to the approved evaluation plan.
7. Select the evaluation team lead
Rating
The author of the evaluation has the responsibility to select a leader in the evaluation team, who should have sufficient experience, knowledge and technology to take charge of and lead the evaluation activities. An evaluation team leader must be authorized by the SEI Evaluation Program
The chief evaluators of scampi must also take good status as a member of the evaluation process. A detailed description of the SEI evaluation program is provided on the SEI website. The evaluation team leader has the responsibility to ensure that the evaluation is based on
Scampi requires that the cropping must meet the evaluation objectives and constraints that are allowed within the scope defined by this method. Specific actions include:
1. Select a chief evaluators authorized by scampi as the evaluation team leader;
2. Test the qualification (experience, knowledge and technology) of the leader of the evaluation team ).
Rating
The evaluation team leader must be an Sei-authorized scampi chief evaluator. This requirement must be made through the network or with the SEI
The cmme Office is directly contacted for confirmation. Only one formal evaluation team leader can be included in any ongoing evaluation. He is the only person who can judge the important tasks assigned to the evaluation team members,
He cannot assign his/her members leadership and ultimate responsibilities regarding the successful completion of the evaluation activities. Multiple evaluators in a specific evaluation team play an important role in the lead of the evaluation team. However
Evaluation Team leaders must fulfill their responsibilities in leading and managing the evaluation process.
8. Select evaluation team members
This activity includes identifying useful employees, assessing their qualifications, and selecting personnel from them as evaluation team members. It can occur after the evaluation initiator makes a commitment to manage the evaluation activities and can provide inputs for the evaluation plan assurance. Specific actions include:
1. Ensure that assessment team members meet the minimum individual standards;
2. Ensure that the evaluation team meets the minimum standards as a whole;
3. Document the responsibilities and qualifications of the members of the input group.
Scampi
The minimum size of an assessment acceptable team is 4 members (including group leaders ). The maximum recommended size is 9 members. All team members must complete the SEI recommendation and are recognized by the sei.
The cmme courses taught by the instructors. Team members must be trained on assessment methods. With regard to engineering experience, the evaluation team (as a whole) should have at least six years of experience on average, and the team's overall
Less than 25 years of experience, these rules are hidden in the evaluation activities. With regard to management experience, the overall experience of the Evaluation Team (as a whole) cannot be less than 10 years, and at least one member has more than 6 years of management experience.
Experience.
In general, the evaluation team should have representative experience in evaluating the lifecycles used within the Organization. In any particular lifecycle phase, the evaluation team should have at least two members with experience in this area. In addition, it must be ensured that the team members should not be managers of any specific project or be one of the direct management chains of any intended visitors.
9. Prepare the evaluation team
Rating
The evaluation team leader has the responsibility to ensure that the evaluation team members fully prepare for the evaluation activities of the implementation plan. This includes familiarity with the reference model, scampi, evaluation plan, organization data and
Features, tools and techniques, and assignment of tasks and responsibilities for evaluation tasks. Group building exercises are usually used to practice simple skills and reach an agreement on understanding the group's goals and how to achieve satisfaction. All group members are requested
Comply with strict rules to ensure confidentiality and protect the owner or sensitive data and the unknown information of project participants. Private statements are usually used to fulfill these understandings. Specific actions include:
1. Ensure that the evaluation team members have received reference model training;
2. training evaluation team members on evaluation methods or ensuring they have mastered this method;
3. Provide services for the establishment of evaluation teams and group specifications;
4. provide evaluation team members with positioning of evaluation objectives, plans and their assigned responsibilities and tasks.
Model training must be provided based on the authoritative standards of the cmme course and taught by the instructors authorized by the cmme office. Method training may be conducted through one of the following two methods:
1. Provide clear methodology training for the coming evaluation;
2. conduct methodological training for a large number of potential team members who are not currently engaged in any assessment.
Pair
A fully re-established team should be trained on methodology for at least two days, and it must be emphasized that the team members are likely to encounter situations during the evaluation process. This training does not need to include all
Variable. For potential future group members, group-based methodology training must include all content tailored to the methodology and allowed changes to cope with a series of future assessments that they may encounter love
Status. The SEI Evaluation Program sets additional requirements for training for those who are not currently members of the Evaluation Team. Those who have been trained as members in the previous evaluation team, if not
For the current method training, they are not automatically qualified to participate in the current evaluation. In such cases, the evaluation team leader asks for an understanding of the nature of previous training and training for the coming evaluation.
Enough content. This requires comparison of previous and planned evaluations. For example, if a team member participates in an evaluation that is only concentrated in the software engineering field using continuous notation, the planned evaluation is the level of use
Segment notation is concentrated in the SE/SW/ippd field, so the team members need to cover many important new concepts. As a whole, the evaluation team should generate at least one result to show what is coming soon.
Estimate the purpose of launching work and setting up group specifications and operational resolutions.
Summary
Above, we listed preparations related to the cmme evaluation in the order of actual operations during the evaluation process. In addition, we should also have some knowledge about the model tailoring principles during the preparation of the cmme evaluation:
1. In some applications, plan templates and routine procedures can be adjusted based on the evaluation needs, which is similar to local process ownership and facilitates communication;
2. A structured planning process group facilitates organizations with limited evaluation experience. Such a process is like a mitigation strategy and is a valuable opportunity for discovering risks;
3. Case study materials provide a variety of options to expand the content of group training to enhance the emphasis on those requiring training;
4. Experienced evaluation team leaders can also manage and simulate evaluation behaviors without case analysis;
5. it is important to manage the establishment of a group in a collection of all Members who have received training to ensure the cohesion of the team. Therefore, many groups can be used to establish exercises, the size, skills, and components of the group are all part of this method;
6. the tools used can include evaluation plan templates, samples, and embedded program help in plan templates. In addition, to estimate the impact of constraints, estimating worksheets and methods is also very useful.
In short, the evaluation of CMMs is a very complicated process. Due to its uncertainty, it is necessary to be prepared in practice. The truth comes from practice. We believe that as more and more software organizations begin to evaluate CMMS, more and more successful experiences will be used and used for reference.