Sunday, September 27, 2009

The effective implementation of multi-source feedback processes (360-degree reviews)



Multi-source feedback (360-degree review) is a useful mechanism to give feedback to an employee from multiple sources, including subordinates, peers, supervisors, as well as a self-assessment, and in some cases customers and suppliers.

Giving feedback consists of providing information about the impact of staff behavior on other people and / or the completion of a task. The importance of timely and accurate feedback is critical to increase staff performance. A quantitative study conducted by the Corporate Leadership Council (2002) revealed that fairness and accuracy of informal feedback increase staff performance by 39.1%. The same study revealed that the presence of 360-degree review (multi-source feedback) increases individual performance by 8.1%.

Multi-source feedback was initially instrumented for development purposes to increase the cognitive process of self-reflection among participants, and increase self-awareness. As multi-source feedback evolved, it has been linked to performance.



Origins
Bracken, Timmreck, & Church (2001) traced back the origins of multi-source feedback processes to the beginning of the 20 century when psychologists started exploring new methods for measuring performance and selecting employees. In the foreword of the textbook, David Campbell explains how MSF processes were implemented in organizations. The following paragraphs provide a brief synopsis.

In 1922 Walter Dill Scott, the director of the Committee on Classification of Personnel in the US Army, invented the man-to-man comparative scale to replace the traditional seniority system with a merit-based system. He started using the man-to-man comparison scale to measure and reward individual performance. Further improvements to this method included the use of “behaviorgrams” to better anchor evaluation scales.

Years later, the evaluations for supervisors included new dimensions such as personality, originality, leadership, organizational ability, cooperativeness, ability to develop workers, and technical ability. After the war, the application of standardized tests was commonly used by organizations to measure intelligence, mathematical and mechanical abilities, personal inventories and career surveys. These tests were scored by hand and results were only provided to organizations, never to individuals.

A study conducted with Marine officers in 1947 revealed that peer ratings were more accurate that several objective tests. Furthermore, peer ratings were more valid predictors of future performance than supervisor ratings. The critical incident technique developed by Flanagan was particularly useful because described examples of effective and ineffective job performance

In the 1960’s the National Computer Systems (NCS) automated the processing of psychological assessments. Despite the increased use of psychological assessments with the automation process, people’s resistance also increased because the tests included discriminating questions and were continuing being used unilaterally by organizations.

The Peace Corps, a government initiative created by President John F. Kennedy implemented the use of psychological tests, based on the premise that a better understanding of themselves would help individuals adapt to cultural change. This was the first time that results were provided to individuals.

In 1970 Robert Dorn who worked in the Peace Corps leadership training joined the Center for Creative Leadership (CCL) and introduced the practice of providing results of the assessment to the individual. Years later, Robert Bailey an economist that worked for Dorn, had the idea of including others in the assessment process and initiated the multi-source assessment process.

Multi-source feedback: Current trends
Research conducted by the Corporate Leadership Council (2006) revealed that over 80% of their member organizations use multi-source feedback. Moreover, 90% of Fortune 1000 companies use multi-source feedback. The frequency reported by organizations varies: nearly two-thirds of 56 surveyed organizations conduct once a year reviews or every two years, 31 percent of organizations apply multi-source feedback as needed, and 25 percent of organizations offer these reviews every other year.

Common applications
Most of organizations use multi-source feedback for development purposes mainly, however, some organizations use them for measuring performance as well. Most common applications are the following:
* Upward Feedback. Some organizations use multi-source feedback to assess their leaders’ strengths and identify development opportunities. Additionally, the process can detect organization-wide problems, and measure the alignment of leaders with key organizational priorities. The CLC reinforces the importance of using 360-degree reviews for leaders. CLC’s research “Voice of the Leader” (2001) reveals that companies with stronger leadership benches are four times more likely to outperform their industry peers in revenue growth over a 36-month period.
­* Development of staff. According to the CLC (2006) nearly 70% of organizations use multi-source feedback for development purposes only. The CLC suggests to concentrate on qualitative feedback on competencies and behavioral attributes.
* Succession planning. Some organizations use 360-degree reviews to identify employees with the necessary attributes to fulfill future leadership roles (high potential employees). In addition, these organizations target leadership development programs around their key talent to prepare them for future leadership positions.
­* Review staff performance. The review of staff performance should concentrate in at least two elements: the measurement of tangible results in terms of outputs and outcomes, and the actions that led to those results measured with multi-source feedback. The use of competencies with behaviors provides clarity of required performance criteria, allowing a consistent and transparent evaluation process.
* Compensation. Literature research indicates that few organizations use multi-source feedback for compensation decisions (salary increases and bonuses) because of potentially biased ratings. Additionally, when multi-source feedback is linked to compensation decisions, feedback provided loses its power as a developmental tool.

Benefits
Multi-source feedback provides a comprehensive insight into facets of employee performance and behavior by compiling feedback from multiple perspectives, and enhancing individuals’ understanding of how their colleagues perceive them and their work. Among the most important benefits are the following:
* Align performance with strategy. Competencies should be aligned with the organization’s mission and priorities. Furthermore defined behaviours should focus staff on specific results required for achieving current and future organizational goals.
* Increase transparency in the review process. The use of multiple feedback sources increases validity and acceptance from staff on the findings of the evaluation process. Additionally, the information includes valuable and complementary perspectives, for example, supervisors tend to base feedback on bottom line results and technical competence, while direct reports value factors such as their supervisor’s commitment to their development, and peers tend to focus on technical competence, teamwork, and collaboration.
* Reinforce desirable behaviors. The standardization of behaviors and competencies throughout the organization brings all employees to the same standard and allows them to focus on developing only essential skills.
* Identify and develop key talent. Multi-source feedback provides a transparent mechanism to identify staff with attributes and competencies necessary to fulfill key positions. In addition, the information helps to articulate targeted training and development programs to increase staff’s strengths.

Key Success Factors for Implementation
Many organizations fail to administer multi-source feedback effectively because they ignore essential supportive components such as proper alignment with strategy, linking feedback to training, and being aware of the influence of rater bias.

The effective implementation of multi-source feedback requires a proper alignment with the organizational goals, preparatory actions and follow-up support. The following four actions should be taken into consideration:

1) Increase alignment with the organizational priorities and objectives: Competencies and behaviors measured with multi-source feedback processes must be linked to business objectives, facilitate organizational strategy, and/or cultivate leadership characteristics
2) Eliminate biases by selecting raters that are familiar with the employee
3) Ensure a shared understanding of rating standards and criteria to prevent confusion among raters and prevent error. Raters should receive preparatory training to ensure a proper understanding of competencies, rating criteria and typical rating errors
4) Support employees during and after the process with coaching or mentoring activities to facilitate full understanding of the process, deal with strong emotions that may occur, and prioritize learning actions.

Bracken, D., Timmreck, C., and Church, A. (2001) emphasized the importance of enhancing rating ability and motivation to improve rating performance. The authors included a list of seventeen specific recommendations grouped in three categories: planning and development, implementation, and rater training.

The value of multi-source feedback is accurate feedback, therefore the 17 listed recommendations are a valuable checklist. Among other, the actions included a 2-3 hours of preparatory training to ensure a proper understanding of the multi-source feedback process, its objectives, competencies and behaviors, rating criteria, number and selection of raters, management commitments and allocated resources to improve on specific areas. Preparatory training is critical to help raters understand and avoid typical rating errors, such as leniency, harshness, central tendency, and halo error, ensuring a consistent criteria between raters.

Multi-Rater Feedback Processes in Development Institutions

In March 2007 an online survey was sent to 21 international organizations to identify multi-source feedback experiences and best practices. 10 organizations (48%) submitted responses. 7 of the 10 organizations reported using multi-rater feedback processes. Key findings are summarized below:
Surveyed organizations reported strengthening supervisory skills as the main objective for their multi-source feedback process. The second most common application reported was staff development/training.
* Managers and supervisors are the most frequent recipients.
­* Most organizations conduct multi-rater feedback processes on an as-needed basis.
* The majority of the organizations rely on customized multi-rater feedback processes.
­* Six of the seven organizations that reported using multi-source feedback incorporate competencies, typically 6-10 competencies.
­* All the organizations that reported using competencies include leadership competencies. They reported that the best sources of feedback for assessing leadership competencies are supervisors and subordinates.
­* Five of the six organizations (83%) that use competencies utilize interpersonal competencies. Survey results revealed that subordinates and supervisors are the best sources of feedback for interpersonal competencies.
­* Three of the six organizations (50%) using competencies include technical competencies. They reported that the best source for feedback are supervisors, followed by internal and/or external clients.

Activities reported to ensure an effective implementation
* The international organizations surveyed reported three activities to support the implementation of multi-source feedback processes: 1) the involvement of the employee’s supervisor, 2) training and learning resources, and 3) the use of external consultants as coaches.
* In addition, most of these organizations provide training sessions to explain the results to feedback recipients, following the application of a multi-source feedback process.
* Most organizations reported that targeted communication/training was critical to increase understanding and acceptance.
* To ensure an effective implementation, organizations reported starting the implementation with a top-down strategy. Additionally, organizations reported the need to assign a dedicated group to manage the implementation. The organizations also rely on technology providers to facilitate information gathering and report generation.

References
* Bracken, D., Timmreck, C., and Church, A. (2001). The handbook of Multisource Feedback: The comprehensive resource for designing and implementing MSF processes”, San Francisco, CA: Jossey-Bass Inc.
* Corporate Leadership Council. (2006). Considerations for implementing 360-degree reviews: secondary research findings, Washington, DC: Corporate Executive Board.
* Corporate Leadership Council. (2003). Trends in 360-degree reviews: literature key findings, Washington, DC: Corporate Executive Board.
* Corporate Leadership Council. (2001). “Voice of the Leader”, Washington, DC: Corporate Executive Board.
* Corporate Leadership Council. (2002). “Building the High-Performance Workforce: A Quantitative analysis of the Effectiveness of Performance Management Strategies”, Washington, DC: Corporate Executive Board.

24 comments:

  1. This is a really good summary of 360 Degree Feedback with some very interesting statistics, especially about what makes the process successful. We have found that additional success factors are:
    1. Proactive involvement by senior personnel/leaders, including visibly obtaining feedback from their teams and being up-front about what they are doing to change the behaviours they need to change.
    2. Linking 360 Degree Feedback to performance review/appraisal (making it part of the process, but not the only factor)
    3. Making the giving of feedback, especially by line managers, a key criterion for a good appraisal. The line manager needs to encourage the feedback process and actively give feedback and obtain feedback on his/her self. Line managers' attitudes and involvement in 360 Degree Feedback can have a huge effect on its success in the organisation.
    Jo
    http://tracksurveys.co.uk/

    ReplyDelete
  2. Dear Jo:
    Thanks a lot for your feedback and comments! As you clearly mentioned support and active participation of top management and line managers is critical. Best regards, Armando

    ReplyDelete
  3. A comprehensive discussion that covers a lot of ground. Like Jo, I think the success factors are particularly useful. However, I wouldn't necessarily always agree with her about aligning the 360 to performance appraisal. There are some pitfalls in this area and in my experience 360 feedback should be used with great care in this context.

    It is extremely effective as a development tool and if used well as part of a programme, can be a real catalyst for performance improvement.

    Thank you for a very thorough discussion.

    Vandy Massey
    www.engauge.co.uk/ask

    ReplyDelete
  4. Great article.. I also found this 360-Degree Feedback forum.Thought I'd share it.

    ReplyDelete
  5. The 360 feedback works by the incorporate the structured program of follow up the reinforcement, continued learning and the accountability to conduct orientation briefings.It gives a huge effect on its success in the organisation 360 feedback.

    ReplyDelete
  6. The 360 Feedback assessment offers the people in administrative positions, and the individual, a rounded version of how all stakeholders see the performance of the individual.360 Feedback is to communicate the intention to carry out the assessment to participants in advance,it is a useful mechanism to give feedback to an employee from multiple sources 360 feedback.

    ReplyDelete
  7. This comment has been removed by the author.

    ReplyDelete
  8. This comment has been removed by the author.

    ReplyDelete
  9. Hello sir,
    How are you,I read your blog ,and i want to suggest you a website Buy Google Reviews i think its should be helpful to you.
    Thank you

    ReplyDelete
  10. A useful and informative blog. Found something awesome! thanks for sharing Yeh Hai Mohabbatein Written Update with all of us.

    ReplyDelete
  11. Nice post. Thanks for sharing this informative information with us. It's very helpful, Self-Assessment Tax System in the UK.

    ReplyDelete
  12. I will recommend anyone looking for Business loan to Le_Meridian they helped me with Four Million USD loan to startup my Quilting business and it's was fast When obtaining a loan from them it was surprising at how easy they were to work with. They can finance up to the amount of $500,000.000.00 (Five Hundred Million Dollars) in any region of the world as long as there 1.9% ROI can be guaranteed on the projects.The process was fast and secure. It was definitely a positive experience.Avoid scammers on here and contact Le_Meridian Funding Service On. lfdsloans@lemeridianfds.com / lfdsloans@outlook.com. WhatsApp...+ 19893943740. if you looking for business loan.

    ReplyDelete
  13. How The Successful Use Social Media For Marketing

    You can also reach a greater number of promotions faster by using social media page.

    Tie in all your social media pages together with links. Add links to your blog where readers can follow you on Twitter, your website, and any social media profile that you own. Linking all of your social media profiles together maximizes your customer base.

    Take time when deciding what your overall strategy is all about. If you have to spend money on any social trends, you'll waste a lot of money and have nothing to show for it.

    Use email marketing and social media marketing. You can also encourage people to join your newsletter by adding a link to the registration page for instance.

    When you post your article, it appears automatically as a LinkedIn update. This will allow you to save time while gaining your business more exposure in the blogging community.

    Be prepared for the negativity that goes along with social media. Social media is great when you get praise, but there is also a negative side.Do not ignore them but answer them and help those customers who are unhappy.

    Your business can benefit from creating and maintaining an identity on social medial networks, as this is important to brand recognition and marketing. Customers are easy to reach with communication within a social media site, and media networks allow attracting customers beyond using the typical advertising outlets.

    ReplyDelete
  14. At A Loss With Internet Marketing? Begin Here With This Solid Advice

    Internet marketing can help your products or services get their site noticed online. It may seem simple, but you have to become educated on the topic of internet marketing in order to succeed at it. The powerful advice in the article below will give you on your way to becoming an expert in Internet marketing.

    Internet marketing means taking advantage of every possible software advancement in modern technology. If your company fails at using technology, the competition could leave you in the dust. Show them that you know about new innovations, and they will respect your products and decisions.

    You need to create a great site before you can attempt to get it ranked. This must be your first step in starting a web-based business. If you have a good website, good you will not have to change it as much over time.

    Get people to click ads by creating links to the product you sell. This will not look like a traditional advertisement.

    You can then identify which version is best by checking the number of new subscribers.

    Internet marketing is an ever-changing phenomenon and research. Many of these same people will advise you personally for a fee. You should thoroughly research your endeavor before deciding it is something you can hold onto easily.

    Give a variety of choices to people when they check-out.You could give a special promotion to previous customers.

    ReplyDelete
  15. Tips To Make Social Media Marketing Easier

    Think about using social media marketing as an advertising alternative that will boost your monthly stats. Sometimes, a fresh approach is all you need to enjoy renewed success. Utilizing social media marketing has several advantages. It is inexpensive, easy to use, and can help you reach a large audience. This article will outline several simple steps you can take when you start a social media marketing campaign.

    Post new blog content frequently and with regularity. When you have new information and your visitors are expecting new content, they will often come by to see what you have up. This is also the truth when people subscribe to other publications. Be sure you stay consistent so that visitors want to come back.

    Be careful if you are considering using a marketing company for social media. Unfortunately, a number of these firms have fraudulent schemes running and they prey on the inexperience of others.

    As you can now see, beginning a marketing campaign using social media is not difficult. Once you take those initial steps, staying up-to-date on new technologies will keep you relevant and profitable. You will only see a return on this type of marketing with consistent effort, so follow the above advice and schedule time to update your profiles regularly.

    ReplyDelete
  16. The World Awaits You: Use Our Social Media Marketing Tips To Succeed

    If you're jumping into marketing using social media tools, you have many elements to bear in mind. These networks are a fast track to business success today, if you know how to work them. But, figuring out where to start can be hard. Use the advice noted below to create a bulletproof social media marketing plan.

    When it comes to social media marketing the right way, it's all about the titles. It doesn't matter where you're leaving a post, you should focus on the right type of title.

    Businesses that rely on Twitter to promote upcoming sales should make an effort to interact with customers. Always thank people for sharing your posts, and acknowledge and answer any questions as soon as you can.

    Invite all your friends and acquaintances to visit your social media sites. Some of these people may not be interested in your business right now.

    One popular social media method is to allow an experienced blogger, who writes about the same product or service you sell, to write guest posts on your blog. Both avenues can bring increased traffic to your website. When guest blogging somewhere else, make sure they let you link back to a website of your own. When you have guest bloggers, provide them the same courtesy. These blogger's followers will probably investigate your website from either their blog or your own post.

    ReplyDelete
  17. Considering Social Media Marketing? These Tips Could Help

    You can use social media sites to do some very effective marketing, not just to keep up with your family and friends or play games. Social media networks will not work if you do not use the right techniques. Keep reading to find out how social networks can be used to develop your business.

    Social media marketing works better with large followings, so always invite everyone you see and know to join. Even if they don't subscribe or follow your page, they're at least being made aware of your company's presence.

    Try using YouTube as part of the marketing you use for social media, to help attract specific viewers to your website. YouTube is effective in drawing in newer visitors, since watching your video content should familiarize them with your products and services. If more new visitors reach your website after viewing your YouTube videos, they will have more knowledge about your products and potentially complete more purchases.

    In order to assist your site in becoming social media interactive, add comments and ratings. In addition, you should have the ability to be able to sort out items. When you add these popular functions, you empower your users to help choose your content and direct your efforts. They will appreciate the opportunity to participate actively.

    ReplyDelete
  18. How Small Businesses Can Win With Social Network Marketing

    There are several crucial things to think about as you venture into the world of social media marketing. One of the new ways you can advertise your business is through social media marketing. It can be difficult to know where to start in your social media marketing. Consider how the following advice can help your business capitalize on the many advantages of social media marketing.

    Figure out how much you want to engage with your customers. For building up sales, keep bells and whistles to a minimum, and use social media for advertisements. If you'd like to take it a step further and mutually communicate with your potential buyers, again, a minimal approach is best. Introduce yourself with a simple hello. You'll be lead by your customers from there.

    Finding the right way to promote your business through social media marketing will help to increase your company's visibility. When your business is visible and accessible through the social networks, it will successfully grow. Continue to seek information to assist you, and use the great advice you learned here to get you started.

    ReplyDelete
  19. My spouse and I stumbled over here from a different page and thought I should check things out. I like what I see so now i'm following you. Look forward to checking out your web page repeatedly.
    Conduct workplace investigations Perth

    ReplyDelete
  20. Ziyyara’s home tutor in Assam are well-versed and updated with IB, CBSE & ICSE curriculum. Get online tuition in Assam for class 5-12 for all subjects and ace your exams.
    Call Our Experts :- +91-9654271931

    ReplyDelete
  21. Thank you for sharing such valuable content please keep sharing like this. Also check for Corporate Leadership and People Management or many more.

    ReplyDelete
  22. This comment has been removed by the author.

    ReplyDelete