Influencer Marketing
Expand your reach and engage with your target audience using this trending technique that blends celebrity endorsements with social media marketing.
Leading High Performing Remote Teams
How can leaders ensure that performance remains high in remote or hybrid-work environments?
Design Thinking
Learn the 5 phases of this problem-solving methodology and switch from technology-centered to user-centered thinking.
Gantt Chart
Invented in the early 20th century, the Gantt Chart is one of the building blocks of modern project management. In this online course, you'll learn how this tool can be used effectively to monitor progress and achieve your team's goals.
Navigating Change Successfully
The working landscape is continually shifting and being disrupted, so how to employees maintain a sense of stability? Listen to CEO and president of Carl ZEISS Japan Stefan Sacre share his expertise on dealing with change in organizations and entire industries.
Halo Effect
The halo effect is often leveraged for marketing and promotion. But as a type of cognitive bias, it can also have a subconscious impact on decision-making in the workplace. Learn why and (how to overcome it) in this online course.
Anchoring and Framing
Want to increase your confidence during negotiations? Master the principles of anchoring and framing to take your negotiation skills to the next level.
ZOPA and BATNA
Understanding ZOPA and BATNA will help you become a better negotiator, create more value, and feel more confident at the table.
Content Marketing
In this course, you’ll learn how compelling blogs, videos, podcasts, and other media can reach customers and drive sales. You’ll also learn steps for creating an effective content marketing plan, and some important ways to measure its impact and success.
Content marketing is a essential digital marketing strategy for companies looking to provide relevant and useful information to support your community and attract new customers.
Get started on your content marketing journey today.
Sustainable Innovation in Times of Disruption: Choices for a Better Society
There are opportunities for progress all around us. The key is to innovate on these opportunities sustainably.
To help identify most effective path forward, you'll need to gain a global perspective to these challenges in an open discussion. How can Japan and the world take action to create a more sustainable, innovative world? Where do you fit in?
It's time to find out.
Social Media & Digital Communications: Impact on Global Public Opinion
Social and digital media have dominated the communications industry for decades. But it's no secret that social media has the power to sway public opinion, and the way in which many companies use these platforms could be seen as manipulative.
What do companies need to be aware of when utilizing social and digital media? How can these mediums be used to better communicate strategically with the world?
Discover what top media and communications experts have to say.
Blockchain
Blockchain is one of the most captivating technologies out there. Learn what it is and how to make use of its opportunities in this short online course.
Mehrabian’s Rule
The 7-38-55 Rule, developed by Albert Mehrabian, suggests that effective communication relies less on the words we choose than on our tone of our voice, appearance, and body language. Learn how to put this theory to use for better communication in business.
Pareto Principle
Your time and resources are limited. Efficiency means learning to prioritize. The Pareto principle (also called the 80-20 rule) can help you identify the best way to use your time for maximum results.
Country Analysis Framework
Overseas expansion requires careful planning. The Country Analysis Framework can help you look beyond an industry-level analysis and reframe your view based on performance, strategy, and context. Try this short course to learn how it works.
SECI Model
The SECI model illustrates how knowledge is created and shared. Learn how to put it to use for best practices, and how the Japanese concept of “ba” fits in to broaden your perspective.
Johari Window Model
The Johari Window Model is a self-awareness framework that helps you better understand . . . you. Learn how its four quadrants can help you identify gaps between how you see yourself, and how others see you.
Sunk Costs
Wondering if you should continue an investment or look for something new? Sunk costs can have a powerful psychological impact on decision-making. Learn how to recognize them to ensure rational decisions.
CAGE Distance Framework
Want to expand overseas? The CAGE distance framework can help ensure you're constructing a solid global strategy in four areas: cultural, administrative, economic, and geographic. Learn how to leverage useful differences between countries, identify potential obstacles, and achieve global business success.
Groupthink
Groupthink refers to group pressure and the perception of consensus which together lead to ill-formed decisions—or even unnecessary risks. Learn to identify the warning signs of groupthink and apply countermeasures in this online course.
Deductive and Inductive Reasoning
Solving problems with the best results means using two types of thinking: deductive and inductive reasoning. In this online course, learn to form a broad premise, make observations, and form conclusions from different perspectives.
Critical Thinking: Hypothesis-Driven Thinking
Anyone can come up with a good idea. The real challenge is putting that idea into action. In this online course, explore how to form compelling, testable hypotheses and bring ideas to life in your own organization.
Critical Thinking: Structured Reasoning
Even a few simple techniques for logical decision making and persuasion can vastly improve your skills as a leader. Explore how critical thinking can help you evaluate complex business problems, reduce bias, and devise effective solutions.
Critical Thinking: Problem-Solving
Problem-solving is a central business skill, and yet it's the one many people struggle with most. This course will show you how to apply critical thinking techniques to common business examples, avoid misunderstandings, and get at the root of any problem.
How to Dream
Join globally renowned author and Columbia Business School professor Dr. Sheena Iyengar as she explains how to approach your dreams with a new perspective. Learn to reflect on what you long to accomplish and what stands in your way.
Logical Thinking
Logical thinking is at the heart of confident, persuasive decisions. This course will equip you with a five-point approach to more becoming a more logical thinker. Learn to classify ideas and distinguish fact from opinion.
Investing & Diversity: The Changing Faces of Venture Capitalists
Is the venture capital industry embracing diversity in investors? Watch global venture capitalists from around the world discuss the state of things and what needs to be done for a more inclusive future.
Servant Leadership
There's more to leadership than driving a team to profit. In fact, there's a word for looking beyond self-interest to prioritize individual growth: servant leadership. Try this course for a quick breakdown of what that is, how it works, and how it can lead to organizational success.
Organizational Behavior and Leadership
Ever wonder what makes a great leader? Whether your role requires leadership or not, understanding organizational behavior is useful for your career. This course from GLOBIS Unlimited can set you on your way.
Leadership vs. Management
Leadership and management are different skills, but today’s leaders must have both. Try out this course from GLOBIS Unlimited to understand the difference, as well as when and why each skill is necessary for motivation, communication, and value.
Strategy: Creating Value Inside Your Company
Have you ever wondered why certain companies are more successful than others? The answer is strategy: internal processes that control costs, allocate resources, and create value. This course from GLOBIS Unlimited can give you the tools you need for that strategic edge.
Strategy: Understanding the External Environment
To plan strategy on any level, you need to understand your company's external environment. In fact, your level of understanding can impact hiring, budgeting, marketing, or nearly any other part of the business world. Want to learn how to do all that? This course from GLOBIS Unlimited is the perfect first step!
Using Japanese Values to Thrive in Global Business
Japanese companies have unique cultural, communication, and operational challenges. But they also have values that have led to remarkable longevity. Check out this seminar to hear how these values help earn trust from overseas head offices and develop employees.
Turnaround Leadership: The Differences Between Japan and the West
What's the best way for leaders to communicate a shift in corporate strategy? How do you even know when it's time for such a change? This course explains how Japan might have one answer, Western companies another.
Conflict Management
Conflicts in the workplace are inevitable. But they can lead to positive outcomes if they’re managed well. Check out this online course for a two-step process that can help you manage conflict successfully.
Evernote Founder: How Tech Startups Can Break through in Japan
Can startup models from Hollywood and Silicon Valley succeed anywhere? Phil Libin, cofounder and CEO of startup incubator All Turtles, explains how AI can solve everyday problems to bring products to market.
Women Empowerment: Lessons from Cartier
How can women overcome gender inequality and reach their leadership goals? Cartier Japan CEO June Miyachi shares her secret in this special course from GLOBIS Unlimited.
Marketing: Reaching Your Target
Every company works hard to get its products into the hands of customers. Are you doing everything you can to compete? In this course, you’ll find a winning formula to turn a product idea into real sales. Follow along through the fundamentals of the marketing mix and see how companies successfully bring products to market.
Marketing Mix
Seeing good products into the hands of customers is no easy task. The marketing mix can help. It's a collection of strategies and tactics companies utilize to get customers to purchase their products or services, and is an essential part of the overall marketing process.
The Principles of Negotiation
With the proper skills and attitude, anyone can become a successful negotiator. But first, you'll need to learn the basics to prepare for, assess, and respond to offers for the best results. GLOBIS Unlimited can help.
Negotiation: Creating Value
Want to create more shared value between yourself and your negotiation opponent? Discover how cognitive bias affects the judgment of others. Try this course from GLOBIS Unlimited to master the value of negotiation.
Finding Your Life Purpose with Ikigai
Ikigai can guide you in your quest for self-discovery. Listen to Japanese brain scientist Ken Mogi explain why and how.
Maslow’s Hierarchy of Needs
Want to leverage Maslow's Hierarchy of Needs as a leader? Try this short course to see how the theory can be applied in practical work scenarios.
Confirmation Bias
We all subconsciously collect information that reinforces our preconceptions. It's natural . . . but it does lead to a kind of flawed decision-making called confirmation bias. To become more objective and impartial, check out this course from GLOBIS Unlimited!
An Investor's Lesson to Entrepreneurs
Entrepreneurs have the power to transform societies for the better. But how do you attract investors to start or grow a business? Or to sell one? Check out this seminar for the answers to these and more, straight from a master venture capitalist!
Managerial Accounting
Managerial accounting is a powerful way to measure progress, identify problems, and meet your goals. Check out this course to learn how data-backed decisions can help you run your business.
Finance Basics: 1
For a healthy mix of quantitative planning, evaluation, and management, you need solid decision-making. And finance is the secret sauce! Get the essentials of finance in this two-part course from GLOBIS Unlimited.
Basic Accounting: Financial Analysis
Want to compare your performance vs. a competitor? Or evaluate a potential vendor? Then you'll need to conduct a financial analysis. This course will teach you how to use three financial statements and evaluate financial performance in terms of profitability, efficiency, soundness, growth, and overall strength.
Career Anchors
What drives you to be good at your job?
Career anchors are based on your values, desires, motivations, and abilities. They are the immovable parts of your professional self-image that guide you throughout your career journey.
Try this short GLOBIS Unlimited course to identify which of the eight career anchors is yours!
Digital Marketing Psychology to Transform Your Business
How does digital marketing really differ from traditional marketing? How is social media changing things really? And what's going on in Asia?
Pyramid Structure
Having the pyramid structure in your communication toolkit can not only help you approach a problem, but convince others that your solution is valid. Break away from linear thinking and test your logical thinking with this course from GLOBIS Unlimited!
Leadership with Passion through Kokorozashi
The key ingredient to success? Passion.
Finding your kokorozashi will unify your passions and skills to create positive change in society. This GLOBIS Unlimited course will help you develop the values and lifelong goals you need to become a strong, passion-driven leader.
AI First Companies – Implementation and Impact
AI is changing the way companies operate. How do you structure teams to increase efficiency?
Technovate in the Era of Industry 4.0
Is Industry 4.0 is the next step of human evolution human civilization? Dr. Jorge Calvo seems to think so. Join him to learn how the past can help you set goals for an exciting future of digital innovation.
Technovate Thinking
Business leaders of tomorrow need to harness the power of technology and innovation. That means understanding algorithms and how they drive business results. Discover opportunities to make technology work for your competitive edge.
Product Life Cycle
Every product takes a natural course through the market—there's a how, when, and why customers adopt products at different stages. Check out this course from GLOBIS Unlimited to find out how a product you use every day is part of this cycle.
Logic Tree
Logical thinking is the most valuable asset any business professional can have. That's why logic trees are such a valuable tool—they can help you identify a problem, break it down, and build it back up to a solution.
MECE Principle
Using the MECE principle can help ensure you categorize without gaps or overlaps. Check out this course from GLOBIS Unlimited for a practical demonstration of how it works!
In this series, we’ve established the foundational concepts of assessment quality and explored practical methodologies for item writing. Now, we tackle the most important—and often least visible—component: research and statistical validation. An assessment’s claims to validity and reliability must be proven through solid research.
This final installment of our series outlines the minimum statistical standards HR teams should demand from vendors. If the research fails to meet these criteria, you could be basing high-stakes decisions on fundamentally flawed data.
What Research Was Done to Make and Validate the Assessment?
Psychometric research usually begins with drafting a large pool of questions (plus rating scales and instructions), from which a subset will form the final assessment. The pool is refined through expert review and interviews with the target population. Next, data are collected—under Classical Test Theory (CTT), this involves administering the question pool alongside established assessments of the same, related, and unrelated constructs, as well as behavioral outcomes. Analyses then identify which questions to retain and provide evidence of reliability and validity. This process is often repeated across multiple iterations, refining subpar elements until a high-quality final assessment is achieved.
HR teams should check to see if the following minimum standards for this research have been met. The more standards met, the greater the trust that can be placed in the assessment. HR teams should ask:
Who Was in the Sample?
Large (typically, 300+ participants), diverse samples.
How Many Questions Were Tested?
Best practice is to begin with a large question pool. For example, a high quality assessment containing 30 questions likely was winnowed down from a pool of 300 questions.
What Analyses Were Used to Select Questions?
In Classical Test Theory (CTT), question selection typically involves Structural Equation Modeling (SEM)—at minimum this should involve two steps, both run on separate adequately sized samples: Exploratory Factor Analyses (EFA) and/or Principal Components Analysis (PCA) at step one, followed by Confirmatory Factor Analysis at step two. A widely supported alternative approach to CTT is Item Response Theory (IRT). IRT is sometimes necessary, such as for validating forced-choice assessments which are incompatible with SEM.
What Analyses Were Used to Check Reliability?
Evidence of reliability is gathered using the following analyses:
- Internal consistency reliability: Coefficient alpha, correlations (item-total, intra-item, inter-item), and factor loadings. Note: Coefficient alpha alone is not sufficient to demonstrate reliability because it has numerous limitations (e.g., nearly meaningless with assessments of 40+ questions).
- Test-retest reliability: Intraclass Correlation Coefficient (ICC), Bland-Altman Limits of Agreement (LOA), Pearson’s correlation.
- Inter-rater reliability: ICC.
What Analyses Were Used to Check Validity?
Validity is typically demonstrated by using correlation and regression to see how the assessment relates to or predicts other variables. For example, a psychological safety (PS) assessment should:
- Predict speaking up in meetings
- Correlate negatively with stress and positively with job satisfaction and an existing PS assessment
- High- and low-performing teams should have high and low scores, respectively
- Have no relation to irrelevant variables (e.g., “What device did you use to take the assessment: Mobile or Desktop?”)
Was Data Checked to Ensure Assumptions Were Met?
Most statistical analyses require data to meet a certain set of requirements called assumptions. If data fail to meet these assumptions, then the results of the analysis will be inaccurate and misleading—garbage in, garbage out. These assumptions may at first glance seem to be the kind of perfectionist nit-picking only scientists need worry about—but they are essential. It would be like baking a cake using salt instead of sugar—it’s all just a bunch of white powdery stuff, what’s the big deal?! No data will ever fit all assumptions perfectly, and the negative impact on quality will be proportional to the extent to which the assumption is violated. Instead, the important point is that HR teams would do well to:
- Ensure analyses were used that were appropriate for the data (e.g., avoiding correlation, regression, or factor analysis with data from a forced-choice assessment).
- Enquire about the process used to check and clean the data. For the above analyses, this would include checking for: missing data and its causes, normality (e.g., skew, kurtosis, QQPlots, Box Plots), linearity (e.g., scatterplots), outliers (e.g., mahalanobis distance, extraction communalities), multicollinearity (e.g., condition index, variance proportions), and factorability (e.g., Bartlett’s test of sphericity, Kaiser’s sampling adequacy, correlation and anti-image matrices).
Has the assessment been altered since validity and reliability data were collected?
Evidence of an assessment’s quality only holds when it is used in the exact form it was in during testing. Even minor tweaks—switching from a 7- to a 5-point rating scale, altering a label (“slightly agree” $\rightarrow$ “agree a little”), changing instructions (teammates $\rightarrow$ managers), or rewording a question (“errors” $\rightarrow$ “mistakes”)—can radically affect quality. Some changes are unavoidable, and not all are equally disruptive (e.g., rating scale changes matter far more than swapping wording in one question). But the safest approach is to use assessments in the form in which they were tested, limit modifications to what is absolutely necessary, and reduce trust in results relative to the degree of alterations.
Wrapping Up
Determining the research quality of an assessment is the ultimate safeguard against low-quality tools. HR teams must ensure vendors have conducted robust validation studies using large samples and appropriate statistical techniques like SEM or IRT. Equally important is confirming that the assessment has not been altered since its validation.
View these guidelines not as rigid rules, but as essential questions to gather information. For example, if a vendor offers a forced-choice format but provides evidence-based reasoning for its design, translates complex statistical results into meaningful reports, is transparent about limitations (e.g., not appropriate for direct comparisons), and backs all claims with high-quality evidence, HR teams can adopt it with confidence.
By demanding transparency in research, quality in item design, and adherence to ethical standards, your team can make informed, effective, and confident choices when selecting your employee analytics tools.
Related Articles
Japan’s Digital Nomad Visa offers a way to explore the startup ecosystem
