Skip to main content
Baselines

Understanding Baseline Data: Simplified & Advanced

Updated over a week ago

Dashboard

To streamline data analysis, activate the baseline comparison feature in the plan builder. If auto baseline hasn't been activated, simply select the pre and post dates and click "compare" to generate a baseline report directly.

Colour Legend:

Purple = Improved Performance

Blue = No Change

Grey = Deteriorated Performance

Choosing Between Advanced and Simplified Baseline Data

Below, we have provided two approaches to Baseline Analysis. The first approach is advanced and is more suited for individuals eager to dive deep and highly optimize the training plan by examining each cognitive metric and maintaining a smaller tolerance limit. Then, we have the simplified approach, which focuses on the big three metrics. If all three metrics either improve or worsen, we recommend the next steps. You may want to start with the simplified approach, and as you gain a deeper understanding of cognitive data, you can switch to the advanced approach. The choice is yours.

Simplified

Grasping your athlete’s response to cognitive training is essential for fine-tuning performance enhancement strategies. Among the plethora of metrics, we emphasize the “Big Three”—reaction time, variation, and accuracy—as central to your decision-making process. Evaluating these metrics collectively rather than individually is crucial. Improvement in all three metrics indicates successful adaptation, while no improvement or deterioration suggests a need to reassess and adjust your approach, considering their interconnectedness.

How to Respond Based on The Big 3

When the Big 3 Have Improved Significantly (Over 5%)

An improvement exceeding 5% in reaction time, variation, and accuracy signifies successful adaptation to the current training stimulus. To further cognitive development:

  • Introduce a New Task: Choose a new task that targets the next cognitive demand.

  • Customize the Existing Task: Increase the task's intensity or duration, or both, applying a specialized training mode to increase cognitive load.

When Performance in the Big 3 Has Not Improved by 5% or Shows No Change

If there’s no improvement or the changes are less than 5%, it indicates a plateau or minimal adaptation. In such cases:

  • Reuse the Task: The current task remains valuable, offering the athlete another chance to meet its challenges.

  • Customize the Task: Adjust the task's intensity, extend its duration, or incorporate a specialized training mode to create a more tailored cognitive challenge.

Making Decisions Based on Key Metrics

Directly assessing the "Big Three" metrics is crucial for tailoring an athlete's cognitive training. Significant improvements suggest readiness for more challenging tasks or new demands. If not, the strategy needs tweaking. Decisions must hinge on these indicators to push or adapt an athlete's training effectively.

We suggest starting with the Big 3 and, as your skills improve, moving to advanced analysis. Analyzing data at the end of each training cycle can become overwhelming. Focusing on the Big 3—reaction time, variation, and accuracy—allows you to efficiently assess progress and make informed decisions for future training adaptations.


Advanced Analysis

In advanced analysis, you need to analyze each cognitive task individually and consider each data point on its own rather than collectively like the simplified "Big 3" approach. This detailed method provides deeper insights into an athlete's progress.

Think of your athlete's performance as a triangle with three points: speed, accuracy, and variation. The goal is to increase response speed without sacrificing accuracy or variation. However, it’s a balancing act, as adjustments to speed often mean trade-offs with consistency.

We suggest a 3-5% tolerance limit with an athlete's data. For example, if an athlete's reaction time is 3% slower, this is acceptable as long as their variation and accuracy have improved. But an increase in reaction time over 5% is a sign that they are slowing down too much. If an athlete's variability increases by 7% and their reaction time improves markedly, it indicates quicker cognitive processing. However, an increase in variability over 7% suggests they are faster but inconsistent.

With ongoing training, a balance between speed, consistency, and accuracy is achievable. It's vital to set realistic goals for each training phase, accepting that data may have its imperfections. Therefore, we suggest a 3-5% tolerance. You may also want to start with a larger tolerance threshold and decrease it over time depending on your athlete's performance.

This advanced approach examines each metric individually. For instance, your athlete may be slower but exhibit lower variation and higher accuracy. While the simplified version signals a need to adjust the plan when all metrics improve, the advanced approach offers a more granular understanding. Even if reaction time is slower, improvements in consistency and accuracy are significant. This represents a more detailed method of analysis.

Aim for a tolerance limit of 5% to balance cognitive performance, speed, and consistency effectively.

Cognitive Metric Goals and Flexibility

Metric

Goal

Permissible Flexibility

Acceptable Range for Change

Excessive Change

Reaction Time

Improve response quickness without compromising other aspects.

Tolerate up to a 3-5% increase in reaction time.

Up to 5% slower if variation is lower.

More than 5% slower is too much.

Speed

Enhance response speed without compromising other aspects.

Allow for 3-5% adjustment in response speed.

Up to 5% slower if variation is lower.

More than 5% decrease in speed is excessive.

Accuracy

Maintain high level without compromise.

Tolerate up to a 3-5% decrease in accuracy.

Up to 5% if variation is lower.

More than 5% decrease in accuracy is too much.

Variation

Find a balance between speed and accuracy.

Consistency adjustments within 3-5% are acceptable.

Variability increase up to 5% is acceptable with improved reaction time & speed.

More than 5% increase in variability is too much.

Examples of Advanced Analysis Scenarios

Analyzing advanced metrics requires understanding how different changes in performance indicators interact. Here are several common patterns and recommended adjustments:

Scenario 1: Reaction Time No Change, Variation Improved

When an athlete’s reaction time remains unchanged but their consistency improves, it indicates a positive trend. Imagine a drum beating steadily instead of erratically. This improved consistency suggests the athlete is tightening their performance. In the next training phase, maintain this consistency while working on reducing reaction time. It’s essential to balance speed, accuracy, and consistency.

Scenario 2: Reaction Time Improved, Variation Worse

Improved reaction time with more erratic responses is a common pattern. This isn’t true improvement as faster but inconsistent responses are not desirable. Focus on enhancing consistency while maintaining improved reaction times. Consider shortening task durations or using Variable Performance Feedback (VPF) mode for real-time speed comparisons, helping athletes maintain consistent performance.

Scenario 3: Reaction Time Slower, Variation Improved

Slower reaction times with improved consistency indicate that the athlete is becoming more consistent. Think of a metronome ticking with a consistent rhythm. This isn’t a performance decline but rather an improvement in consistency. In the next training phase, maintain this newfound consistency while working to reduce reaction times. Athletes need to be fast, accurate, and consistent.

Scenario 4: Reaction Time No Change, Variation No Change, HRV Improved

No change in reaction time or variation, but improved Heart Rate Variability (HRV), indicates better stress management by the nervous system. This is crucial for over-trained athletes. Focus on improving response consistency and reducing reaction times. With a better-equipped nervous system, continued training should lead to positive changes in cognitive performance.

Scenario 5: Reaction Time Faster, Speed Slower

Improved reaction time but decreased overall speed suggests outliers—extremely slow responses—dragging down the average speed. This highlights inconsistencies that reaction time alone might miss. These outliers could be due to distractions or lapses in concentration. Identifying and understanding these outliers is crucial to avoid being misled by seemingly better reaction times.

Scenario 6: Reaction Time Slower, Speed Slower, Variation Higher

Slower reaction time and speed but improved variation indicate that the athlete is slower but more consistent. This is a positive development in addressing consistency issues. The next training step should focus on building speed while maintaining the new level of consistency. Athletes need to balance being fast, accurate, and consistent.

Each scenario demonstrates the importance of a comprehensive approach. Whether it’s maintaining consistency while working on speed or understanding the impact of outliers, deeper insights are crucial. These insights enable the creation of tailored training programs, ensuring athletes are not just fast, but also accurate and consistent.

Data tells a story. It’s neither good nor bad—it simply is. By understanding the full narrative, you can make informed decisions that truly enhance athletic performance. Embrace the depth of cognitive data and unlock the potential to push your athletes beyond their limits.

Progressing the Training Plan

After analyzing the post-baseline data, it’s time to move forward with a new plan. If all cognitive demands have improved, that’s a great sign—just like in physical training, this means the athlete has adapted and their cognitive resilience has increased.

The next step is deciding where to go from here. If the focus remains the same, select new tasks, modes, and a suitable periodization model. If some areas still need improvement, prioritize those cognitive demands and adjust the training accordingly.

Adjustments to Consider:

  • Prioritize Weak Areas: Focus on demands that need the most attention.

  • Apply Specific Training Modes: Use different modes to increase challenge and effectiveness.

  • Adjust Task Parameters:

    • Increase difficulty

    • Adjust duration

    • Change task order and integration method

As with physical training, set clear goals for each plan. If you’re addressing the same demands, use the adjustments mentioned above. For new demands, follow the same process to ensure continuous progress.

Did this answer your question?