Skip to main content
Leidos
Search
  • Global
  • Employees
  • Newsroom
  • Investors
  • Contact
  • Company
    • Our Business

      We embrace and solve some of the world's toughest challenges.

      • Civil
      • Defense
      • Health
      • Intelligence
      • Dynetics
      • Leidos Innovations Center (LInC)
      Gibbs & Cox-designed DDG-51 Arleigh Burke-class destroyer at sea

      Leidos completes Gibbs & Cox acquisition, expanding maritime undersea, autonomous and cybersecurity capabilities.

      Read Press Release

    • Mission, Vision, & Values

      Everything we do is built on a commitment to do the right thing for our customers, our people, and our community.

      • Mission
      • Vision
      • Values
      man sitting on bleachers holding soccer ball

      Let’s come together and talk about the changes that are needed.

      The Opioid Epidemic: A Call to Action

    • Leadership

      Meet the executive team responsible for leading our forward-thinking employees toward a shared success.

      • Roger Krone
      • Chris Cage
      • Maureen Waterston
      • Vicki Schmanske
      • Jerry Howe
      • Jim Carlini
      • Debbie Opiekun
      • Jim Moos
      • Gerry Fasano
      • Roy Stevens
      • Liz Porter
      • Steve Cook
      • Paul Engola
      • Board of Directors
      Roger Krone

      Meeting the challenges of an uncertain world.

      An Interview with CEO Roger Krone

    • History

      Leidos has a long history of innovative problem-solving and customer service, dating all the way back to 1969 when Dr. J. Robert Beyster founded his "crazy little company".

      • Explore our History
      • Dr. J. Robert Beyster
      • A Kaleidoscope of Innovation: The Story of Leidos
      Dr. Beyster

      Almost 50 years ago, visionary scientist J. Robert Beyster, Ph.D. founded the company that evolved into Leidos.

      Read More

    • Inclusion & Diversity

      Our commitment to inclusion and diversity is reflected in the way we engage our people, our customers, and our external partnerships through our innovative programs, sponsorships, and engagement.

      • Our Vision, Philosophy, and Approach
      • Strategic Diversity Outreach
      • Employee Resource Groups
      • Inclusion & Diversity in the UK
      Top Supporters HBCU badge for 2021

      Leidos was recently named to the 2021 Top Supporters of HBCU Engineering list published by Career Communications Group, Inc.

      Partnering with HBCUs

    • Responsibility & Sustainability

      We're equally committed to using our time and resources to support people, enrich communities, and protect the environment.

      • ESG Goals
      • CEO Message
      • ESG Initiatives
      • Executive Summary
      • Environment
      • Community
      • People
      • Suppliers & Small Business Relationships
      • Political Activities
      • About our Reporting
      • GRI™ Standards
      Leidos CEO Roger Krone

      Our response to COVID-19: A message to our valued customers, partners, and colleagues.

      Read Message

    • Ethics & Compliance

      We have a strong history of performance that rests on our foundation of integrity.

      • File a Report
      • History of Ethics
      • Ethics Program Structure
      • Code of Conduct
      Ethisphere World's Most Ethical Companies logo

      Leidos named one of the World’s Most Ethical Companies for fourth consecutive year.

      Read More

    • Rankings & Awards

      Our innovative approach and the services and solutions we deliver frequently earn Leidos recognition from our industry and the media.

      • Enterprise Awards
      • Defense Awards
      • Civil Awards
      • Health Awards
      A gold trophy on a light green background

      A frequent honoree on the corporate awards circuit, Leidos is proud of its many industry-specific and corporate-level achievements.

      Cue the Applause

    • Partners

      The Leidos Alliance Partner Network emphasizes connections through partnership and collaboration that drive innovation, advance technology, and build efficiency.

      • Corporate Strategic Partners
      • Technology Integration Partners
      • Emerging Technology Partners
      Bubba with helmet on

      We're teaming up with Bubba Wallace and 23XI Racing in 2022 advancing a culture of inclusion and diversity.

      Fueling a Better Tomorrow

    • Subsidiaries

      Our wholly owned and majority-owned subsidiaries attract and retain top talent motivated to deliver results for clients.

      • 1901 Group
      • Dynetics
      • Gibbs & Cox
      • Leidos Biomedical Research
      • Leidos Digital Solutions
      • BEONTRA
      • QTC
      • Leidos Engineering
      • Systems Made Simple
      • Varec
      Gibbs & Cox-designed DDG-51 Arleigh Burke-class destroyer at sea

      Leidos completes Gibbs & Cox acquisition, expanding maritime undersea, autonomous and cybersecurity capabilities.

      Read Press Release

    • Contract Vehicles

      Whether you’re a potential government customer or a prospective supplier, through this listing you can find our technical and professional services under pre-negotiated terms and conditions.

      • Governmentwide MACs & IDIQs
      • GSA Schedules
      • Agency Specific IDIQs
      • International
    • Global

      With more than 400 locations in 30 countries, we continue to expand our presence and strengthen our international relationships.

      • United Kingdom & Europe
      • Australia
      • Israel
      • Middle East
      • Canada
      Graphic showing buildings connected by technology

      Meeting UK border management security needs, now and long into the future.

      More on Border Management

    • Trust

      Cybersecurity and data privacy is central to what we do; protecting data, systems, and infrastructure that are critical to our employees, customers, communities, and stakeholders.

      • Commitment to Privacy & Cybersecurity
      • Cybersecurity
      • Data Privacy
      • Privacy Statement
      Citizens walking with data flowing around them

      Today, tomorrow, and every day is Data Privacy Day.

      Read the Article

  • Markets
    • Aviation

      From sidewalk to sky, we've got you covered.

      • Air Traffic Management
      • ANSP Professional Services
      • Security Detection & Automation
      • Intelligent Approach
      • Scenario Planning & Forecasting
      • Passenger Flow Measurement
      • FODD & Fuels Management
      • Flight Management & Briefing
      Leidos Smartlane in use at an airport

      Safeguarding travel and trade at a global scale, Leidos completes acquisition of L3Harris Technologies’ Security Detection & Automation businesses.

      Learn About Our Portfolio

    • Defense

      From our airborne work with sensors alerting warfighters to what's over the next hill to our autonomous maritime platforms protecting sea lanes and shores, our team is solving critical challenges across the globe.

      • Airborne
      • Autonomy & Autonomous Solutions
      • Command & Control
      • Cyber
      • Digital Modernization
      • Operations & Logistics
      • Training
      Gibbs & Cox-designed DDG-51 Arleigh Burke-class destroyer at sea

      Leidos completes Gibbs & Cox acquisition, expanding maritime undersea, autonomous and cybersecurity capabilities.

      Read Press Release

    • Energy

      Whether your mission involves nuclear site cleanup or power grid hardening, Leidos is uniquely equipped to support your important work as the world’s reliance on energy continues to increase.

      • Site Management & Operations
      • Power Delivery
      • Integrated Energy Management
      • Project Finance & Development
      • Digital Utilities
      • Advanced Communications Solutions
      • Manufacturing Systems
      Electricity pylons in sunny field

      Leidos delivers a complex modeling project resulting in a clear view of bulk electric and sub-transmission systems for FirstEnergy.

      Read the Case Study

    • Government

      We support important programs that expedite identity theft recovery, protect electronic health records, streamline paper tax filings, enhance consumer fraud investigations, support census data collection, and enable scientific research.

      • Cybersecurity
      • Digital Modernization
      • Health IT
      • Forms Processing
      • Operations & Logistics
      • Mission Software Systems
      IT analysts in discussion over monitors

      Leidos completes acquisition of 1901 Group, expanding digital modernization capabilities.

      Read Press Release

    • Healthcare

      We draw on decades of success to deliver a range of solutions and services to meet the healthcare challenges of today.

      • Hospital Systems
      • Federal Health
      • Military & Veterans Health
      Healthcare professional using tablet

      Taking a strategic approach to experience true digital transformation in healthcare.

      Read White Paper

    • Homeland

      Integrating, applying, and advancing IT to tackle the ever-advancing challenges of protecting our borders.

      • Biometrics
      • Mission Cyber & Network Defense
      • Integrated Systems
      • Digital Modernization
      • Data Analytics
      • Intelligence & Linguistic Services
      • CBRN Defense
      • Human Capital Services
      • Complex Logistics
      • Ports & Borders
      • Critical Infrastructure
      Leidos Smartlane in use at an airport

      Safeguarding travel and trade at a global scale, Leidos completes acquisition of L3Harris Technologies’ Security Detection & Automation businesses.

      Learn About Our Portfolio

    • Intelligence

      With expertise in cloud-enabled automation and augmentation and a team adept at harnessing machine learning, we’re applying powerful analytic tools for superior performance and protection despite a staggering breadth of data.

      • Intelligence Community Engineering
      • Collection, Analysis, & Reporting
      • Operational Support & Training
      Woman looking at computer screen reflection in glasses

      Our DevOps Lab is an advanced, unclassified, state-of-the-art center dedicated to software and hardware development and engineering.

      Learn more about the Lab

    • Science

      Providing groundbreaking scientific research and environmental management best practices that make headways in the defense, civilian, and health markets.

      • Life Sciences
      • Autonomous Systems
      • Airborne & Ground ISR
      • Command & Control
      • Electronic Warfare
      • Environmental Science
      • Modeling, Simulation, & Training
      • Sensors
      • Specialty Sciences
      Illustration representing health-focused scientific research

      NCI's Frederick National Laboratory has launched three initiatives focused on SARS-CoV-2.

      Read the Article

    • Space

      Speed, security, and scale for your most critical space missions

      • Mission Operations
      • Human Exploration
      • ISR
      • Payloads
      • Domain Awareness
      • Propulsion
      Female behind a transparent screen with text and graphs visible

      IT systems disappear into the background by providing an enhanced user experience

      Learn how IT Enables the Mission

    • Surface Transportation

      We help government agencies in areas like freight efficiency and connected and automated vehicles through transportation safety, operations, and system management.

      • Connected & Automated Vehicles
      • Human Factors Research
      • Analysis, Modeling, & Simulation
      • Transportation Safety
      • Operations
      • Asset Management
      • Accelerated & e-Construction
      • Freight
      • Research Facility Management
      Semi-truck driving on highway

      TransVM helps organizations drive down the cost of logistics while improving their on-time delivery.

      View Fact Sheet

  • Capabilities
    • Cyber Operations

      We use intelligent automation and AI/ML-driven analytics, combined with detection and mitigation, to protect and defend networks.

      • Zero Trust
      • Security Operations Center
      • Cyber Resiliency
      • Risk Management Framework
      • Cyber Analytics
      • Information Assurance
      • Insider Threat
      • Accredited Testing & Evaluation
      • EXCITE
      binary code

      Outpacing adversaries through the application of IT, engineering, and science.

      From Castles to Cities with Zero Trust

    • Digital Modernization

      We deliver resilient IT solutions and managed services that leverage trusted AI and full-spectrum cyber to decrease vulnerabilities in complex IT operations.

      • Application Modernization
      • Cloud
      • Data Center Modernization
      • Digital Workplace
      • Mobility
      • SecDevOps
      • User Engagement
      IT analysts in discussion over monitors

      Leidos completes acquisition of 1901 Group, expanding digital modernization capabilities.

      Read Press Release

    • Integrated Systems

      We deliver high-performing hardware and software systems to solve challenges in an array of specializations.

      • Assured-Position Navigation & Timing
      • Autonomous & Unmanned Systems
      • Biometrics
      • Security Detection & Automation
      • Sensors, Signal Processing, & Analysis
      • Space
      • Strike Systems & Hypersonics
      • TRAPS
      Gibbs & Cox-designed DDG-51 Arleigh Burke-class destroyer at sea

      Leidos completes Gibbs & Cox acquisition, expanding maritime undersea, autonomous and cybersecurity capabilities.

      Read Press Release

    • Mission Operations

      We leverage our in-depth domain knowledge and mission understanding to provide cost-effective tools and enhanced processes that are secure, resilient, and support our customer's critical missions.

      • Antarctic Support Contract
      • EngineeringEdge® NextGen
      • ISS Cargo Mission Contract
      • Leidos Performance Management
      • UK Logistics & Operations
      • StarTT®
      • Strategic National Stockpile
      Ice sheet in Antarctica

      Each year, Leidos moves more than six million pounds of cargo and coordinates 100 flight missions to and from Antarctica.

      About Our Role

    • Mission Software Systems

      Through disciplined processes, common tools, reusable frameworks, automation, collaboration, and domain expertise, our mission software systems are designed to deliver secure, mission quality software.

      • Command & Control
      • LEAF
      • SE Core
      • Tactical Data Links
      • AI/ML
      Software on a mission text on blue background

      Mission quality software. Silicon Valley speed.

      More on Building Better Software

    • Enabling Technologies

      Our enabling technologies are the backbone of our core capabilities, supporting our customer's important work from the front lines.

      • Secure, Rapid Software
      • Trusted AI/ML
      • Full-Spectrum Cyber
      • Rapid Prototyping & Manufacturing
      Military radar simulation with green display, showing a glowing grid with coordinates and positioning numbers

      How we are deploying AI to solve the world’s toughest problems.

      Artificial Intelligence in Action

    • Technology Certifications

      We partner with world-class technology providers to develop innovative solutions for our customer’s toughest challenges.

      • AWS
      • Cisco
      • Microsoft
      • Scaled Agile
      • ServiceNow
      group of coworkers looking at computer monitor

      We help our partners save money and improve performance.

      How the Cloud Saved Some Coin

  • Insights
    • Insights

      Expertise, industry leadership, unique perspectives, and more — directly from our employees and stakeholders.

      • Latest Insights
      • MindSET Podcast
      • Press Releases
      • Heroes of Leidos
      • Our Experts
      • Careers
      • Military & Veterans
      • Inclusion & Diversity
      • Community
      • Articles
      • Case Studies
      • Infographics
      • Q&As
      Microphones on a table in front of a purple background

      Listen to the stories behind the world's most important work as the MindSET podcast returns.

      Explore the MindSET Podcast

  • Careers
    • Latest Opportunities

      Keep up to date on the latest career opportunities at Leidos.

      • Military Veteran Program
      • External Referral Program
      • Intern & New Graduate Jobs
      • Careers with Leidos in the UK
      • Careers with Leidos in Australia
      • Opportunities for Leidos Employees
      People icons with gradient over

      At Leidos, we have a strong focus on our employees’ career, flexibility, and well-being.

      Learn more about Leidos Life

    • Life at Leidos

      A career at Leidos offers meaningful and engaging work, a collaborative culture, support for your career goals, while nurturing a healthy work-life balance.

      • Our Values
      • Our Culture
      • An Inclusive Workforce
      • Build a Career
      • Leidos Alumni Network
      People icons with gradient over

      At Leidos, we have a strong focus on our employees’ career, flexibility, and well-being.

      Learn more about Leidos Life

    • Pay & Benefits

      Pay and benefits are fundamental to any career decision, which is why our compensation packages reflect the importance of the work we do for our customers.

      • Compensation
      • Health & Wellness
      • Income Protection
      • Leave
      • Retirement
      • Family Benefits
      People icons with gradient over

      At Leidos, we have a strong focus on our employees’ career, flexibility, and well-being.

      Learn more about Leidos Life

    • Frequently Asked Questions

      Find answers to the most commonly asked questions related to securing a role at Leidos.

      • Searching for a Role
      • Applying for a Job
      • Determining Application Status
      • System Access
      • Job Eligibility Requirements
      • Receiving Job Notifications
      • Our Talent Community
      • Career Insights
      People icons with gradient over

      At Leidos, we have a strong focus on our employees’ career, flexibility, and well-being.

      Learn more about Leidos Life

  • Search Search
  • Company
  • Markets
  • Capabilities
  • Insights
  • Careers
Back to top

Breadcrumb

  1. Home
  2. Insights

Human factors from desktop to deep space

Kritina Holden head shot

Like lots of kids, Kritina Holden dreamed of working at NASA when she grew up. Not necessarily as an astronaut, just at NASA. However, unlike lots of kids, Tina’s dream actually came true.  

Kritina Holden, Ph.D., Technical Fellow in Human Factors at Leidos, has spent most of her career at NASA's Johnson Space Center, focusing on how humans interact with technology.

“Unlike a technology focused role, a human factors practitioner's role is to focus on the human user. It's not about what cool technologies can be brought to bear on a problem, but really about fully understanding -- what are the needs of the user in performing their task? And then what cool technologies might meet those needs?”

In this episode, Tina discusses how she got into the field, what being a Technical Fellow in Human Factors actually means, and what human systems integration is. She also shares some examples of how NASA is using human systems integration (HSI) in their program today and into the future as they plan for missions to Mars. 

“Focusing on the human means that you involve the user from the beginning. Try to understand their capabilities, the environment they work in, and the culture of the environment. We follow the well-known Human Factors maxim of know thy user - for they are not you.”

To learn more about how HSI applies to office applications as well as space travel, how movies often miss the mark when it comes to realistically usable technologies, and how someone aspiring to follow in Tina’s footsteps can achieve their NASA dream, don’t miss this enlightening episode.

On today’s podcast:

  • How human systems integration (HSI) differs from typical engineering approaches
  • The human-centered design (HCD) process
  • How NASA has used the HCD process
  • The benefits of HSI and HCD outside of NASA

Transcript

Kritina Holden: We know they're going to get deconditioned after a long duration in space. There's a potential for depression, loss of alertness, loss of situation awareness, all the things that you need to really focus and do a good job on these spacecraft tasks. So, it'll be a challenge.

Bridget Bell: Welcome to MindSET, a Leidos podcast. I'm your host, Bridget Bell.

Meghan Good: And I'm your host, Meghan Good. Join us as we talk with pioneers in science, engineering, and technology, to understand their creative mindset and share their stories of innovation.

Bridget Bell: Today, we're speaking with Dr. Kritina Holden, human factors technical fellow at Leidos. In our conversation, she shared her story of how she got into human systems integration, from a childhood dream to work with NASA, through her education, and now her position with Leidos and her work with NASA.

Meghan Good: We talked a lot about what is HSI and what does that really look like on an engineering effort? And then, how is that different than other engineering efforts?

Bridget Bell: Tina has spent most of her career at NASA's Johnson Space Center. And so, she shared with us some examples of how NASA is using HSI on programs today-

Meghan Good: As well as those programs that they're looking to in the future, the longer duration missions, those to Mars, and what challenges and constraints that they're trying to deal with as they're considering, “what is a human going to do in that environment?”

Bridget Bell: And then, she wrapped up the conversation by talking about how HSI can be used in a variety of different areas, not just space. And then, gave some really interesting resources for others looking into this topic or interested in a similar career. So, with that, let's get started with our conversation.

Bridget Bell: Welcome to MindSET. Today, we're speaking with Dr. Kritina Holden, Human Factors technical fellow with Leidos. Welcome, Tina.

Kritina Holden: Thank you. Thanks so much for having me.

Bridget Bell: Let's start with your role with Leidos and a little bit about your background.

Kritina Holden: Okay. Sure. I guess my story starts when I was about eight years old and I looked up at the moon and said, I want to work for NASA. I don't know what I want to do, but I know I want to work for NASA. So, I started college as a computer science major, but I was really always interested in psychology. So, near the end of my undergraduate career, I switched my major and minor because I was really more interested about the human using a computer than programming the computer to do the task, and particularly interested in how humans perceive and process information from the computer and how they interact with it. And, near the end of my stay at the university, a professor suggested, hey, have you heard about this field that combines computer science and psychology? It's called human-computer interaction. Well, that sounded great to me and put me on my path to graduate school.

Kritina Holden: So, I ended up going to Rice University in Houston. And I got a masters and PhD in engineering psychology. That was the name of the degree, but it was essentially human-computer interaction. And then, conveniently, already being located in Houston, I had an opportunity to go to work at NASA. So, this was my first real job. And I guess my dream has come true because I've spent most of my career at NASA Johnson Space Center.

Kritina Holden: In the past, I have worked in a web based training company. And I was the usability lead for an international enterprise software company. But I did come back to NASA. And currently I'm a human factors technical fellow with Leidos. I'm involved in space, human factors research. And I'm also a displays and control subject matter expert, working with spacecraft development programs.

Meghan Good: And wow, Tina. So, within your role and work with NASA, you focus on how humans interact with technology. What does it really mean to focus on the human?

Kritina Holden: Well, unlike a technology focused role, a human factors practitioner's role is to focus on the human user. So, it's a very different mindset. It's not about what cool technologies can be brought to bear on a problem, but really about fully understanding what are the needs of the user in performing their task, and then what cool technologies might meet those needs.

Kritina Holden: Sometimes the best answer is not the cool technology at all. It's just a better process or better designed display. Focusing on the human also means that you involve the user from the beginning, try to understand their capabilities, the environment they work in, and the culture of the environment. We follow the well known human factors maxim of “know that user, for they are not you.” This is really important. I don't know how many times I've heard a developer say, “well, this design makes perfect sense to me. I don't know the problem.” But it doesn't ultimately work for the user. People tend to think, well, I'm a human. I know what makes sense to another human. But this is really a bad assumption, as many poor designs have shown. I'm sure everybody's had the experience of working with a badly designed piece of software or a control panel in your car. So, we really don't want to make assumptions for the user. We want to bring users in early to see and interact with conceptual prototypes, involve them in early iterative testing.

Bridget Bell: So, throughout the MindSET series, we've talked about how we can use technology to enable our customers to focus on their mission. But it seems like your work is taking it even to a more micro scale focused on that individual human. And I know I've heard you say the term human systems integration. So, what does that mean? What is HSI? And how do you look at the human as a system?

Kritina Holden: So, HSI stands for human systems integration. And it's an interdisciplinary management process, or basically an overall approach that ensures, throughout development, the human operator is considered on the same level as the hardware and software, taking into consideration human capabilities and human limitations.

Kritina Holden: So, if we use the example of designing a vehicle, there's a team usually dedicated to focus on the power system, let's say. They must determine what inputs or data are needed to come into the power system to perform the functions of the system, how information will be output from the power system, what dependencies and interrelationship there are between the power system and other systems. The same questions can be asked and should be asked about the human. What information does the human need to perform their task? How will they provide information to other systems through inputs to a computer system? How are their actions dependent on other events in the system, for example.

Kritina Holden: So, just as there might be a subsystem team set up to develop the power system, ideally, there's an HSI team who will focus on the humans' needs, inputs, and outputs. They are specialists who will provide guidance about what should be done by the human versus automation, depending on the strengths of each. So, for example, computers are good at rapid responses, repetitive operations, calculations, remembering things, where humans are better at complex problem solving and adapting to changing conditions. So, if humans are using a system that requires them to remember things from one display to another, or to do mental math, that can result in errors, frustration, and sometimes be a safety risk. So, it's important to think about what functions the computer should do and what functions the human should do. The overall goal is to design the system to fit the user and not make the user adapt to fit the system.

Meghan Good: So, I guess with that in mind, I'm wondering what's different. So, how does this look different than a typical engineering development effort?

Kritina Holden: So, we follow a process called the human centered design process. And, in doing HCD, human centered design, we focus on meeting the user's needs, not just cool technology, as I mentioned. We bring that user in early versus having demos and testing after the product's already done. There's a lot of iteration, a lot of prototyping early on. We follow an iterative test, redesign, retest cycle, where we test users in realistic scenarios and we collect performance data. This allows issues to be identified early so that we can make changes when they're cheaper and feasible.

Kritina Holden: And the truth is, everyone will end up doing usability testing. It's just whether it's in the lab when it's cheap and easy to fix, or whether it's when the product is already out in the field, which means costly redesigns. We also have a lot of special methods for accomplishing human centered design. We have things like task analysis, cognitive walkthroughs, card sorting, reactive prototyping tools, Wizard of Oz techniques, and methods for measuring situation awareness, workload, and usability.

Meghan Good: Can you tell me more about what are Wizard of Oz techniques?

Kritina Holden: I knew that would intrigue you?

Meghan Good: I had to know. Do I click my heels together and I'm not in Kansas anymore?

Kritina Holden: You could, but actually it's a great technique for testing a prototype that's not fully mature. So, a lot of times during development, you might have a partially functional prototype, but you want to be able to test it with users. And maybe your prototype doesn't give actual responses. Maybe it doesn't actually function. So, Wizard of Oz technique means that you basically do smoke and mirrors. You fake it so that, as far as the user knows, the system is actually providing answers to the inputs they're giving. It's bringing up a display at their request, when actually there's no real background architecture going on. It's a person feeding them the appropriate display or sending the response. So, the user thinks it's real, but it's actually the man behind the curtain.

Bridget Bell: I love it. It's really bringing the user in early because it's before the system is even designed or ready.

Kritina Holden: Absolutely.

Bridget Bell: So, you talked through a lot of the benefits, and one of those being bringing the user in early and identifying those issues early. But what are more of those benefits? And what are some challenges that you've seen?

Kritina Holden: So, the benefits of this approach ultimately are you get designs that produce higher productivity. You have fewer service calls because users have been brought in early. They already have buy-in. They have had their needs identified, so the product works for them. You've identified user requirements up front, so you don't have the problem with requirements creep, which everybody has probably experienced in a development project. Early testing means that you identify issues early. So, overall, the life cycle cost is lower. And basically good designs reduce training costs, they reduce errors, and they increase safety.

Kritina Holden: Challenges are probably, at first, getting development teams to be open to new way of doing business. And then, also educating management about how investment in HSI will yield life cycle cost savings.

Meghan Good: That makes a lot of sense because it is a switch, a different paradigm there. Now, I wonder, what are some examples from NASA where you've used this approach?

Kritina Holden: So, I've got a couple that I can talk about. The first one is an older example, but it's a great example. It was work that we did for the International Space Station, or ISS. And it has to do with the respiratory support pack cue card.

Kritina Holden: So, on space station, they have medical supplies that are put into kits. They're like small suitcases. And one of those is called the respiratory support pack. On the lid of the pack, you have a cue card that contains very brief procedures or instructions for how to put the equipment together, how to apply it to the patient or the person in need to stabilize them. So, in this case that I'm talking, if someone was in respiratory distress, you would pull out the respiratory support pack, you would read the cue card, you would follow the instructions, put the equipment together, stabilize the patient.

Kritina Holden: And so, we had a training group come to us and say, we've been working with this cue card, but the crews, during simulations, have not been able to stabilize a patient within the required amount of time. They're just having a lot of trouble with the cue card. And it's interesting to note that all of the crew members, all the astronauts are not physicians. Many of them are not. They receive some medical training, but not a lot. And it may be that they received the training a long time ago. So they were having a lot of trouble with this particular cue card.

Kritina Holden: Since our expertise, part of our expertise, is information design, we thought it was an interesting project. We looked at the cue card. And it had a lot of text, a lot of text, very cluttered layout. And, if you think about it, reading is probably the last thing you want to do in an emergency situation. So, we removed all the unnecessary text. We added a schematic of the different parts of the equipment that needed to be assembled. We added color coding. We did about four iterations of testing where we identified problems, we would do a redesign, we would take into consideration recommendations from the users that we ran. And the final test, we found that people were able to complete the procedure in four minutes. So, that's a savings of three minutes. That's a huge deal with something like this. And that hard data led ISS to adopt the new cue card design. So, that was a very exciting project.

Meghan Good: Wow. That's incredible that you were able to save three minutes in an emergency situation. And what I'm most struck by is that it wasn't necessarily something very technical, but it really changed the outcome because you were considering the people who are using it and the stress of the environment they were in. That's so cool.

Bridget Bell: Yeah. I agree. Very interesting. So, do you have other examples that you can share?

Kritina Holden: I have another example that's kind of currently in work. The Orion Spacecraft is the vehicle that's going to take astronauts to the moon and Mars. And they have been in development for a while. And I used to work with that group. And one of the early challenges was figuring out how the cockpit would be designed and how astronauts would interact with it. The space vehicle, being brand new, is mostly a glass cockpit. So, unlike the old shuttle, which had hundreds and hundreds of switches and knobs, this allows crew to do almost all of their commanding with software. So, they needed some sort of cursor control device to interact with that software. At that point in time, touchscreen had been ruled out, so we really needed to think about what kind of device would work.

Kritina Holden: And the real challenge was that this device has to operate under vibration, acceleration, microgravity, ungloved, gloved, and pressurized gloved. So, that's a tall order, a lot of challenging constraints. So, to take this project on, we involved astronauts early. We did testing of commercially available solutions and decided that we would probably need a custom device. We started by making clay models. We did 3D models with 3D printers looking at different alternatives. We had astronauts put their hands on some of these models to figure out the best ergonomic form. We had astronauts suggest different types of controls. Maybe they had worked with a particular type of button or switch in a jet aircraft that they used to fly. We put all this together in a bunch of prototypes. We did a lot of iterative testing in the lab in a pressurized glove box with gloved subjects and in high fidelity mock ups. So, we have a lot of data on this device. Now, this device is going to be used in high fidelity testing and preparation for flight very soon. So, it's on a good path.

Kritina Holden: Similarly, the displays for Orion are being developed with the same type of process. We had very early prototypes that we had the astronauts look at and give their thoughts about. They've been heavily involved in iterative testing. And these prototypes have increased in fidelity over time. So again, we have lots of testing and lots of data before the solutions are locked in.

Meghan Good: So, Tina, I cringe every time I see cybersecurity broached on a TV show or in a movie. And I wonder, for you, do you do the same when it's about a character using a computer? Do you kind of cringe at some of the displays and how people are interacting with it?

Kritina Holden: I do. Also, just in general about human computer interaction things. Like there's this famous line where we always laugh. I think it was in a Jurassic Park movie. So, in the middle of mayhem, the young girl gets on the computer and says, “It's a Unix system. I know this.” And she just starts typing away like she's got it all figured out. Because, if you know Unix, of course you know how to break into the Jurassic Park system. It's pretty funny.

Meghan Good: But I wonder with that too, do you feel like a lot of the expectations from your human users are actually driven by some of the Hollywood aspects of what they're seeing? Since displays really are in movies all over the place and they kind of generalize the functionality and make it simple, do you then find that users want that?

Kritina Holden: That's absolutely true. And it's especially true with spacecraft user interfaces because we see so many super cool science fiction movies. And you see these really advanced ways of interacting with the computer. And then, what you find out is, when you come to work for the space program, that we actually have a big challenge in terms of radiation. And radiation in space is not only very dangerous for the human, but it's really hard on electronics. It burns holes in the chips, and it flips bits, and it causes lots of issues. So, a lot of the very fancy interfaces with nice graphics, and streaming video, and all these things that you might expect, are things that we really can't do with the radiation hardened components that we have to use for space travel.

Kritina Holden: So, it's a little bit of a let down sometimes when you see what some of the real user interfaces look like, some of the vehicle displays. You're like, wow. Those are like '60s style. They're very simple and they're kind of boring. They're very basic. They're meant to be usable, not meant to be flashy. But we're just not able to put all that fanciness in because we have to use radiation hardened components.

Meghan Good: And right there is that intersection between the field that you've been discussing with us and engineering. Right? Where there's these constraints, there's limitations, and you're trying to find that balance between what the human needs and what the system actually has to deliver.

Kritina Holden: Exactly.

Bridget Bell: And that balance of the environment. Like you're saying, in space, it's a completely different set of challenges as far as the resiliency needed. And so, that's super interesting.

Meghan Good: And I can't even imagine those future pioneers who are going to be in that team of four that you've discussed on their way to Mars, out of touch, and it's on them in space. That's amazing.

Kritina Holden: It is. And that's one of the biggest challenges on the research side of the house that I work in. That's one of our biggest challenges is figuring out how do we mitigate the extreme conditions they are going to be under and the things that it's going to do to them? How do we develop countermeasures for the isolation and the lack of communication with Earth? And, at times, they want him to be able to see the Earth. So, they're going to lose this Earth connected feeling. They're going to miss their families. It's just a lot to put on someone. And that ultimately is going to affect their performance, their ability to do their task, and do it with accuracy, and stay focused. So, we're very, very much thinking about, how can we help and support the crew that are going to be in this very challenging situation?

Bridget Bell: And you said, your degree is, the official title is engineering psychology. And so, that statement kind of wraps it all up of it's not just about the engineering and making sure the systems work and the humans can use the systems, but that psychology behind it, of what the users are going through in their body, in their mind. That isolation, it's a huge problem to solve.

Kritina Holden: Yeah. Absolutely. We know they're going to get deconditioned after a long duration in space. There's a potential for depression, loss of alertness, loss of situation awareness, all the things that you need to really focus and do a good job on these space craft tasks. So, it'll be a challenge.

Bridget Bell: So, all of those examples make me think back to the motto you said, the “know thy user for they are not you.” Because everything from as small as a cue card to the cockpit design and displays, you're considering how that unique human is going to be interacting. And so, it also makes me wonder, as we look into the future, how will HSI help NASA meet the challenges of those future longer duration missions?

Kritina Holden: So, first of all, more so than other domains, such as aviation, at NASA, when we build a spacecraft, we have very few opportunities to get the design just right. We build relatively few spacecraft as compared to airplanes, for example. So, once that design is locked down and the vehicle is put into operation, things are not very changeable. There will be minimal system upgrades, but in truth, once that spacecraft launches, updates and fixes are going to be a bit difficult. So, astronauts will have to live with the design as is for a potentially long period of time. So again, we need to get it right the first time as much as possible. That's why HSI and a focus on the human is so important.

Kritina Holden: And this becomes even more important with future long duration missions. Because, as we head to Mars, for example, there will be communication delays and blackouts. Crews will not have the near 24/7 access to mission control. Right now, mission control provides guidance, watches over crew tasks, corrects mistakes, provides reminders, helps with procedures, et cetera. And, on future missions, there are going to be times when four crew members are totally on their own to perform tasks and solve any problems that arise. Even more reason that we need good HSI to ensure things have an excellent design.

Kritina Holden: We also need this focus on the human to make sure that we provided the information and resources that these crews are going to need to operate autonomously. They're going to need things like intelligent information systems, decision aids, just in time training tools, troubleshooting software, and even simple software development tools. So, we also need HSI professionals to advocate for very simple designs, things that have small numbers of components so there are fewer things to fail. Things that are easy to train, that are easy to use, easy to repair. All of these things are extremely important as we develop vehicles that will go far beyond Earth.

Meghan Good: It's amazing to think about in those systems, those platforms, or whatever it's called, those vessels, those shuttles are in place for so long. I mean, you really do have to think about the design and how they'll be used in the future. But, as you've been talking about this, I wonder, with human systems integration and with human centered design, as you've been describing it, it seems to have a lot of implications even outside of NASA. How do you see this being applied across industries or other technology areas?

Kritina Holden: So, HSI absolutely applies across all kinds of development efforts, whether it's hardware, software, procedures, or training, anything really that involves human interaction. So, no matter the domain, we need to make sure solutions are effective, so they meet the needs of the user and they support task performance. They're efficient. That means they're easy to learn, easy to use. They don't result in errors that would require backtracking and redoing work. And satisfaction is also a goal. We want users to like and want to work with these products. Otherwise, what happens is they either won't use them or they'll find work arounds. And that can cause a lot of other problems. So, these types of goals apply to lots of domains and industries, control centers, aircraft, ships, spacecraft, office applications.

Bridget Bell: Yeah. It seems like that list of other applications could go on and on because humans are operating all kinds of systems. And so, having the user test it first and really having that human centered design, it seems like it could be very important across areas. So, I'm curious, switching gears a little bit, is there anything that stands out that really makes Leidos unique when it comes to HSI?

Kritina Holden: So, at Leidos, we have expertise, not only in how to work with development teams and facilitate human centered design and knowledge of the formal techniques and methods, but we also have researchers and behavioral scientists that can go a step further. So, if during development or before development, there is an open design question that requires a formal research study, our HSI team can do that. And let me give you a few examples.

Kritina Holden: So, you might say, we're building an automated system. How do we know if users are going to trust automation? How can we design it to encourage trust? Or you might say, we're designing a system with a complex control panel. How do we make sure users have adequate situation awareness? How do we make sure they don't have too high of a workload? Or we're building an electronic procedures product. How can we compare performance with the legacy system? What kind of data do we need to convince management that this is a better solution? To answer these types of questions, you kind of have to go beyond human centered design. You have to have expertise in formal research methods. And, at Leidos, we have that expertise as part of our HSI team.

Meghan Good: I love that idea, as we're definitely moving towards a more data driven world and where we want those comparisons. We want to be able to motivate the changes that we want to see happen. And really it's the users who are making that happen in the end. Now, beyond telling us a bit about Wizard of Oz techniques, I'm wondering, what recommendations do you have for someone interested in learning more or who is interested in a career in HSI?

Kritina Holden: So, the most common area of expertise within people working in HSI is human factors. So, if you're interested in getting a degree, you want to look for a degree program in human factors. Now, this can be tricky because different schools have different names for this general area. The program might be in the engineering department. It might be called industrial engineering. Or it might be in the psychology department and called human factors or engineering psychology. Or it might even be in the computer science department called human-computer interaction. Most of these are graduate programs. And there's also a great HSI certification program at the Naval Postgraduate School. But, if you just want to read more about designing for the human, you can check out the human factors and ergonomics society website, usability.gov. Or really you can just Google human systems integration or human factors. There are a lot of good books and online resources available.

Bridget Bell: I also listened to your interview, Tina, with NASA's podcast, “Houston, We Have a Podcast.” And I would say that's another great resource. And I think you gave a lot of interesting facts and tidbits about how NASA is using HSI during that interview. So, I'll make a plug for you there.

Kritina Holden: Well, thanks. Thanks.

Bridget Bell: So, as we wrap up, any final guidance or words that you want to share with our listeners?

Kritina Holden: I would say, whenever you're in the position of developing or creating something for human use, it might be hardware, software, procedures, training, anything, think hard about who is the user, what skills and abilities are they bringing to the table, what environment are they going to be using the product in, what is the culture, are there special considerations? Involve the users early and throughout the process. Develop multiple concepts or prototypes. And, most importantly, and something we see so often, instead of just asking them, hey, what do you think about this? Does this look good? Thumbs up. You really want to take a more formal approach to that. Be sure to include some testing where users are actually using the product in a realistic scenario and you're collecting objective data. So, you're collecting how many mistakes are they making, how long are they taking, any points of confusion along the way. That stuff is real important.

Kritina Holden: And finally, if you need to do something like this and it's really important, try to reach out to an HSI or human factors professional because they really have the knowledge and tools to make your product a success.

Meghan Good: That's wonderful advice. Thank you, Tina.

Kritina Holden: Thank you. I enjoyed it.

Meghan Good: Oh, well, thanks so much. And thanks to our audience for listening to MindSET. If you enjoyed this episode, please share with your colleagues and visit Leidos.com/MindSET.

Related Insights
View more Insights
  • Yoseph Asfaw graphic with Keeping IT Brief
    Using digital modernization to maintain efficiency
  • Keeping IT brief graphic
    Using ITIL 4 to grow federal health organizations
  • podcast microphone on table
    Crossing the technological valley of death with Steve Cook
Author
Meghan Good
Meghan Good Cyber Solutions Lead

Meghan is the Cyber Solutions Lead for the Intelligence Group. She is also a Technical Fellow and Solutions Architect who focuses on designing and delivering innovative solutions for Leidos’ customer challenges. In her spare time, she enjoys exploring the outdoors with her two young children, cooking with her husband, swimming competitively, and podcasting.

Share
  • Share on Facebook
  • Share on Twitter
  • Share on LinkedIn
  • Share via Mail
  • Print Insight

Posted

August 13, 2020

Estimated Read Time

Author
Meghan Good

Tags

Podcast
Experts
Space
NASA

Sign up for our newsletters

Stay up to date on our expertise, industry leadership, unique perspectives, and more by subscribing to our newsletters.

  • Company
    • Our Business
    • Mission, Vision, & Values
    • Leadership
    • History
    • Inclusion & Diversity
    • Responsibility & Sustainability
    • Ethics & Compliance
    • Rankings & Awards
    • Partners
    • Subsidiaries
    • Contract Vehicles
    • Global
    • Trust
  • Markets
    • Aviation
    • Defense
    • Energy
    • Government
    • Healthcare
    • Homeland
    • Intelligence
    • Science
    • Space
    • Surface Transportation
  • Capabilities
    • Cyber Operations
    • Digital Modernization
    • Integrated Systems
    • Mission Operations
    • Mission Software Systems
    • Enabling Technologies
    • Technology Certifications
  • Insights
    • Newsroom
  • Careers
    • Life at Leidos
    • Pay & Benefits
    • Alumni
    • FAQs

Want to know more?

Contact us about product information and pricing, customer feedback, stockholder services, or just to voice a concern.

Get started

  • © 2022 Leidos

  • Trust
  • Ad Choices

  • Privacy Statement
  • Email Preferences
  • Do Not Sell My Personal Information
  • © 2021 Leidos
  • Australian Privacy Statement
  • Australian Whistleblower Policy
  • Ad Choices
  • Email Preferences
  • Do Not Sell My Personal Information

Utility Footer Navigation

  • Products
  • Customers
  • Suppliers
  • Investors
  • Employees
  • Accessibility
  • Twitter
  • Facebook
  • Instagram
  • Linkedin
  • YouTube