Skip to main content
Leidos
Search
  • Suppliers
  • Employees
  • Newsroom
  • Investors
  • Global
  • Contact
  • Company
    • Our Business

      We embrace and solve some of the world's toughest challenges.

      • Civil
      • Defense
      • Dynetics
      • Health
      • Intelligence
      • Leidos Innovations Center (LInC)
      Tom Bell standing in a stairway at Leidos GHQ

      Leidos welcomes Tom Bell as incoming CEO.

      Meet Tom

    • Mission, Vision, & Values

      Everything we do is built on a commitment to do the right thing for our customers, our people, and our community.

      • Mission
      • Vision
      • Values
      man sitting on bleachers holding soccer ball

      Let’s come together and talk about the changes that are needed.

      The Opioid Epidemic: A Call to Action

    • Leadership

      Meet the executive team responsible for leading our forward-thinking employees toward a shared success.

      • Tom Bell
      • Chris Cage
      • Maureen Waterston
      • Vicki Schmanske
      • Jerry Howe
      • Jim Carlini
      • Debbie Opiekun
      • Thomas Sanglier
      • Jim Moos
      • Gerry Fasano
      • Roy Stevens
      • Liz Porter
      • Steve Cook
      • Paul Engola
      • Board of Directors
      Tom Bell standing in a stairway at Leidos GHQ

      Leidos welcomes Tom Bell as incoming CEO.

      Meet Tom

    • History

      Leidos has a long history of innovative problem-solving and customer service, dating all the way back to 1969 when Dr. J. Robert Beyster founded his "crazy little company".

      • Explore our History
      • Dr. J. Robert Beyster
      • A Kaleidoscope of Innovation: The Story of Leidos
      Dr. Beyster

      Almost 50 years ago, visionary scientist J. Robert Beyster, Ph.D. founded the company that evolved into Leidos.

      Read More

    • Diversity, Equity, & Inclusion

      Our commitment to diversity, equity, and inclusion is reflected in the way we engage our people, our customers, and our external partnerships through our innovative programs, sponsorships, and engagement.

      • Our Vision, Philosophy, and Approach
      • Strategic Diversity Outreach
      • Employee Resource Groups
      • Inclusion & Diversity in the UK
      Top Supporters HBCU badge for 2022

      Leidos was recently named to the 2022 Top Supporters of HBCU Engineering list published by Career Communications Group, Inc.

      Partnering with HBCUs

    • Responsibility & Sustainability

      We're equally committed to using our time and resources to support people, enrich communities, and protect the environment.

      • ESG Goals
      • Executive Summary
      • ESG Governance & Strategy
      • Environment
      • Community
      • People
      • Suppliers & Small Business Relationships
      • Political Activities
      • About our Reporting
      • GRI™ Standards
      NASA ground station

      Discover how we helped NASA develop a climate action plan

      Read Article

    • Ethics & Compliance

      We have a strong history of performance that rests on our foundation of integrity.

      • File a Report
      • History of Ethics
      • Ethics Program Structure
      • Code of Conduct
      World's most ethical companies logo

      Leidos named one of the World’s Most Ethical Companies for sixth consecutive year.

      Read More

    • Rankings & Awards

      Our innovative approach and the services and solutions we deliver frequently earn Leidos recognition from our industry and the media.

      • Enterprise Awards
      • Defense Awards
      • Civil Awards
      • Health Awards
      A gold trophy on a light green background

      A frequent honoree on the corporate awards circuit, Leidos is proud of its many industry-specific and corporate-level achievements.

      Cue the Applause

    • Partners

      The Leidos Alliance Partner Network emphasizes connections through partnership and collaboration that drive innovation, advance technology, and build efficiency.

      • Corporate Strategic Partners
      • Technology Integration Partners
      • Emerging Technology Partners
      Bubba Wallace image

      We're teaming up with Bubba Wallace and 23XI Racing in 2023 advancing a culture of inclusion and diversity.

      Fueling a Better Tomorrow

    • Subsidiaries

      Our wholly owned and majority-owned subsidiaries attract and retain top talent motivated to deliver results for clients.

      • 1901 Group
      • Dynetics
      • Gibbs & Cox
      • Leidos Biomedical Research
      • Leidos Digital Solutions
      • BEONTRA
      • QTC
      • Leidos Engineering
      • Systems Made Simple
      • Varec
      Gibbs & Cox-designed DDG-51 Arleigh Burke-class destroyer at sea

      Leidos completes Gibbs & Cox acquisition, expanding maritime undersea, autonomous and cybersecurity capabilities.

      Read Press Release

    • Contract Vehicles

      Whether you’re a potential government customer or a prospective supplier, through this listing you can find our technical and professional services under pre-negotiated terms and conditions.

      • Governmentwide MACs & IDIQs
      • GSA Schedules
      • Agency Specific IDIQs
      Leidos Lunar Terrain Vehicle

      Leidos and its Dynetics team will compete in another moon race, this time to design a vehicle that astronauts will use to explore the lunar surface.

      Take a lunar leap into the details

    • Global

      With more than 400 locations in 30 countries, we continue to expand our presence and strengthen our international relationships.

      • United Kingdom & Europe
      • Australia
      • Israel
      • Middle East
      • Canada
      plane flying over water

      Leidos has announced the completed acquisition of Cobham Aviation Services Australia’s Special Mission business.

      Hop Onboard to Learn More

    • Trust

      Cybersecurity and data privacy is central to what we do; protecting data, systems, and infrastructure that are critical to our employees, customers, communities, and stakeholders.

      • Commitment to Privacy & Cybersecurity
      • Cybersecurity
      • Data Privacy
      • Privacy Statement
      Citizens walking with data flowing around them

      Today, tomorrow, and every day is Data Privacy Day.

      Read the Article

  • Markets
    • Aviation

      From sidewalk to sky, we've got you covered.

      • Air Traffic Management
      • ANSP Professional Services
      • Security Solutions
      • Intelligent Approach
      • Scenario Planning & Forecasting
      • Passenger Flow Measurement
      • FODD & Fuels Management
      • Flight Management & Briefing
      Leidos Smartlane in use at an airport

      Safeguarding travel and trade at a global scale with fully-integrated security detection solutions.

      Learn About Our Portfolio

    • Defense

      Empowering and enabling mission success in all domains with aerial and autonomous platforms.

      • Advanced Manufacturing
      • Airborne
      • Autonomy & Autonomous Solutions
      • Command & Control
      • Cyber
      • Digital Modernization
      • Force Protection
      • Hypersonics & Strike Systems
      • CJADC2
      • Operations & Logistics
      • Training
      Helicopter with a chest being carried underneath it

      Leidos was recently awarded a new prime contract to develop an uncrewed aircraft system that can autonomously resupply forward-deployed ground forces.

      Read Press Release

    • Energy & Industry

      Leidos is equipped to support critical industries like energy, transportation, and manufacturing.

      • Power Delivery
      • Integrated Energy Management
      • Electrification & Clean Energy Services
      • Project Finance & Development
      • Advanced Communications Solutions
      • Manufacturing Systems
      • Site Management & Operations
      • Transportation
      Engineer working on a tablet

      Sophisticated approaches to automation help utilities improve the accuracy, safety, and reliability of the power grid.

      Read the Article

    • Government

      We support programs for identity theft recovery, health record protection, tax filing, fraud investigation, census data, and research.

      • Cybersecurity
      • Digital Modernization
      • Health IT
      • Forms Processing
      • Operations & Logistics
      • Mission Software Systems
      IT analysts in discussion over monitors

      Leidos completes acquisition of 1901 Group, expanding digital modernization capabilities.

      Read Press Release

    • Healthcare

      We draw on decades of success to deliver a range of solutions and services to meet the healthcare challenges of today.

      • Hospital Systems
      • Civilian Health
      • Military & Veterans Health
      Healthcare professional using tablet

      Taking a strategic approach to experience true digital transformation in healthcare.

      Read White Paper

    • Homeland

      Integrating, applying, and advancing IT to tackle the ever-advancing challenges of protecting our borders.

      • Biometrics
      • Mission Cyber & Network Defense
      • Integrated Systems
      • Digital Modernization
      • Data Analytics
      • Intelligence & Linguistic Services
      • CBRN Defense
      • Human Capital Services
      • Complex Logistics
      • Ports & Borders
      • Critical Infrastructure
      Leidos Smartlane in use at an airport

      Safeguarding travel and trade at a global scale with fully-integrated security detection solutions.

      Learn About Our Portfolio

    • Intelligence

      With cloud-enabled automation and augmentation expertise and a team adept at harnessing machine learning, we apply powerful analytic tools for superior performance and data protection.

      • Intelligence Community Engineering
      • Collection, Analysis, & Reporting
      • Operational Support & Training
      Woman looking at computer screen reflection in glasses

      Our DevOps Lab is an advanced, unclassified, state-of-the-art center dedicated to software and hardware development and engineering.

      Learn more about the Lab

    • Science

      Groundbreaking scientific research and environmental management practices for defense, civilian, and health markets.

      • Life Sciences
      • Autonomous Systems
      • Airborne & Ground ISR
      • Command & Control
      • Environmental Solutions
      • Modeling, Simulation, & Training
      • Sensors
      • Specialty Sciences
      Illustration representing health-focused scientific research

      NCI's Frederick National Laboratory has launched three initiatives focused on SARS-CoV-2.

      Read the Article

    • Space

      Speed, security, and scale for your most critical space missions

      • Cargo Mission Operations
      • Human Exploration
      • NASA IT
      • ISR
      • Payloads
      • Domain Awareness
      • Propulsion
      Female behind a transparent screen with text and graphs visible

      IT systems disappear into the background by providing an enhanced user experience

      Learn how IT Enables the Mission

  • Capabilities
    • Cyber Operations

      We use intelligent automation and AI/ML to defend networks through detection and mitigation.

      • Quantum
      • Zero Trust
      • Security Operations Center
      • Cyber Resiliency
      • Risk Management Framework
      • Cyber Analytics
      • Information Assurance
      • Insider Threat
      • Accredited Testing & Evaluation
      • EXCITE
      • Electronic Warfare
      binary code

      Outpacing adversaries through the application of IT, engineering, and science.

      From Castles to Cities with Zero Trust

    • Digital Modernization

      Boost your IT resilience with trusted AI and full-spectrum cyber services for complex operations.

      • Application Modernization
      • Cloud
      • Data Center Modernization
      • Digital Workplace
      • Mobility
      • SecDevOps
      • User Engagement
      IT analysts in discussion over monitors

      Leidos completes acquisition of 1901 Group, expanding digital modernization capabilities.

      Read Press Release

    • Integrated Systems

      We deliver high-performing hardware and software systems to solve challenges in an array of specializations.

      • Assured-Position Navigation & Timing
      • Autonomous & Unmanned Systems
      • Biometrics
      • Security Detection & Automation
      • Sensors, Signal Processing, & Analysis
      • Space
      • Strike Systems & Hypersonics
      • TRAPS
      Female Leidos employee holding a tablet

      With the help of Leidos, IRS has been able to leverage enabling technology to develop solutions to the year's unique challenges.

      Read Article

    • Mission Operations

      Providing secure, resilient, and cost-effective tools and processes, informed by deep domain knowledge and mission understanding, to support critical customer missions.

      • Antarctic Support Contract
      • EngineeringEdge® NextGen
      • ISS Cargo Mission Contract
      • Leidos Performance Management
      • UK Logistics & Operations
      • StarTT®
      • Strategic National Stockpile
      Ice sheet in Antarctica

      Each year, Leidos moves more than six million pounds of cargo and coordinates 100 flight missions to and from Antarctica.

      About Our Role

    • Mission Software Systems

      Through disciplined processes, common tools, reusable frameworks, automation, collaboration, and domain expertise, our mission software systems are designed to deliver secure, mission quality software.

      • Command & Control
      • LEAF
      • SE Core
      • Tactical Data Links
      • AI/ML
      Software on a mission text on blue background

      Mission quality software. Silicon Valley speed.

      More on Building Better Software

    • Enabling Technologies

      Our enabling technologies are the backbone of our core capabilities, supporting our customer's important work from the front lines.

      • Secure, Rapid Software
      • Trusted AI/ML
      • Full-Spectrum Cyber
      • Rapid Prototyping & Manufacturing
      Military radar simulation with green display, showing a glowing grid with coordinates and positioning numbers

      How we are deploying AI to solve the world’s toughest problems.

      Artificial Intelligence in Action

    • Technology Certifications

      We partner with world-class technology providers to develop innovative solutions for our customer’s toughest challenges.

      • AWS
      • Cisco
      • Microsoft
      • Scaled Agile
      • ServiceNow
      group of coworkers looking at computer monitor

      We help our partners save money and improve performance.

      How the Cloud Saved Some Coin

  • Insights
    • Insights

      Get employees' and stakeholders' expertise, leadership, unique perspectives, and more.

      • Latest Insights
      • MindSET Podcast
      • Press Releases
      • Heroes of Leidos
      • Our Experts
      • Careers
      • Military & Veterans
      • Diversity, Equity, & Inclusion
      • Fact Sheets
      • Articles
      • Case Studies
      • Infographics
      • Q&As
      podcast microphone

      Listen to the stories behind the world's most important work in the MindSET podcast.

      Explore the MindSET Podcast

  • Careers
    • Latest Opportunities

      Keep up to date on the latest career opportunities at Leidos.

      • Military Veteran Program
      • External Referral Program
      • Intern & New Graduate Jobs
      • Careers with Leidos in the UK
      • Careers with Leidos in Australia
      • Opportunities for Leidos Employees
      Bombardier Challenger CL-604 flying

      Seriously smart people protecting Australia's way of life.

      Careers with Airborne Solutions Australia

      cartoon silhouettes of people with gradient on top

      We have a strong focus on our employees' career, flexibility, and well-being.

      Learn more about Leidos Life

    • Life at Leidos

      A career at Leidos offers meaningful and engaging work, a collaborative culture, support for your career goals, while nurturing a healthy work-life balance.

      • Our Values
      • Our Culture
      • An Inclusive Workforce
      • Build a Career
      • Leidos Alumni Network
      Bombardier Challenger CL-604 flying

      Seriously smart people protecting Australia's way of life.

      Careers with Airborne Solutions Australia

      cartoon silhouettes of people with gradient on top

      We have a strong focus on our employees' career, flexibility, and well-being.

      Learn more about Leidos Life

    • Pay & Benefits

      Pay and benefits are fundamental to any career decision, which is why our compensation packages reflect the importance of the work we do for our customers.

      • Compensation
      • Health & Wellness
      • Income Protection
      • Leave
      • Retirement
      • Family Benefits
      Bombardier Challenger CL-604 flying

      Seriously smart people protecting Australia's way of life.

      Careers with Airborne Solutions Australia

      cartoon silhouettes of people with gradient on top

      We have a strong focus on our employees' career, flexibility, and well-being.

      Learn more about Leidos Life

    • Frequently Asked Questions

      Find answers to the most commonly asked questions related to securing a role at Leidos.

      • Searching for a Role
      • Applying for a Job
      • Determining Application Status
      • System Access
      • Job Eligibility Requirements
      • Receiving Job Notifications
      • Our Talent Community
      • Career Insights
      Bombardier Challenger CL-604 flying

      Seriously smart people protecting Australia's way of life.

      Careers with Airborne Solutions Australia

      cartoon silhouettes of people with gradient on top

      We have a strong focus on our employees' career, flexibility, and well-being.

      Learn more about Leidos Life

  • Search Search
  • Company
  • Markets
  • Capabilities
  • Insights
  • Careers
Back to top

Breadcrumb

  1. Home
  2. Insights

Trust and human machine workflows

data stream

As we accelerate the automation of tasks that have been previously conducted by humans, we begin to crossover into the territory of allowing machines to make complex judgements that can have a significant impact on the world.  But how do we evaluate the potential consequences of these decisions? Looking at our military past through an AI lens and assessing how political and military decisions might have changed with increased AI involvement, gives an intriguing perspective to this debate. 

In the early 1980s, relations between the U.S. and the Soviet Union were strained almost to breaking point. Both sides were deploying theatre nuclear missiles, which could strike key targets within 10 minutes.  
1982 saw the Soviet Union place the Oko satellite system into full operations. The system’s mission was to provide early warning for nuclear missile launches from the US. Then, in the spring of 1983, President Ronald Reagan announced the Strategic Defense Initiative (“Star Wars”) to significantly expand space-based military capability threatening to upend the already teetering balance between the Cold War powers.  

As tensions escalated on September 1, 1983, the Soviet military shot down a South Korean passenger jet, Korean Air Lines Flight 007. Flying from Alaska to Seoul, the aircraft had strayed into Soviet air space. 269 people were killed, including U.S. Congressman Larry McDonald.  
Three weeks later on September 26, 1983, Stanislav Petrov, a Lieutenant Colonel in the Soviet Air Defense Forces, had to make a judgement that might have changed the course of history. Petrov was responsible for monitoring the Oko mission warning system that was placed into operations the previous year. On that day, the system triggered an alert that one intercontinental ballistic missile was launched from the U.S. and quickly thereafter alerted that four more were behind it.  

Petrov’s job was to report these alerts to his superiors, and he was keenly aware of the current tensions. A missile launch report would quickly move up the Soviet chain of command and most likely result in an immediate call for counter-strike.  

However, Petrov did not report the alert despite the system claiming the highest confidence level; he made a judgement that the alerts were triggered in error. His only evidence was his instinct and belief that it would be highly unlikely for the U.S. to only launch five missiles. His training had convinced him that any U.S. first strike would be significant in scale.

What would a machine have done in place of Petrov? 

At a high level, how do we trust the judgements of machines, or of humans for that matter? How can we provide assurance that our judgements are accurate? Undoubtedly, context is king.

In some cases, machines can make more accurate judgements than humans. A study by Jon Kleinberg in 2017, indicated that human judges were not very good at predicting a defendant’s risk of skipping bail upon release pre-trial. When implemented in a random trial, their algorithmic-based decision model showed crime reductions of up to 24.7% with no change in jailing rates compared with human judges. However, there have been recent claims that systemic racial bias is still present and may be exacerbated through the use of algorithmic-based decision making. 

Often the data that goes into algorithmic-based decision making is not trustworthy. The Oko system’s “high confidence” alert was anything but. New data sources like commercial remote sensing systems such as BlackSky, Planet, IceEye, and HawkEye360, and automated processing and interpretation systems will proliferate over the next few years. This will allow governments, NGOs, and commercial entities to derive new insights and make near-real-time decisions. The challenge will shift from not having enough data to the trustworthiness of the data and subsequent analytic judgments. 

Clearly, we are wading into murky waters that include trust, belief, and confidence mixed with subjective assessments similar to the one Petrov had to make.

As governments and commercial organizations build out data collection and analytics systems, we need to invest in frameworks to determine how and when to trust machine outputs. Underestimating the value of human validation on data quality and machine judgements has the potential to lead to significantly negative outcomes. 
The field of IT security may provide a potential model towards maturing our notions of trustworthiness. In the early days, IT systems were small, not connected to external systems, and everyone knew their local IT administrator.  

However, as IT systems became interconnected, particularly with the advance of the Internet, users, systems and data became distributed. As a result, IT security professionals were forced to develop better approaches to protect assets. Then as security threats increased in sophistication, and with the consequences of data loss, companies began to implement a zero-trust IT security model. This framework essentially assumes all IT systems and data are potentially compromised; calculates a “trustworthiness” score each time a user accesses data within the enterprise and determines whether they allow or block access.  

At least conceptually, this “never trust, always verify” approach could be a good model to follow as we test and implement the automation of analytic workflows. Below is set of proposed guiding principles to consider as organizations automate their analytic activities:

  • Treat all systems and algorithms that perform analytic functions as an “analyst”
  • Consider all analysts (whether human or machine) as fallible and subject to bias
  • Understand that all analysts (whether human or machine) possess a limited contextual frame of reference based on experience and training
  • Consider all data to be potentially corrupted (either through processing errors or malign intent)
  • Recognize that we live in a world composed of shades of grey that requires analysts to think in probabilities
  • Analysts (whether human or machine) should endeavour to model their analytic processes and conclusions explicitly and transparently 
  • Analytic processes and conclusions are dynamic; more data will lead to better analytic products (but not necessarily more confident conclusions)

As we race to automate let’s not forget that, like Stanislav Petrov, implicitly trusting machine judgements may lead to poor or even disastrous outcomes. Agreeing on a set of guiding principles such as those articulated above is a critical step toward achieving better business and societal outcomes.

Related Insights
View more Insights
  • Leaves on a stem
    How FinOps and GreenOps improve Cloud Management
  • A plane landing
    Getting the most out of existing runway infrastructure
  • A woman teaching a man in front of screens
    From Information to Insight
Author
Leidos logo
Leidos Editorial Team

The Leidos Editorial Team consists of communications and marketing employees, contributing partner organizations, and dedicated freelance designers, editors, and writers. 

Share
  • Share on Facebook
  • Share on Twitter
  • Share on LinkedIn
  • Share via Mail
  • Print Insight

Posted

January 24, 2022

Estimated Read Time

Author
Leidos Editorial Team

Tags

Article
UK Defence
Artificial Intelligence
Defense

Sign up for our newsletters

Stay up to date on our expertise, industry leadership, unique perspectives, and more by subscribing to our newsletters.

  • Company
    • Our Business
    • Mission, Vision, & Values
    • Leadership
    • History
    • Diversity, Equity, & Inclusion
    • Responsibility & Sustainability
    • Ethics & Compliance
    • Rankings & Awards
    • Partners
    • Subsidiaries
    • Contract Vehicles
    • Global
    • Trust
  • Markets
    • Aviation
    • Defense
    • Energy & Industry
    • Government
    • Healthcare
    • Homeland
    • Intelligence
    • Science
    • Space
  • Capabilities
    • Cyber Operations
    • Digital Modernization
    • Integrated Systems
    • Mission Operations
    • Mission Software Systems
    • Enabling Technologies
    • Technology Certifications
  • Insights
    • Newsroom
  • Careers
    • Life at Leidos
    • Pay & Benefits
    • Alumni
    • FAQs

Want to know more?

Contact us about product information and pricing, customer feedback, stockholder services, or just to voice a concern.

Get started

  • © 2023 Leidos

  • Trust
  • Ad Choices

  • Privacy Statement
  • Email Preferences
  • Do Not Sell My Personal Information
  • © 2021 Leidos
  • Australian Privacy Statement
  • Australian Whistleblower Policy
  • Ad Choices
  • Email Preferences
  • Do Not Sell My Personal Information

Utility Footer Navigation

  • Products
  • Customers
  • Suppliers
  • Investors
  • Employees
  • Accessibility
  • Twitter
  • Facebook
  • Instagram
  • Linkedin
  • YouTube