Skip to main content
Leidos
Search
  • Suppliers
  • Employees
  • Newsroom
  • Investors
  • Global
  • Contact
  • Company
    • Our Business

      We embrace and solve some of the world's toughest challenges.

      • Civil
      • Defense
      • Health
      • Intelligence
      • Dynetics
      • Leidos Innovations Center (LInC)
      Gibbs & Cox-designed DDG-51 Arleigh Burke-class destroyer at sea

      Leidos completes Gibbs & Cox acquisition, expanding maritime undersea, autonomous and cybersecurity capabilities.

      Read Press Release

    • Mission, Vision, & Values

      Everything we do is built on a commitment to do the right thing for our customers, our people, and our community.

      • Mission
      • Vision
      • Values
      man sitting on bleachers holding soccer ball

      Let’s come together and talk about the changes that are needed.

      The Opioid Epidemic: A Call to Action

    • Leadership

      Meet the executive team responsible for leading our forward-thinking employees toward a shared success.

      • Roger Krone
      • Chris Cage
      • Maureen Waterston
      • Vicki Schmanske
      • Jerry Howe
      • Jim Carlini
      • Debbie Opiekun
      • Thomas Sanglier
      • Jim Moos
      • Gerry Fasano
      • Roy Stevens
      • Liz Porter
      • Steve Cook
      • Paul Engola
      • Board of Directors
      Roger Krone

      Meeting the challenges of an uncertain world.

      An Interview with CEO Roger Krone

    • History

      Leidos has a long history of innovative problem-solving and customer service, dating all the way back to 1969 when Dr. J. Robert Beyster founded his "crazy little company".

      • Explore our History
      • Dr. J. Robert Beyster
      • A Kaleidoscope of Innovation: The Story of Leidos
      Dr. Beyster

      Almost 50 years ago, visionary scientist J. Robert Beyster, Ph.D. founded the company that evolved into Leidos.

      Read More

    • Inclusion & Diversity

      Our commitment to inclusion and diversity is reflected in the way we engage our people, our customers, and our external partnerships through our innovative programs, sponsorships, and engagement.

      • Our Vision, Philosophy, and Approach
      • Strategic Diversity Outreach
      • Employee Resource Groups
      • Inclusion & Diversity in the UK
      Top Supporters HBCU badge for 2021

      Leidos was recently named to the 2021 Top Supporters of HBCU Engineering list published by Career Communications Group, Inc.

      Partnering with HBCUs

    • Responsibility & Sustainability

      We're equally committed to using our time and resources to support people, enrich communities, and protect the environment.

      • ESG Goals
      • CEO Message
      • ESG Initiatives
      • Executive Summary
      • Environment
      • Community
      • People
      • Suppliers & Small Business Relationships
      • Political Activities
      • About our Reporting
      • GRI™ Standards
      Leidos CEO Roger Krone

      Our response to COVID-19: A message to our valued customers, partners, and colleagues.

      Read Message

    • Ethics & Compliance

      We have a strong history of performance that rests on our foundation of integrity.

      • File a Report
      • History of Ethics
      • Ethics Program Structure
      • Code of Conduct
      Ethisphere World's Most Ethical Companies logo

      Leidos named one of the World’s Most Ethical Companies for fourth consecutive year.

      Read More

    • Rankings & Awards

      Our innovative approach and the services and solutions we deliver frequently earn Leidos recognition from our industry and the media.

      • Enterprise Awards
      • Defense Awards
      • Civil Awards
      • Health Awards
      A gold trophy on a light green background

      A frequent honoree on the corporate awards circuit, Leidos is proud of its many industry-specific and corporate-level achievements.

      Cue the Applause

    • Partners

      The Leidos Alliance Partner Network emphasizes connections through partnership and collaboration that drive innovation, advance technology, and build efficiency.

      • Corporate Strategic Partners
      • Technology Integration Partners
      • Emerging Technology Partners
      Bubba with helmet on

      We're teaming up with Bubba Wallace and 23XI Racing in 2022 advancing a culture of inclusion and diversity.

      Fueling a Better Tomorrow

    • Subsidiaries

      Our wholly owned and majority-owned subsidiaries attract and retain top talent motivated to deliver results for clients.

      • 1901 Group
      • Dynetics
      • Gibbs & Cox
      • Leidos Biomedical Research
      • Leidos Digital Solutions
      • BEONTRA
      • QTC
      • Leidos Engineering
      • Systems Made Simple
      • Varec
      Gibbs & Cox-designed DDG-51 Arleigh Burke-class destroyer at sea

      Leidos completes Gibbs & Cox acquisition, expanding maritime undersea, autonomous and cybersecurity capabilities.

      Read Press Release

    • Contract Vehicles

      Whether you’re a potential government customer or a prospective supplier, through this listing you can find our technical and professional services under pre-negotiated terms and conditions.

      • Governmentwide MACs & IDIQs
      • GSA Schedules
      • Agency Specific IDIQs
      • International
    • Global

      With more than 400 locations in 30 countries, we continue to expand our presence and strengthen our international relationships.

      • United Kingdom & Europe
      • Australia
      • Israel
      • Middle East
      • Canada
      Graphic showing buildings connected by technology

      Meeting UK border management security needs, now and long into the future.

      More on Border Management

    • Trust

      Cybersecurity and data privacy is central to what we do; protecting data, systems, and infrastructure that are critical to our employees, customers, communities, and stakeholders.

      • Commitment to Privacy & Cybersecurity
      • Cybersecurity
      • Data Privacy
      • Privacy Statement
      Citizens walking with data flowing around them

      Today, tomorrow, and every day is Data Privacy Day.

      Read the Article

  • Markets
    • Aviation

      From sidewalk to sky, we've got you covered.

      • Air Traffic Management
      • ANSP Professional Services
      • Security Detection & Automation
      • Intelligent Approach
      • Scenario Planning & Forecasting
      • Passenger Flow Measurement
      • FODD & Fuels Management
      • Flight Management & Briefing
      Leidos Smartlane in use at an airport

      Safeguarding travel and trade at a global scale with fully-integrated security detection solutions.

      Learn About Our Portfolio

    • Defense

      From our airborne work with sensors alerting warfighters to what's over the next hill to our autonomous maritime platforms protecting sea lanes and shores, our team is solving critical challenges across the globe.

      • Airborne
      • Autonomy & Autonomous Solutions
      • Command & Control
      • Cyber
      • Digital Modernization
      • Operations & Logistics
      • Training
      Gibbs & Cox-designed DDG-51 Arleigh Burke-class destroyer at sea

      Leidos completes Gibbs & Cox acquisition, expanding maritime undersea, autonomous and cybersecurity capabilities.

      Read Press Release

    • Energy & Industry

      Leidos is uniquely equipped to support your important work in critical industries such as energy, transportation, and manufacturing.

      • Site Management & Operations
      • Power Delivery
      • Integrated Energy Management
      • Project Finance & Development
      • Digital Utilities
      • Manufacturing Systems
      • Transportation
      • Advanced Communications Solutions
      Electricity pylons in sunny field

      Leidos delivers a complex modeling project resulting in a clear view of bulk electric and sub-transmission systems for FirstEnergy.

      Read the Case Study

    • Government

      We support important programs that expedite identity theft recovery, protect electronic health records, streamline paper tax filings, enhance consumer fraud investigations, support census data collection, and enable scientific research.

      • Cybersecurity
      • Digital Modernization
      • Health IT
      • Forms Processing
      • Operations & Logistics
      • Mission Software Systems
      IT analysts in discussion over monitors

      Leidos completes acquisition of 1901 Group, expanding digital modernization capabilities.

      Read Press Release

    • Healthcare

      We draw on decades of success to deliver a range of solutions and services to meet the healthcare challenges of today.

      • Hospital Systems
      • Federal Health
      • Military & Veterans Health
      Healthcare professional using tablet

      Taking a strategic approach to experience true digital transformation in healthcare.

      Read White Paper

    • Homeland

      Integrating, applying, and advancing IT to tackle the ever-advancing challenges of protecting our borders.

      • Biometrics
      • Mission Cyber & Network Defense
      • Integrated Systems
      • Digital Modernization
      • Data Analytics
      • Intelligence & Linguistic Services
      • CBRN Defense
      • Human Capital Services
      • Complex Logistics
      • Ports & Borders
      • Critical Infrastructure
      Leidos Smartlane in use at an airport

      Safeguarding travel and trade at a global scale with fully-integrated security detection solutions.

      Learn About Our Portfolio

    • Intelligence

      With expertise in cloud-enabled automation and augmentation and a team adept at harnessing machine learning, we’re applying powerful analytic tools for superior performance and protection despite a staggering breadth of data.

      • Intelligence Community Engineering
      • Collection, Analysis, & Reporting
      • Operational Support & Training
      Woman looking at computer screen reflection in glasses

      Our DevOps Lab is an advanced, unclassified, state-of-the-art center dedicated to software and hardware development and engineering.

      Learn more about the Lab

    • Science

      Providing groundbreaking scientific research and environmental management best practices that make headways in the defense, civilian, and health markets.

      • Life Sciences
      • Autonomous Systems
      • Airborne & Ground ISR
      • Command & Control
      • Electronic Warfare
      • Environmental Science
      • Modeling, Simulation, & Training
      • Sensors
      • Specialty Sciences
      Illustration representing health-focused scientific research

      NCI's Frederick National Laboratory has launched three initiatives focused on SARS-CoV-2.

      Read the Article

    • Space

      Speed, security, and scale for your most critical space missions

      • Mission Operations
      • Human Exploration
      • ISR
      • Payloads
      • Domain Awareness
      • Propulsion
      Female behind a transparent screen with text and graphs visible

      IT systems disappear into the background by providing an enhanced user experience

      Learn how IT Enables the Mission

  • Capabilities
    • Cyber Operations

      We use intelligent automation and AI/ML-driven analytics, combined with detection and mitigation, to protect and defend networks.

      • Zero Trust
      • Security Operations Center
      • Cyber Resiliency
      • Risk Management Framework
      • Cyber Analytics
      • Information Assurance
      • Insider Threat
      • Accredited Testing & Evaluation
      • EXCITE
      binary code

      Outpacing adversaries through the application of IT, engineering, and science.

      From Castles to Cities with Zero Trust

    • Digital Modernization

      We deliver resilient IT solutions and managed services that leverage trusted AI and full-spectrum cyber to decrease vulnerabilities in complex IT operations.

      • Application Modernization
      • Cloud
      • Data Center Modernization
      • Digital Workplace
      • Mobility
      • SecDevOps
      • User Engagement
      IT analysts in discussion over monitors

      Leidos completes acquisition of 1901 Group, expanding digital modernization capabilities.

      Read Press Release

    • Integrated Systems

      We deliver high-performing hardware and software systems to solve challenges in an array of specializations.

      • Assured-Position Navigation & Timing
      • Autonomous & Unmanned Systems
      • Biometrics
      • Security Detection & Automation
      • Sensors, Signal Processing, & Analysis
      • Space
      • Strike Systems & Hypersonics
      • TRAPS
      Gibbs & Cox-designed DDG-51 Arleigh Burke-class destroyer at sea

      Leidos completes Gibbs & Cox acquisition, expanding maritime undersea, autonomous and cybersecurity capabilities.

      Read Press Release

    • Mission Operations

      We leverage our in-depth domain knowledge and mission understanding to provide cost-effective tools and enhanced processes that are secure, resilient, and support our customer's critical missions.

      • Antarctic Support Contract
      • EngineeringEdge® NextGen
      • ISS Cargo Mission Contract
      • Leidos Performance Management
      • UK Logistics & Operations
      • StarTT®
      • Strategic National Stockpile
      Ice sheet in Antarctica

      Each year, Leidos moves more than six million pounds of cargo and coordinates 100 flight missions to and from Antarctica.

      About Our Role

    • Mission Software Systems

      Through disciplined processes, common tools, reusable frameworks, automation, collaboration, and domain expertise, our mission software systems are designed to deliver secure, mission quality software.

      • Command & Control
      • LEAF
      • SE Core
      • Tactical Data Links
      • AI/ML
      Software on a mission text on blue background

      Mission quality software. Silicon Valley speed.

      More on Building Better Software

    • Enabling Technologies

      Our enabling technologies are the backbone of our core capabilities, supporting our customer's important work from the front lines.

      • Secure, Rapid Software
      • Trusted AI/ML
      • Full-Spectrum Cyber
      • Rapid Prototyping & Manufacturing
      Military radar simulation with green display, showing a glowing grid with coordinates and positioning numbers

      How we are deploying AI to solve the world’s toughest problems.

      Artificial Intelligence in Action

    • Technology Certifications

      We partner with world-class technology providers to develop innovative solutions for our customer’s toughest challenges.

      • AWS
      • Cisco
      • Microsoft
      • Scaled Agile
      • ServiceNow
      group of coworkers looking at computer monitor

      We help our partners save money and improve performance.

      How the Cloud Saved Some Coin

  • Insights
    • Insights

      Expertise, industry leadership, unique perspectives, and more — directly from our employees and stakeholders.

      • Latest Insights
      • MindSET Podcast
      • Press Releases
      • Heroes of Leidos
      • Our Experts
      • Careers
      • Military & Veterans
      • Inclusion & Diversity
      • Community
      • Articles
      • Case Studies
      • Infographics
      • Q&As
      podcast microphone

      Listen to the stories behind the world's most important work in the MindSET podcast.

      Explore the MindSET Podcast

  • Careers
    • Latest Opportunities

      Keep up to date on the latest career opportunities at Leidos.

      • Military Veteran Program
      • External Referral Program
      • Intern & New Graduate Jobs
      • Careers with Leidos in the UK
      • Careers with Leidos in Australia
      • Opportunities for Leidos Employees
      People icons with gradient over

      At Leidos, we have a strong focus on our employees’ career, flexibility, and well-being.

      Learn more about Leidos Life

    • Life at Leidos

      A career at Leidos offers meaningful and engaging work, a collaborative culture, support for your career goals, while nurturing a healthy work-life balance.

      • Our Values
      • Our Culture
      • An Inclusive Workforce
      • Build a Career
      • Leidos Alumni Network
      People icons with gradient over

      At Leidos, we have a strong focus on our employees’ career, flexibility, and well-being.

      Learn more about Leidos Life

    • Pay & Benefits

      Pay and benefits are fundamental to any career decision, which is why our compensation packages reflect the importance of the work we do for our customers.

      • Compensation
      • Health & Wellness
      • Income Protection
      • Leave
      • Retirement
      • Family Benefits
      People icons with gradient over

      At Leidos, we have a strong focus on our employees’ career, flexibility, and well-being.

      Learn more about Leidos Life

    • Frequently Asked Questions

      Find answers to the most commonly asked questions related to securing a role at Leidos.

      • Searching for a Role
      • Applying for a Job
      • Determining Application Status
      • System Access
      • Job Eligibility Requirements
      • Receiving Job Notifications
      • Our Talent Community
      • Career Insights
      People icons with gradient over

      At Leidos, we have a strong focus on our employees’ career, flexibility, and well-being.

      Learn more about Leidos Life

  • Search Search
  • Company
  • Markets
  • Capabilities
  • Insights
  • Careers
Back to top

Breadcrumb

  1. Home
  2. Insights

Why is AI so difficult to scale?

Q&AI series motion

Converting an exploratory model into an enterprise capability is called scaling, and it can be remarkably difficult with AI. The simplest approach might be spinning up copies of the model in the cloud, but this sort of system can be easy to break and expensive to run, especially when each copy requires significant computing resources. Solving these types of problems when scaling across the enterprise will be an important next step toward realizing the potential of AI/ML. It’s an active area of research at Leidos, where data scientists like Tifani O'Brien are solving scalability problems every day. To learn more we welcome Tifani, who is expert in scaling AI for the intelligence community in particular.

Q: Take us inside the process of scaling AI. What’s the big challenge our customers are facing?

O'Brien: When a data scientist creates a model on their own computer, running on a set of data collected on a local hard drive, it works well when you need answers to a specific, time-bounded question. Model training happens once, and the results apply to the data already collected. However, if an enterprise wants to apply this model to the data they collect going forward, and improve the model as more data is collected, you need a way to scale your access to data and computing resources without breaking the bank.

Tifani O'Brien

If you want to apply AI models across the enterprise, you need a way to scale your access to data and computing resources without breaking the bank.

Tifani O`Brien, Chief AI Engineer


Let’s say you want to do a search across all your data including text, video, and audio. Machine learning models can extract audio speech from a video and convert it to text, and even do machine learning translation of all the content that is available in one language. Your data scientists have demonstrated they can do this on a month’s worth of data already collected, and now you want to scale this up to do the same processing to all your historical data and all the new data streaming into your enterprise so your researchers can search across time and media type.

Just embedding the model in a browser application limits your users to only the resources available to each of them running it, so it would be very inefficient for them to have to extract and translate speech for each search every time. So we choose instead to pre-process all the audio and save the results for later searching. We deploy in the cloud with the ability to spin up as many resources as needed for the current task. This flexibility can come at a high cost though if not done efficiently.

Q: What particular methods make scalability more efficient?

O'Brien: One of the most effective ways we've found to scale AI is to deploy microservices in containers, managed by a container orchestration system. Orchestration makes it easy to spin up additional containers whenever the demand is encountered, but this can quickly turn costly if not throttled correctly. For our purposes, we configured our usage to apply the more expensive processing resources for monthly model retraining, but once we deployed the production model we could dial it back.

Determining the appropriate API design and architecture is another scaling technique. Correctly delineating the boundaries of a service allows it to be flexibly inserted at different points in the processing pipeline, potentially avoiding bottlenecks. Also, locating the API layer inside the containerized microservice itself avoids losing valuable time to repeated container startup, hardware allocation, and session startup activities. Carefully managing the data as it transitions through a pipeline of AI models is another opportunity to reduce the traffic and cost of scaling up. We use a fast cache for input data that multiple models are going to access, and then move that data to cheaper, slower storage.


Q: What are some of the biggest challenges you normally face?

O'Brien: One challenge is filtering out noise and selecting the right model to run on different data based on its type. If you run AI models on the data they are not trained to handle, you spend resources on irrelevant processing that also produces poor results. For example, using a model that was trained to detect firearms in photos on something different, like application icons, can result in many false positives and use expensive GPU computing time. 

Another challenge is dealing with data proliferation. We often work with customers who have terabytes or even petabytes of data. Every time you process data using machine learning, you end up creating new artifacts based on that data. Take a situation in which we pull out speech from video. We have the original video file, then we have the audio file, and we also have text files based on the audio–one in a foreign language and one translated to English. And if you add to that extraction of all the still images pulled from the video, you'll add thousands of images that you must run through your processing pipeline again.   

Q: What’s your best advice for overcoming these challenges?

O'Brien: To work well, scalable AI depends not only on strong AI capabilities, but also on an understanding of the computational infrastructure and how it handles resource contention, data transport and availability, and service orchestration. Many people say they can build microservices but then are challenged when they try to process truly large collections efficiently. We’ve been successful in scalable AI because we establish careful service boundaries, design analytics to best use the compute resources available, apply knowledge of the domain to customize the processing workflow, and apply the right models to the right data.

Q&AI: Conversations on artificial intelligence
View more Insights
  • Doug Barton graphic
    Executive Spotlight: Doug Barton, Health Group CTO
  • Man sat talking
    #Innovidual Ron Keesing
  • Q&AI header
    How does AI transform aerial combat?
Author
Leidos logo
Leidos Editorial Team

The Leidos Editorial Team consists of communications and marketing employees, contributing partner organizations, and dedicated freelance designers, editors, and writers. 

Share
  • Share on Facebook
  • Share on Twitter
  • Share on LinkedIn
  • Share via Mail
  • Print Insight

Posted

November 25, 2019

Estimated Read Time

Author
Leidos Editorial Team

Tags

Q&A
Artificial Intelligence
Dynetics-LInC

Sign up for our newsletters

Stay up to date on our expertise, industry leadership, unique perspectives, and more by subscribing to our newsletters.

  • Company
    • Our Business
    • Mission, Vision, & Values
    • Leadership
    • History
    • Inclusion & Diversity
    • Responsibility & Sustainability
    • Ethics & Compliance
    • Rankings & Awards
    • Partners
    • Subsidiaries
    • Contract Vehicles
    • Global
    • Trust
  • Markets
    • Aviation
    • Defense
    • Energy & Industry
    • Government
    • Healthcare
    • Homeland
    • Intelligence
    • Science
    • Space
  • Capabilities
    • Cyber Operations
    • Digital Modernization
    • Integrated Systems
    • Mission Operations
    • Mission Software Systems
    • Enabling Technologies
    • Technology Certifications
  • Insights
    • Newsroom
  • Careers
    • Life at Leidos
    • Pay & Benefits
    • Alumni
    • FAQs

Want to know more?

Contact us about product information and pricing, customer feedback, stockholder services, or just to voice a concern.

Get started

  • © 2022 Leidos

  • Trust
  • Ad Choices

  • Privacy Statement
  • Email Preferences
  • Do Not Sell My Personal Information
  • © 2021 Leidos
  • Australian Privacy Statement
  • Australian Whistleblower Policy
  • Ad Choices
  • Email Preferences
  • Do Not Sell My Personal Information

Utility Footer Navigation

  • Products
  • Customers
  • Suppliers
  • Investors
  • Employees
  • Accessibility
  • Twitter
  • Facebook
  • Instagram
  • Linkedin
  • YouTube