From: GovWin Network/Deltek
by Alex Rossino
FIA research has verified more than 160 big data projects, programs, contracts, grants, and assorted other efforts in place across the federal government. Some of these efforts have been underway for years already, suggesting that federal agencies are not necessarily the backwater of the IT world that is often assumed.
Big data is all the rage in the trade and technology press, but while the subject garners a lot of attention, there is precious little solid information on the extent to which federal agencies are using big data solutions. Knowing which agencies are early adopters of big data solutions can help vendors understand which agencies are potential green fields for further business development.
For the last several months our research team has diligently collected data on big data projects at federal agencies. We gathered this data for use in our recently published Federal Big Data Outlook, FY 2012–2017 report. What we discovered surprised us to a certain extent. Contrary to expectations that it would be difficult to identify big data solutions in use at agencies, we eventually verified more than 160 different big data projects, programs, contracts, grants, and assorted other efforts. Some of these efforts have been underway for years already, suggesting that federal agencies are not necessarily the backwater of the IT world that is often assumed. Having participated in our research effort on emerging technology approaches back in 2009-2010, I can say with confidence that we had far more difficulty then identifying cloud computing efforts and pilots than we had this time identifying big data efforts. New solutions are evolving to meet federal agency data challenges and the big data space is immature, but it would be incorrect to say that big data is a brand new market or phenomenon.
Below is a graphic illustrating the 163 big data projects, initiatives, and efforts that FIA identified across the federal government.
This list is a good start, but there are likely many more projects, initiatives, and efforts that remain unidentified. The distribution of agencies using big data solutions is not unexpected. Those with scientific/health care, military, and national security missions have been adopting big data solutions for several years now. As these early adopters gain experience and confidence with big data solutions we believe they will be more inclined to make further investments.
The Department of Health and Human Services, the Department of Energy, the National Science Foundation, and NASA are in the forefront of using their data to facilitate scientific research. The work being done at these agencies produces massive amounts of data that the agencies know can be used by the private sector to enable scientific discovery and innovation. Take for example the Health Data Initiative at HHS, which provides agency data to spur innovation in health care research, or the DOE’s Genomic Science Program, which funds research into next generation information sharing systems. For its part, the VA is using big data solutions to improve the services it provides to the nation’s veterans.
Then there are the defense and national security establishments, which are using big data solutions in a variety of capacities, from researching battlefield applications to analyzing high definition video. When the White House announced the Big Data Initiative in March 2012 the DoD stated that it intends to spend $250 million more than it already spends on big data research and development to enable “Data-to-Decisions.” Big data tools are in use at the Military Departments too. The Navy and Air Force both use big data approaches for C4ISR applications and text mining. The Army uses advanced analytics to synthesize intelligence data pushed through the Distributed Common Ground System-Army (DCGS-A). Meanwhile, a reading of the Army’s $1 billion Technical Information Engineering Systems (TIES) IDIQ Performance Work Statement coming out of the Communications-Electronics Research, Development and Engineering Center (CERDEC) suggests that the vendors who win contracts will play a significant role in enabling the Army’s contribution to DoD’s “Data-to-Decisions” objective. The Department of Homeland Security and National Security Agency are employing big data approaches for purposes similar to those at the DoD – to parse intelligence data and glean insight from the massive in-flow of surveillance data.
This focus on the top 10 agencies using big data solutions is not meant to draw attention away from agencies that are not adopting as quickly. Those agencies can also benefit from big data solutions. However, because they have less experience with big data they are likely to need more advice on getting started, or on expanding the pilot programs they have in place. Many agency leaders understand this and are already testing the big data waters. As they realize the benefits and gain confidence employing the technology, it becomes increasingly likely that they will invest in advanced analytics solutions.
Leave a Reply