Data is a natural byproduct of the business of government. However, federal agencies have been challenged as they try to gather, cleanse, standardize, mine and share that data. Now, however, new legislation (the Evidence Based Policymaking Act of 2019) and policy (OMB memo M-19-23) lay out the path agencies must follow to identify the data they plan to collect, use or acquire, as well as the methods and analytical approaches to facilitate the...

Achieving Real Success with Hadoop Although Hadoop shows great promise for managing Big Data, many organizations are still struggling to decide which parts of the Hadoop ecosystem to adopt in order to obtain/elicit the greatest value. A key concern is how to avoid performance and data security issues so that your agency/organization isn’t spending valuable time and resources on what ultimately turns out to be little more than a developme...

The age of big data has officially arrived in government. Storage systems are near capacity as the amount of information the federal government captures has increased exponentially since 2000, and is projected to double every year going forward. This new information, effectively captured, managed, and analyzed, has the power to enhance profoundly the effectiveness of government. Yet government CIOs and their staffs must rise to the big data ch...