The customer is an Intelligence Agency (IA) delivering world-class geospatial intelligence providing a decisive advantage to policymakers, war-fighters, intelligence professionals and first responders. The customer enables all of these critical actions and shapes decisions impacting our world through the indispensable discipline of geospatial intelligence (GEOINT). Our customer is a unique combination of intelligence and combat support agency. It is the world leader in timely, relevant, accurate, and actionable GEOINT. This IA enables the U.S. intelligence community (IC) and the Department of Defense (DOD) to fulfill the president’s national security priorities to protect the nation.

The Program

This client is the prime contractor on a program awarded to provide agile operations, adaptive maintenance, and minor enhancement services to support the maintenance, integration, and ingest of multiple business data sets into an analytic environment.  This Intelligence Agency (the customer) program is focused on human capital data, and also focused on activities to bring in other corporate business data sets such as; Information Technology, Cyber, Security, Financial, Contract, Customer Feedback, and Mission Management Activity.  One goal for the program is to provide the Agency with the capability for a centralized authoritative data repository, refreshed automatically, from source systems of record and transaction databases along with a range of visualization tools for reporting and delivery to end-users.

The Job

In your role as data engineer, you will be assigned to an agile scrum team that focuses on the development of extract, transform, and load (ETL) jobs currently using Microsoft SQL, Server, and SSIS. The environment currently supports hundreds of related ETL jobs that move data between 30 different source systems and between multiple classifications. Part of the challenge as a data engineer will be to find scalable and efficient coding solutions that plug into this extensible system in order to add more data to the Enterprise data store. The existing data warehouse is built on Microsoft SQL hosted on Amazon Web Services (AWS), so experience developing solutions that scale well in these environments is a plus. Experience with other data ingest pipelines such as NIFI is also desired as this contract is likely to evolve over the next 5 years to keep up with industry best practices.

In this role you will work with product owners and data stewards to deliver high quality technical solutions in response to business requirements. You will be counted on to provide your peers with technical expertise that will offer solutions for difficult programming problems.

Qualifications

Desired Core Skills:

• SQL Server Integration Services (SSIS) including UI and custom code features.
• Ability to write or create stored procedures, SQL scripts, SSIS packages that can be used to:o Move data from source databases to target databaseso Clean / Condition datao Convert or transform datao Reconcile and confirm converted datao Find data errorso Validate data to business ruleso Ability to examine existing ETL scripts and track data back to source
• SQL Server administration, tuning, and workbench.
• Ability to work with business experts to understand data and complete data mappings.

Preferable Secondary Skills:

• Data discovery techniques and data wrangling to pull data together from disparate sources.
• Data Modeling techniques
• Expertise in operating within an Agile based environment and breaking down large tasks into smaller story/point based tasks.
• AWS infrastructure functionality and configuration, installation as applies to databases and specifically.
• Experience in at least one scripting language desirable (PowerShell, Shell, PERL, Python).
• Expertise in the Design and Deployment of various components as part of SQL to include SQL Server Integration Services, SSIS - (both Scale-Out and non-Scale-Out)
• Understanding of SSIS ETL jobs including setting up and monitoring job length and performance.
• SQL Server Reporting Services (SSRS) – Decent to Solid understanding of monitoring the SSRS core database tables with regards to report run- time and slow reporting performance.