Data Ingest Engineer

Full Time
Hanover, MD
Posted 4 days ago

Clearance Requirement: TS/SCI with Polygraph


• Develop new tools using scripting languages that provide methods for data transformation, mapping, standardization, and data characterization
• Devise strategies to extract meaning and value from structured and unstructured data
• Review data namespaces and models to recommend new data structures in support of analytic usage
• Support data wrapping and encoding in line with service APIs (TDF, TCLD, other)
• Review data schemas and perform troubleshooting in line with data structures
• Use tools, such as DataXplorer, to identify key data and subsequently structure data for improved discovery and search capabilities
• Define requirements for enhanced data characterization to improve discovery and search capabilities
• Work with IC partners to characterize data and document data mission value
• Develop characterization and processing documentation for individual datasets
• Provide engineering support to data stewards to ingest data
• Analyze and develop requirements to support the ingest of new and existing data types
• Conduct technical exchange meetings with customer personnel involving data discovery, review and dataflow, and entitlements
• Develop and implement ingest processing and approval workflows
• Analyze and assess legal requirements, policies, and handling restrictions for various data types
• Determine applicable handling attributes and encode data for ingestion into analytic repository

Required Position Skills & Experience:

• Experience collaborating on and devising strategies to extract meaning and value from structured and unstructured data
• Experience with the development of new requirements to support the characterization and ingestion of new data flows
• Experience with high-level analysis of IC systems, data models, data formats/types, data volumes, and data samples
• Experience with dataflow, routing and data enrichments tools (e.g. NiagaraFiles)
• Experience with scripting languates such as shell scripts, Python, Java, etc., that provide methods for data transformation, mapping, standardization, and data characterization
• Excellent oral and written communications. Comfortable in programmatic and technical exchange with internal SE and software teams, multiple levels of leadership, and across IC and DoD stakeholder agencies
• Skilled with development and implementation of SE processes and workflows
• Working functional knowledge and experience with IC-GovCloud (GM and Content Warehouse)

General Requirements:

• BA/BS Degree in a technical discipline related to the experience requirements as stated herein (such as: Systems Engineering, Computer Science, Electrical Engineering, Information Systems). Substitute: +6 years of additional experience; AND/OR a related, active certificate may be substituted for 1 year of experience, up to 3 certificates allowed for a total of 3 years substituted.
• Minimum fifteen (15) years experience in technical roles for Government or Industry customer.
• Ten (10) years experience as a systems, software, or hardware engineer in programs that encompassed: System architecture development; Performing requirements analysis, management and control; multiple activities with multiple vendors; large systems engineering efforts totaling more than $15M/year, or Management and evaluation of business processes and implementation strategies.

Job Features

Job CategoryData Architect, Data Scientist / Engineer, Engineering
Clearance Level RequiredTS/SCI with Polygraph
Years of Experience Required15
Job #19-815

Apply Online

A valid email address is required.