Sr. Data Flow System Engineer
Culper Technology · Annapolis Junction, MD ·
- Seniority
- Senior
- Category
- Software engineering
- Experience
- 6+ years
Senior engineer designing, troubleshooting, and optimizing complex data flows using Apache NiFi (NiagaraFiles) for Intelligence Community mission systems, including processing DMRs and migrating data flows from hardware to a virtual cloud environment. Requires TS/SCI clearance with polygraph and on-call rotation.
About the role
We are looking for a Senior Data Flow Engineer to join our team and support the design, troubleshooting, and optimization of complex data flows using NiagaraFiles (NiFi).
In this role, you’ll troubleshoot data formatting and software issues, work with engineers and developers to solve problems, and review existing data flows to improve performance and ensure they meet compliance requirements. You’ll also help process DMRs and develop solutions to make data flows more efficient.
A key part of the role will be supporting Data Flow Modernization, including moving existing data flows from hardware to a virtual cloud environment. This will involve evaluating current flows, helping define requirements, and working with the Operations team to build and implement the new flows.
The position also includes one week of on-call support, typically on a rotating schedule about every 6–8 weeks. Occasional on-site support may be required for emergency system issues.
What you'll do
- 6+ years of experience working with data flows.
- 10+ years of experience within the Intelligence Community, supporting mission systems and mission data formats.
- Experience working with mission systems that process and manage mission data.
- Strong understanding of mission data formats and how they are used within operational systems.
- Experience reviewing, processing, or creating Data Flow Management Requests (DMRs).
- Hands-on experience with Apache NiFi, including building, managing, troubleshooting, and documenting complex data flows.
- Experience with DeltaFi is highly desirable.
- Experience gathering and managing analytical requirements.
- Ability to create system architecture diagrams that clearly illustrate software and system functions.
- Experience providing customer support and helping users troubleshoot data flow questions and issues.
- Self-motivated, organized, and comfortable working independently while managing multiple priorities.
Qualifications
- Active TS/SCI clearance with a current polygraph required.
- 14+ years of Systems Engineering experience supporting programs and contracts of similar scope, type, and complexity.
- Bachelor’s degree in Systems Engineering, Computer Science, Information Systems, Engineering Science, Engineering Management, or a related discipline from an accredited college or university.
- Five additional years of relevant Systems Engineering experience may substitute for the bachelor’s degree.