Lead Data Flow Engineer (Java/NiFi Focus) - PRIME, Hybrid - TS/SCI
Tasks
- Administer Apache NiFi
- Build and manage big data ingestion infrastructure
- Design data models
- Develop data extraction and custom logic
- Ensure data integrity
- Implement testing and monitoring
- Lead data flow ingestion
- Modify data sources and data pipelines
- Perform ETL development
- Support ingest to visualization
- Troubleshoot dataflow issues
Perks/Benefits
Skills/Tech-stack
AWS | AWS S3 | AWS SQS | Apache Airflow | Apache Kafka | Apache NiFi | Bash | Data Modeling | Data pipeline | Docker | ETL | GitLab | Integration Testing | JSON | Java | Kubernetes | Linux | Maven | Server Administration | Unit Testing | XML | YAML
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer | Senior Data Engineer
Related jobs
-
Automation Testing | CI/CD | CSS | Cypress | Feature DevelopmentMedical, dental & vision coverage | Paid time off | Parental leave | Reimbursement programs | Retirement planMid-levelRaleigh, United States R9d ago
-
Lead Data Engineer USD 125K-150KAWS Glue | AWS Lambda | AWS Step Functions | Agile | Amazon EMR401k matching | ADandD insurance | Disability insurance | Employee assistance program | Health insuranceSenior-level Full TimeFort Lauderdale, FL, United States5h ago
-
Enterprise Analytics Lead USD 167K-241KABAP | Access Control | Analysis Services | Analytics Cloud | Azure DataExtra day off every other week | Flexible 9/80 schedule | Work-life balanceSenior-level Full TimePortsmouth, NH, United States5h ago
-
Databricks Pipeline Architect USD 150K-180KAWS Glue | AWS Lambda | AWS S3 | Agile | Amazon Web ServicesPublic trust clearance support | Remote workSenior-level Full TimeWork from home, VA, United States R6h ago
-
Batch Processing | CI/CD | Cloud Computing | Data Architecture | Data ModelingMid-level Full TimeChicago, IL, United States7h ago
-
Senior AI Software Engineer USD 85K-125KAWS | Amazon Bedrock | Amazon EKS | Amazon ElastiCache | Amazon S3Employee assistance program | Employee stock purchase plan | Hybrid work | Paid parental leave | Paid time offSenior-level Full TimeHilton - Systems Solutions - McLean …10h ago
-
Software Engineer, Audio Embedded DSP - Reality Labs USD 117K-173KAndroid | Audio Processing | Audio Software | Audio software engineering | C#Mid-level Full TimeSunnyvale, CA11h ago
-
Software Engineer, Systems USD 221K-240KAlgorithms | CSS | Data Analysis | Data Modeling | Data ProcessingEntry-level Full TimeBellevue, WA11h ago
-
AI infrastructure | Accelerator Virtualization | Container Runtime | Distributed Systems | GPUSenior-level Full TimeSeattle, WA, USA; Kirkland, WA, USA11h ago
-
Senior Software Engineer, AI and Infrastructure USD 174K-252KArtificial Intelligence | C++ | Code review | Data Storage | Data StructuresSenior-level Full TimeSunnyvale, CA, USA11h ago
-
Evaluation Team Lead, Business Intelligence, Google.org USD 171K-248KData Modeling | Data Visualization | Data Warehousing | Data collection | HadoopSenior-level Full TimeMountain View, CA, USA; Seattle, WA, …11h ago
-
2026 Summer Internship | Data Analytics & AI USD 50K-90KDashboarding | Data Engineering | Data Pipelines | Data analytics | ETLCareer development opportunities | Community service opportunities | Executive spotlights | Hybrid schedule | Professional development sessionsEntry-level InternshipMiramar, FL, US, 3313216h ago
-
Software Engineer - Robot Link Platform USD 160K-232KAPI Design | Apache | Caching | Cloud services | DatabasesMid-level Full TimeFoster City, CA19h ago
-
Senior-level Full TimeSan Jose, CA20h ago
-
Senior Software Engineer - Data Platform USD 186K-218KAccess Control | Airflow | Apache Kafka | Apache Spark | CachingSenior-level Full TimeRemote - USA R20h ago
-
Computational Geometry Software Engineer USD 130K-250KC++ | CAD | CAM | Docker | GPU Computing401k | Dental insurance | Flexible vacation policy | Life insurance | Medical insuranceSenior-level Full TimeLos Angeles, CA20h ago
-
Software Engineer - Reference Data (Java/SQL) USD 175K-200KAPI Development | Distributed Systems | Git | HBase | HadoopMid-level Full TimeNew York20h ago
-
Senior LLM Software Engineer USD 191K-287KAWS | Agentic Automation | Data Pipelines | Event Driven | Event-driven architecture401k retirement plan | Caregiver leave | Commuter benefits | Dental insurance | Disability insuranceSenior-level Full TimeCosta Mesa, California, United States20h ago
-
Senior Technical Data Engineer - Boston, MA USD 64K-149KAPI Integration | Azure Data | Azure Data Factory | CI/CD | CSVSenior-level Full TimeBOSTON, MA, United States21h ago
-
Senior-level Full TimeHybrid (Salt Lake City, UT, US) R22h ago
-
Lead- Full Stack Engineer USD 150K-190KAWS Fargate | AWS Lambda | Amazon RDS | Amazon S3 | CI/CDCareer development opportunities | Entrepreneurial environment | Equal employment opportunity | High responsibilityMid-level Full TimeMcLean, Virginia, United States23h ago
-
API Integration | AWS | Adobe Commerce | Azure | BI Dashboards401k retirement plan | Health insurance | Hybrid work schedule | Paid time off | Performance bonusSenior-level Full TimeWeymouth, Massachusetts, United States23h ago
-
Robotics Hardware Integration Engineer USD 120K-158KAWS IoT | AWS IoT Core | AWS IoT Greengrass | C++ | CANDirect impact on shipped products | Early-stage company | Equity | Health, dental, and vision insurance | Permissive time off policyMid-level Full TimeAtlanta, Georgia, United States - Remote R23h ago
-
Lead AI Engineer (ML Ops) USD 116K-170KAPI Development | AWS | Azure | CI/CD | Cloud services401k match | Charity match | Employee assistance program | Employee stock purchase plan | Health and wellness allowanceSenior-level Full TimeIrving - 6011 Connection, United States23h ago
-
Senior-level Full TimeMcLean, VA, United States23h ago