Lead Data Flow Engineer (Java/NiFi Focus) - PRIME, Hybrid - TS/SCI
Tasks
- Build ETL pipelines
- Design data pipelines
- Implement integration testing
- Implement unit testing
- Ingest high volume data
- Optimize data ingestion frameworks
- Transform data into intelligence
Perks/Benefits
Skills/Tech-stack
Amazon S3 | Amazon SQS | Amazon Web Services | Apache NiFi | Data Ingestion | Data Pipelines | ETL | Integration Testing | Java | Kafka | Unit Testing | Web Services
Education
Roles
Data Engineer | Engineer | Lead | Senior Data Engineer | Technical Lead
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R6d ago
-
Senior AI Solutions Engineer USD 164K-215KAI Observability | Agentic Systems | Airflow | Amazon S3 | Amazon Web Services401k plan | Annual Caltrain Pass | Fastrak reimbursement | Fitness reimbursement | Health, dental, vision insuranceSenior-level Full TimeUS - Remote R19h ago
-
Lead Data Engineer USD 160K-193KAmazon Redshift | CI/CD | DBT | ELT | ETL401k match | Adoption benefits | Employee resource groups | Flexible time off | Health insuranceSenior-level Full TimeDeerfield, IL, United States R21h ago
-
Senior Software Engineer Remote/Travel- Active Secret -Top Secret clearance(SCI-eligibility) USD 145K-200KAPI Testing | Cloud Computing | Cypher | Data Processing | Data QualityProfessional growth | Remote work | Travel opportunitiesSenior-level Full TimeReston, VA, United States R23h ago
-
Senior-level Full TimeUS Remote R1d ago
-
Senior Database Administrator - ETL USD 106K-180KAmazon Web Services | Bitbucket | Data Guard | Data Integration Studio | Database Encryption401k matching | Comprehensive healthcare | Fully remote work schedule | Paid time off | Profit sharingSenior-level Full TimeSt. Louis, MO, United States R1d ago
-
Batch Processing | Bias Mitigation | C++ | Data Processing | Experimentation401k employer match | Caregiving support | Family planning support | Flexible vacation | Gender-affirming careSenior-level Full TimeRemote - United States R1d ago
-
Machine Learning Engineer USD 151K-265KC++ | Cloud infrastructure | Data Analysis | Debugging | Distributed ComputingSenior-level Full TimeSan Jose, United States R1d ago
-
Agentic Workflows | CI/CD | Docker | Embeddings | Evaluation instrumentationEducational assistance | Health and wellness benefits | Hybrid work schedule | Paid Holidays | Paid maternity and parental bonding leaveSenior-level Full TimeNew Jersey Office - 210 Hudson … R1d ago
-
Bioinformatics Engineer (Hybrid) USD 95K-125KAWS CDK | Amazon Web Services | Batch computing | CI/CD | CWL401k match | Career advancement opportunities | Dental insurance | Disability insurance | Education assistanceEntry-level Full TimeBaltimore, MD, United States R1d ago
-
Airflow | CI/CD | Cause analysis | Data Modeling | Data PipelinesHealth insurance | Paid time off | Remote work | Retirement planSenior-level Full TimeRosemont, IL, United States of America R1d ago
-
Senior Engineer, Data Integration USD 101K-175KAzure | Cloverleaf | Data Transformation | Data Validation | Data profilingHealthcare benefits | Incentive programs | Professional development | Recognition programs | Remote workSenior-level Full TimeWork at Home - Ohio - … R1d ago
-
Azure Data and MLOps Engineer USD 119K-222KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Databricks401k match | Dental insurance | Life insurance | Long-term disability | PTOSenior-level ContractUnited States - Remote R1d ago
-
Senior-level Full TimeTwo Destiny Way, Westlake TX, United … R1d ago
-
Senior Data Engineer - Power BI USD 97K-185KAWS Batch | AWS CloudFormation | Agile | Amazon EC2 | Amazon EKSSenior-level Full Time100 New Millennium Way, Bldg 2, … R1d ago
-
Data Engineer USD 94K-175KAWS | AWS Glue | Apache NiFi | Data Visualization | Document DatabasesCareer development | Employee assistance program | Fitness reimbursement | Flexible work-life balance | Headspace accessMid-level Full TimeUnited States of America, McLean, Virginia R1d ago
-
Senior Software Engineer - Machine Learning (Remote) USD 90K-170KAPI Gateway | Agent Frameworks | Agentic AI | Apache Airflow | Apache BeamRemote workSenior-level Full TimeGEORGIA - VIRTUAL - GA01, United … R1d ago
-
Principal Engineer - Data Platform USD 221K-387KAccess Control | Apache Spark | Audit Logging | CDC | CompactionSenior-level Full TimeSanta Clara, California, United States R1d ago
-
Software Engineer - Managed Kubernetes USD 225K-300KC plus plus | C# | CI/CD | CNI | CSIHybrid work schedule | On site office days 4 per week | Work from home day TuesdayMid-level Full TimeSan Francisco Office (Fremont St) R1d ago
-
Senior Data Engineer USD 155K-186KBigQuery | Cloud platform | DBT | Data Governance | Data Ingestion401k match | Accident insurance | Dental insurance | Disability insurance | Employee assistance programSenior-level Full TimeSan Francisco, CA R1d ago
-
Machine Learning Engineer II USD 160K-231KAlgorithms | Computer Vision | Data Pipelines | Data analytics | Entity recognitionMid-level Full TimeRemote - USA R1d ago
-
Senior Software Engineer - Computational Platform USD 154K-200KAPI Development | AWS | Cloud Networking | Data Modeling | Data Pipelines401k plan | Commuter support | Company-provided laptop | Flexible paid time off | HolidaysSenior-level Full TimeRemote; Watertown, Massachusetts, United States R1d ago
-
Senior-level Full TimeDeerfield, IL, United States R1d ago
-
Senior Software Engineer I- Data & Insights Engineering USD 135K-165KAmazon Redshift | BigQuery | CI/CD | Data Pipelines | Database replicationSenior-level Full TimeRemote, United States R1d ago
-
Azure Data | Azure Data Factory | Azure DevOps | Azure Synapse | Azure Synapse Analytics401k plan | Company holidays | Floating holidays | Paid time off | Remote workSenior-level Full TimeUnited States R2d ago