Lead Data Flow Engineer (Java/NiFi Focus) - PRIME, Hybrid - TS/SCI
Tasks
- Build ETL pipelines
- Design data pipelines
- Develop and test data processing components
- Ingest and route data using message systems
- Optimize data ingestion frameworks
- Transform high volume data into intelligence
Perks/Benefits
Skills/Tech-stack
Amazon S3 | Amazon SQS | Apache Kafka | Apache NiFi | Data Ingestion | ETL | Integration Testing | Java | Unit Testing
Education
Roles
Data Engineer | Engineer | Lead | Senior Data Engineer | Technical Lead
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R4d ago
-
Batch Processing | Bias Mitigation | C++ | Data Processing | Experimentation401k employer match | Caregiving support | Family planning support | Flexible vacation | Gender-affirming careSenior-level Full TimeRemote - United States R11h ago
-
Software Engineer - Managed Kubernetes USD 225K-300KC plus plus | C# | CI/CD | CNI | CSIHybrid work schedule | On site office days 4 per week | Work from home day TuesdayMid-level Full TimeSan Francisco Office (Fremont St) R13h ago
-
Senior Data Engineer USD 155K-186KBigQuery | Cloud platform | DBT | Data Governance | Data Ingestion401k match | Accident insurance | Dental insurance | Disability insurance | Employee assistance programSenior-level Full TimeSan Francisco, CA R13h ago
-
Senior Software Engineer - Computational Platform USD 154K-200KAPI Development | AWS | Cloud Networking | Data Modeling | Data Pipelines401k plan | Commuter support | Company-provided laptop | Flexible paid time off | HolidaysSenior-level Full TimeRemote; Watertown, Massachusetts, United States R15h ago
-
Senior-level Full TimeDeerfield, IL, United States R15h ago
-
Senior Software Engineer I- Data & Insights Engineering USD 135K-165KAmazon Redshift | BigQuery | CI/CD | Data Pipelines | Database replicationSenior-level Full TimeRemote, United States R16h ago
-
Azure Data | Azure Data Factory | Azure DevOps | Azure Synapse | Azure Synapse Analytics401k plan | Company holidays | Floating holidays | Paid time off | Remote workSenior-level Full TimeUnited States R21h ago
-
Lead Data Analyst, Marketing USD 120K-150KAffiliate Marketing | Business Intelligence | CAC Analysis | Conversion Rate | Conversion rate optimizationGlobal team | Performance-based growth | Profit-sharing bonus | Remote-first cultureSenior-level Full TimeArlington, VA (remote); Baltimore, MD (remote); … R23h ago
-
Lead Data Analyst, Marketing USD 120K-150KAffiliate Marketing | Dashboard Standardization | Data Ingestion | Data Modeling | Data QualityCompetitive benefits | Profit-sharing bonus | Remote-first teamSenior-level Full TimeDenver, CO (remote); Las Vegas, NV … R23h ago
-
Lead Analytics Manager USD 120K-150KAffiliate Marketing | CAC Analysis | Dashboard Development | Data Ingestion | Data LiteracySenior-level Full TimeLos Angeles, CA (remote); Portland, OR … R23h ago
-
Sr. Data Engineer USD 109K-145KAWS | Agile | CI/CD | Compliance | Data Governance401k matching | Employee assistance program | Flexible working hours | Learning platform access | Medical, dental, and vision insuranceSenior-level Full TimeRemote, TX, United States R1d ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Flink | Apache HBase | Apache Hive | Apache Hudi100 percent remote | Career growth | Full-time W2 employmentSenior-level Full TimeUnited States - Remote R1d ago
-
AI Data Engineer USD 100K-150KApache Beam | CI/CD | Data Ingestion | Data Lineage | Data ModelingRemote workMid-level Full TimeUnited States - Remote R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
Data Engineer USD 88K-102KAWS | Data Lake | Data Modeling | Data Transformation | Data WarehouseEmployee discounts | Health care options | Paid leave | Remote work option | Retirement contributionsMid-level Full TimeIthaca (Main Campus), United States R1d ago
-
AI Infrastructure Engineer USD 100K-150KApache Beam | Apache Spark | CI/CD | Code review | Data LineageMid-level Full TimeUnited States - Remote R1d ago
-
Lead Software Engineer-0341 USD 129K-212KAirflow | Amazon CloudWatch | Amazon EC2 | Amazon IAM | Amazon S3Remote work one or more days per weekSenior-level Full TimeVA - Reston, 11951 Freedom Dr … R1d ago
-
Senior Software Engineer Remote/Travel- Active Secret -Top Secret clearance(SCI-eligibility) USD 145K-204KAPI Testing | Cypher | Data Processing | DataOps | DevOpsCompetitive benefits | Growth opportunity | Remote work | TravelSenior-level Full TimeReston, VA, United States R1d ago
-
Senior Data Solutions Lead USD 175K-200KAWS | Agile | Apache Airflow | Apache Kafka | Apache SparkDHS Public Trust suitability determination | Remote workSenior-level Full TimeWork from home, VA, United States R2d ago
-
API Design | Agent Optimization | Agent systems | Atomic operations | Caching401k plan | Calm app access | Disability insurance | In Home Office Setup Support | Internet stipendSenior-level Full TimeUnited States and Canada - Remote … R3d ago
-
Lead Data Engineer USD 160K-193KAmazon Redshift | CI/CD | DBT | ELT | ETL401k match | Adoption benefits | Employee resource groups | Flexible time off | Health insuranceSenior-level Full TimeDeerfield, IL, United States R3d ago
-
Senior Data Engineer II USD 134K-203KAPI Gateway | API Management | AWS | AWS API | AWS API GatewayHealth insurance | Health leave | Parental leave | Professional development stipend | Remote work flexibilitySenior-level Full TimeRemote - US R3d ago
-
Forward Deployed ML/AI Engineer USD 167K-200KAWS | Azure | CI/CD | Databricks | DockerAnnual company retreat | Company winter break | Education bonus | High-performance culture | Optional in person events and meetupsSenior-level Full TimeUnited States R3d ago
-
Software Engineer II, Fulfillment USD 106K-142KA/B | A/B Testing | AWS | B testing | CI/CD401k match | Education stipend | Employer-paid health insurance | Flexible time off | IKEA discountsSenior-level Full TimeSan Francisco, California, United States R3d ago