Lead Data Flow Engineer (Java/NiFi Focus) - PRIME, Hybrid - TS/SCI
Tasks
- Administer Apache NiFi
- Build and manage big data ingestion infrastructure
- Design data models
- Develop data extraction and custom logic
- Ensure data integrity
- Implement testing and monitoring
- Lead data flow ingestion
- Modify data sources and data pipelines
- Perform ETL development
- Support ingest to visualization
- Troubleshoot dataflow issues
Perks/Benefits
Skills/Tech-stack
AWS | AWS S3 | AWS SQS | Apache Airflow | Apache Kafka | Apache NiFi | Bash | Data Modeling | Data pipeline | Docker | ETL | GitLab | Integration Testing | JSON | Java | Kubernetes | Linux | Maven | Server Administration | Unit Testing | XML | YAML
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer | Senior Data Engineer
Related jobs
-
Data Engineer (remote) USD 85K-100KAgile | Apache Spark | Artificial Intelligence | Azure Data | Azure Data Factory401k match | Employee assistance program | Flexible schedule | Health insurance | Paid parental leaveMid-level Full TimeWork From Home, United States R2h ago
-
Mid-level Full TimeSalt Lake City, Utah4h ago
-
Data Engineer ID50062 USD 148K-164KAWS | AWS SageMaker | AWS SageMaker Studio | Airflow | Apache SparkEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeBlacksburg, United States4h ago
-
Full Stack Developer - Cloud Engineer USD 107K-160KAPI Design | Agile | Amazon SageMaker | Analytical Data | Analytical Data WarehouseMid-level Full TimeColumbus, Ohio, United States6h ago
-
Lead Data Architect USD 173K-276KAI metadata | Cloud Platforms | Data Architecture | Data Governance | Data Lakes401k | Dental insurance | Health insurance | Paid time off | Vision insuranceExecutive-level Full TimeFoster City, CA, United States7h ago
-
Data Engineer, Analytics USD 205K-235KData Governance | Data Modeling | Data Quality | Data Security | Data VisualizationEntry-level Full TimeSeattle, WA7h ago
-
Software Engineer, Machine Learning USD 185K-200KClassification | Computer Vision | Data Mining | Data Regression | Deep learningMid-level Full TimeMenlo Park, CA7h ago
-
Data Engineer (Analytics) USD 191K-235KBig Data | Data Modeling | Data Warehousing | Data integration | Dimensional ModelingDomestic and international travel | TelecommutingMid-level Full TimeMenlo Park, CA | Remote, US R7h ago
-
AI Engineer, Professional Services, Google Cloud USD 183K-265KApache Beam | Apache Spark | C++ | Data Validation | Data WarehousingTechnical workshops | Travel opportunitiesSenior-level Full TimeAustin, TX, USA; Atlanta, GA, USA7h ago
-
Product Software Modernization Engineer, Quantum AI USD 147K-211KBazel | Cloud Spanner | Cloud Storage | Cloud platform | Distributed cloudMid-level Full TimeSeattle, WA, USA; Goleta, CA, USA7h ago
-
Software Engineer III, Infrastructure, GDC AI Storage USD 147K-211KCSI | Data Structures | Data Structures and Algorithms | Distributed Systems | GoSenior-level Full TimeKirkland, WA, USA7h ago
-
Automation | C++ | CSS | Database Design | HTMLMid-level Full TimeAnn Arbor, MI, USA7h ago
-
Software Engineering - DataStage Developer USD 112K-129KAxway | Axway Secure SFTP | Azure | Azure DevOps | CA7 SchedulerHybrid work schedule | Remote workMid-level Full TimeSyracuse, New York, United States10h ago
-
Senior Data Engineer - Knowledge Platform USD 160K-260KApache Airflow | Apache NiFi | Batch Processing | BigQuery | Cloud platformEquity compensation | Fully stocked kitchen | Open office space | Team building eventsSenior-level Full TimeUS - San Francisco15h ago
-
Robotics Platform Security Engineer USD 90K-300KAppArmor | Auditd | C# | C++ | CIS BenchmarksHybrid work option | On-site collaboration | Remote work optionSenior-level Full TimeIrvine, CA15h ago
-
Data Center Operations Systems Engineer (Dallas, TX) USD 89K-145KAirflow management | Aisle containment | Boot process | Cable Management | Cable Optics401k company match | Commuter stipend | Dental insurance | Flexible paid time off | Health insuranceMid-level Full TimeDallas, TX - Data Center16h ago
-
Applied AI ML Engineer-Senior Associate USD 175K-210KAWS | Amazon Bedrock | Amazon EKS | Amazon SageMaker | Data ShardingBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimeNew York, NY, United States17h ago
-
Machine Learning Engineer, Growth USD 130K-500KElasticsearch | Embeddings | Fine Tuning | Go | KafkaEquity grant | Free gym membership | Health insurance | Housing bonus | Meals stipendMid-level Full TimeSan Francisco18h ago
-
Senior Analytics Engineer USD 87K-161KData Lakehouse | Data mesh | Databricks | Delta Lake | ETL401k | Health insurance | Hybrid work | Paid time off | Remote workSenior-level Full TimeRemote-MO, United States R19h ago
-
Data Engineer II USD 63K-114KData Processing | ETL | Real Time | Real-time Data | Real-time Data Processing401k | Flexible work schedule | Health insurance | Paid time off | Tuition reimbursementMid-level Full TimeRemote-MN, United States R19h ago
-
Principal Software Engineer - Robotics & Drones USD 170K-200KAPIs | Accelerators | CPU | Camera Signal Processing | Cloud DataSenior-level Full TimeBoston, MA - USA, United States19h ago
-
Lead, Data Platform Engineer USD 132K-150KApache Airflow | DBT | Data Pipeline Monitoring | Data Quality | Data Transformation401k retirement plan | Dental insurance | Health insurance | Holiday pay | Parental leaveSenior-level Full TimeUS063 NJ Raritan - 920 US …19h ago
-
Quantitative Analyst, Portfolio Engineering & Analytics USD 120K-135KAPI Development | AWS | Azure | Cloud platform | FastAPI401k matching | Employee stock purchase plan | Flexible paid time off | Health and wellbeing benefits | Hybrid work scheduleMid-level Full TimeBoston, United States19h ago
-
Scientist III, Data Engineer USD 161K-186KACID | API Gateway | AWS API | AWS API Gateway | AWS CodePipeline401k | Accident insurance | Commuter benefits | Dental insurance | Employee assistance programSenior-level Full TimeUS - Waltham, MA - 168 … R19h ago
-
Applied AI ML-Senior Associate USD 177K-240KAWS | Algorithms | Azure | Data Quality | Data StructuresBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimeNew York, NY, United States20h ago