Senior Data Pipeline Engineer
CYC LINTHICUM HEIGHTS MD, United States
USD 113K-237K Senior-level Full Time
Tasks
- Administer NiFi cluster
- Automate infrastructure and deployments with Infrastructure as Code
- Configure environments and support project compliance and security
- Deploy and manage NiFi in AWS Azure and GCP
- Design implement troubleshoot dataflows with Apache NiFi
- Integrate data with Amazon S3
- Optimize NiFi cluster architecture and performance
- Track work in JIRA workflows
Perks/Benefits
- Comprehensive healthcare
- Continuing education
- Family support benefits
- Flexible time off
- Learning resources
- Retirement benefits
- Time off benefits
- Wellness benefits
Skills/Tech-stack
Amazon S3 | Apache NiFi | Apache Spark | Bash | CentOS 7 | Cloud Native | Cloud Native Services | Cloud deployment | Containerization | Docker | Elasticsearch | Expression Language | Groovy | Infrastructure as Code | Linux system | Linux system administration | MongoDB | Native services | NiFi Expression Language | Performance Tuning | Python | RedHat 8 | System Administration | Terraform | “as-code”
Education
Associate Degree | Bachelor of Science | High School Diploma | Master of Science | PhD
Related jobs
-
Senior Data Engineer - Knowledge Platform USD 160K-260KApache Airflow | Apache NiFi | Batch Processing | BigQuery | Cloud platformEquity compensation | Fully stocked kitchen | Open office space | Team building eventsSenior-level Full TimeUS - San Francisco7h ago
-
Robotics Platform Security Engineer USD 90K-300KAppArmor | Auditd | C# | C++ | CIS BenchmarksHybrid work option | On-site collaboration | Remote work optionSenior-level Full TimeIrvine, CA7h ago
-
Software Engineer II - Abnormal Data Platform USD 149K-214KAerospike | Amazon DynamoDB | Apache Spark | Data Storage | DatabricksDistributed team collaboration | Remote work | Technical mentorshipMid-level Full TimeRemote - USA R7h ago
-
Machine Learning Engineer, Growth USD 130K-500KElasticsearch | Embeddings | Fine Tuning | Go | KafkaEquity grant | Free gym membership | Health insurance | Housing bonus | Meals stipendMid-level Full TimeSan Francisco10h ago
-
Senior Analytics Engineer USD 87K-161KData Lakehouse | Data mesh | Databricks | Delta Lake | ETL401k | Health insurance | Hybrid work | Paid time off | Remote workSenior-level Full TimeRemote-MO, United States R11h ago
-
Abuse Test Engineer, Energy Storage USD 140K-224KActuation | Data Analysis | Data acquisition | Data logging | Electrochemical systemsSenior-level Full TimeMcCarran, NV12h ago
-
Data Warehouse Engineer USD 46K-60KCorepoint | Data Modeling | Data Quality | Data Validation | Data Warehousing401k match | Dental insurance | Discount programs | Employee counseling | FSAEntry-level Full TimeRemote, United States R12h ago
-
Lead Machine Learning Engineer USD 157K-237KA/B | A/B Testing | Airflow | B testing | Data PipelinesSenior-level Full TimeUS TX Austin13h ago
-
C++/CUDA Systems Engineer – Surgical Robotics Platform USD 140K-160KC++ | C++17 | C++20 | CPU GPU Scheduling | CUDAEquity | Health insurance | Paid time off | Performance bonusMid-level Full TimeLos Angeles, California13h ago
-
Senior Machine Learning Engineer USD 170K-237KA/B | A/B Testing | Apache Airflow | B testing | Deep learningSenior-level Full TimeUS TX Austin13h ago
-
AWS Batch | AWS EC2 | AWS IAM | AWS Lambda | AWS S3Annual bonus | Company paid benefits | Equity | Paid time offSenior-level Full TimeLos Angeles, California13h ago
-
Staff Applied AI Engineer, Enterprise GenAI USD 216K-270KAWS | Cloud platform | Data Analysis | Generative AI | Google CloudCommuter stipend | Equity compensation | Health, dental, vision insurance | Learning and development stipend | Paid time offSenior-level Full TimeSan Francisco, CA; Seattle, WA; New …13h ago
-
AI/ML Engineer USD 130K-223KAgentic AI | Deep learning | Distributed Training | Docker | EmbeddingsMid-level Full TimeScottsdale, AZ13h ago
-
Principal Engineer, Data & ML Platform USD 119K-180KAPIs | Automated testing | Cloud Native | Cloud platform | Continuous DeploymentSenior-level Full TimeScottsdale, AZ13h ago
-
Principal Machine Learning Engineer USD 245K-393KCloud infrastructure | Data Science | Distributed Systems | Infrastructure as Code | ML pipelinesSenior-level Full TimeChicago, Illinois, USA R13h ago
-
AI Ops Specialist USD 150K-210KAPI Integration | Automation | Evaluation | GitHub API | LLM Agents401k match | Dental insurance | Hardware setup | Health insurance | Unlimited PTOMid-level Full TimeNew York13h ago
-
Sr Sales Engineer, West USD 160K-196KAnalytics | Apache Spark | Artificial Intelligence | Dataiku | Kubernetes401k match | Dental insurance | Employer paid disability coverage | Flexible spending accounts | Medical insuranceSenior-level Full TimeUnited States, Remote R14h ago
-
Data Engineer USD 129K-178KApache Kafka | Apache Spark | Cloud Platforms | Data Compliance | Data GovernanceMid-level Full TimeUS - Remote R14h ago
-
Machine Learning Engineer, Foundation Model USD 129K-247KAuto-regressive models | C plus plus | Deep learning | Diffusion Models | Distributed TrainingSenior-level Full TimeSan Jose14h ago
-
Data Engineer USD 140K-160KAI workflows | DBT | JavaScript | N8n | Python401k access | Dental insurance | Health insurance | Life insurance | Paid parental leaveMid-level Full TimeNew York, NY14h ago
-
Mid-level Full TimeLondon, New York City14h ago
-
AI Engineer USD 53K-119KAPI Design | Cost Optimization | Embeddings | Evaluation | JSONDental insurance | Gym stipend | Health insurance | Medical membership | Offsite retreatsSenior-level Full TimeRemote, US R14h ago
-
Sr. Data Engineer USD 145K-160KAPI Development | AWS | AWS Glue | AWS Lambda | Amazon AthenaComplimentary club membership | Personal training | Pilates | Shop discounts | SpaßSenior-level Full TimeNew York, NY, United States14h ago
-
Senior Machine Learning Engineer, Operations Research USD 173K-218KCombinatorial Optimization | Deep learning | Keras | Machine Learning | Mathematical ProgrammingAnnual refresh grants | Equity grant | Flexible work policy | Remote workSenior-level Full TimeUnited States - Remote R14h ago
-
Machine Learning & Game Tech Architect USD 186K-257KAPI Design | C# | C++ | Game engines | Go401k matching | Dental insurance | Flexible schedule | Flexible working hours | Health insuranceSenior-level Full TimeBoston, MA, United States R15h ago