Lead Data Operations Engineer
Tasks
- Address performance issues in data governance and analytics tools
- Collaborate with data science teams to define ingestion and processing best practices
- Design implement and maintain AWS data lake environment
- Implement Terraform infrastructure
- Lead migration of legacy Big Data solutions to EMR
- Manage EMR cluster workloads
- Manage IICS cluster workloads
- Manage Talend cluster workloads
- Manage system installations, patches, and upgrades
- Troubleshoot application data cloud infrastructure Linux and automation scripts
Perks/Benefits
- 401k
- Disability insurance
- Health, dental, and vision insurance
- Life insurance
- Paid time off
- Remote work
Skills/Tech-stack
AWS | AWS CloudTrail | AWS CloudWatch | Alation | Alteryx | Amazon EMR | Amazon S3 | Apache Kinesis | Apache Tomcat | Auto Scaling | Bamboo | CI/CD | CloudFormation | EC2 | ECS | EKS | ELB | EventBridge | GitHub | HDP | Hadoop | Hadoop Ecosystem | IAM | Informatica IICS | KMS | Lambda | Linux | MSTR | NetApp | RDS | SNS | SQS | Tableau | Talend | Terraform | VPC | WebLogic
Education
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R17d ago
-
Apache Iceberg | CI/CD | Compaction | Cost Management | DBTEmployee Stock Purchase Plan (ESPP) | Flexible spending wallets | Health care coverage | Paid time off | Remote-first work environmentSenior-level Full TimeRemote US R5h ago
-
Principal Engineer - Data Platform USD 221K-387KAccess Control | Apache Spark | Audit Logging | CDC | CompactionSenior-level Full TimeSanta Clara, California, United States R9h ago
-
Senior-level Full TimeDeerfield, IL, United States R12h ago
-
Senior Data Engineer - Databricks USD 180K-247KAWS | Access Control | Apache Spark | Azure | CI/CD401k match | Career development program | Corporate Benefit Program | Educational resources | Employee Referral Bonus ProgramSenior-level Full TimeDenver, CO R14h ago
-
AWS | AWS Config | Checkov | CloudTrail | CloudWatchDomestic travel up to 100 percent | On-call support | Remote workMid-level Full TimeRemote - USA R15h ago
-
Azure Data | Azure Data Factory | Azure DevOps | Azure Synapse | Azure Synapse Analytics401k plan | Company holidays | Floating holidays | Paid time off | Remote workSenior-level Full TimeUnited States R18h ago
-
Principal AI Platform Engineer (US) USD 125K-200KAuthentication | Authorization | CI/CD | Container Security | Cost OptimizationRemote workSenior-level Full TimeRemote, USA R1d ago
-
Senior-level Full TimeUS - Remote; Canada - Remote R1d ago
-
Sr. Data Engineer USD 109K-145KAWS | Agile | CI/CD | Compliance | Data Governance401k matching | Employee assistance program | Flexible working hours | Learning platform access | Medical, dental, and vision insuranceSenior-level Full TimeRemote, TX, United States R1d ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Flink | Apache HBase | Apache Hive | Apache Hudi100 percent remote | Career growth | Full-time W2 employmentSenior-level Full TimeUnited States - Remote R1d ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Flink | Apache Hive | Apache Hudi | Apache IcebergSenior-level Full TimeUnited States - Remote R1d ago
-
AI Data Engineer USD 100K-150KActive Learning | Apache Beam | Apache Spark | CI/CD | Code reviewCareer growth | Health benefits | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
AI Data Engineer USD 100K-150KApache Beam | CI/CD | Data Ingestion | Data Lineage | Data ModelingRemote workMid-level Full TimeUnited States - Remote R1d ago
-
AI Data Engineer USD 100K-150KApache Beam | Apache Spark | CI/CD | Caching | Code review100 percent remote | Benefits | Career growth potentialMid-level Full TimeUnited States - Remote R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
Data Engineer USD 88K-102KAWS | Data Lake | Data Modeling | Data Transformation | Data WarehouseEmployee discounts | Health care options | Paid leave | Remote work option | Retirement contributionsMid-level Full TimeIthaca (Main Campus), United States R1d ago
-
AI Infrastructure Engineer USD 100K-150KApache Beam | Apache Spark | CI/CD | Code review | Data LineageMid-level Full TimeUnited States - Remote R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
Storage Engineer USD 100K-150KAnsible | Backup | CRUSH maps | CSI | Capacity PlanningBenefits package | H1B transfer support | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
AVP, Audit Execution Analytics USD 106K-130KAudit Analytics | Data Automation | Data Manipulation | Data Modeling | Data QualityEducational assistance | Health and wellness benefits | Income replacement for qualified employees with disabilities | Paid Holidays | Paid Maternity LeaveExecutive-level Full TimeTampa - 4050 West Boy Scout … R1d ago
-
Principal Data Science Engineer - Financial Crimes USD 107K-216KAnomaly Detection | Automated testing | CI/CD | Clustering | DBTSenior-level Full Time499 Washington Blvd., Jersey City NJ, … R1d ago
-
Lead Software Engineer-0341 USD 129K-212KAirflow | Amazon CloudWatch | Amazon EC2 | Amazon IAM | Amazon S3Remote work one or more days per weekSenior-level Full TimeVA - Reston, 11951 Freedom Dr … R1d ago
-
Forward Deployed Engineer (AI COE) USD 185K-250KAWS | Agent Frameworks | Agile | Autogen | Azure401k retirement plan | Annual bonus eligibility | Dental insurance | Disability insurance | Life insuranceSenior-level Full TimeUS - MI, Novi (Detroit) - … R1d ago
-
AI Platform Engineer (AI COE) USD 170K-250KAPI | AWS | Agent Frameworks | Automated Model Evaluation | Azure401k retirement plan | Annual bonus eligibility | Dental insurance | Disability insurance | Health insuranceSenior-level Full TimeUS - MI, Novi (Detroit) - … R1d ago