Senior Data Engineer
Tasks
- Build real time and batch ingestion pipelines
- Deploy manage and scale data workloads
- Design and implement Lakehouse environment
- Develop and optimize ETL workflows
- Monitor end to end data lifecycles
- Optimize storage with compaction and data skipping
- Own storage lifecycle management
- Write and tune high performance queries
Perks/Benefits
- Charitable giving program
- Company-Paid Holidays
- Dental insurance
- Life insurance
- Medical insurance
- PTO
- Retirement programs
- Vision insurance
- Work from home options
Skills/Tech-stack
Amazon EKS | Apache Spark | Async Processing | Data Ingestion | Data Partitioning | ETL | Infrastructure as Code | Kafka | Kubernetes | Lakehouse | Query Optimization | Schema evolution | Snapshot management | Workflow Orchestration | “as-code”
Education
N/A
Roles
Regions
Countries
States
Related jobs
-
Automation Testing | CI/CD | CSS | Cypress | Feature DevelopmentMedical, dental & vision coverage | Paid time off | Parental leave | Reimbursement programs | Retirement planMid-levelRaleigh, United States R11d ago
-
Senior AI Software Engineer USD 160K-198KA2A | ADK | API | Containers | EnvoyNo visa sponsorship | Remote workSenior-level Full TimeRemote US R11h ago
-
Senior Machine Learning Engineer USD 120K-195KAnomaly Detection | Apache Beam | Apache Spark | BigQuery | CI/CD401k | Compassionate leave | Dental insurance | Discount Portal | HolidaysSenior-level Full TimeRemote - US R12h ago
-
Senior MLOps Platform Engineer {S} USD 120K-185KAWS EKS | Airflow | Amazon S3 | Argo CD | Batching401k match | Dental insurance | Employee assistance program | HSA contributions | Health insuranceSenior-level Full TimeColorado Springs, Colorado, United States R15h ago
-
Senior Staff Engineer - Data Scientist USD 150K-190KAmazon Web Services | Anomaly Detection | Apache Airflow | Apache Kafka | Apache SparkContract-to-hire | Remote work | Travel opportunitiesSenior-level Full TimeRemote, REMOTE, United States R16h ago
-
Manager, Data Engineering USD 130K-166KAWS | Access Controls | Apache Airflow | Audit Logging | AzureCollaborative team culture | Remote work | Work-life balanceSenior-level Full TimeRemote, United States R17h ago
-
Senior Software Engineer - Data Platform USD 150K-195KAPIs | BigQuery | C++ | CI/CD | Cloud Storage401k company contribution | Disability insurance | Fertility and infertility benefits | Industry competitive PTO | Learning and development opportunitiesSenior-level Full TimeUnited States R17h ago
-
Senior Data Engineer (Remote, US) USD 140K-211KAirflow | Aiven | Apache Spark | BigQuery | CI/CD401k company contribution | Annual professional development fund | Be Well program | Paid volunteer service hours | Parental leaveSenior-level Full TimeRemote - United States R18h ago
-
Machine Learning Engineer USD 155K-228KAirflow | Amazon SageMaker | Apache Spark | Argo CD | Artificial IntelligenceHealthcare insurance | Paid parental leave | Paid personal time off | Paid sick time | Paid time offMid-level Full TimeRemote - US R19h ago
-
Data Solutions Engineer II USD 72K-115KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure SynapseMid-level Full TimeOhio WFH, United States R1d ago
-
Cloud Data Engineer USD 125K-205KApache Airflow | Apache Spark | Azure | CI/CD | ContainersFlexible work hours | Fully remote option | Occasional Evening CoverageMid-level Full TimeComerica Park, United States R1d ago
-
Sr AI Platform Specialist Solution Architect USD 206K-330KAnsible | CI/CD | Computer Vision | Data pipeline | Deep learningSenior-level Full TimeRemote US CA, United States R1d ago
-
API Integration | Apache Airflow | Apache Beam | Bash | BigQuerySenior-level Full TimeHome, United States R1d ago
-
Senior Database Site Reliability Engineer USD 120K-160KAlerting | Ansible | Automation | Azure | BashDental insurance | Disability insurance | Health insurance | Life insurance | Mentorship programSenior-level Full TimeUnited States - Remote R1d ago
-
Senior Software Engineer, Data Platform USD 164K-227KAccess Control | Airflow | Amazon Kinesis | Amazon Redshift | Apache Flink401k match | Community volunteer time | Commuter benefit | Company-paid days off | Dental insuranceSenior-level Full TimeSan Francisco, CA, USA R1d ago
-
Data Engineer USD 100KAPIs | Apache Kafka | Apache Spark | Azure | Azure Data401k match | Dental insurance | Life insurance | Medical insurance | Paid sick leaveEntry-level Full TimeRemote, US R1d ago
-
Senior Data Engineer USD 165K-175KAWS Glue | AWS Step Functions | Amazon Athena | Amazon EMR | Amazon KinesisEmployee discounts | Employee equity | Medical, dental & vision coverage | Unlimited PTOSenior-level Full TimeRemote - United States R1d ago
-
Principal AI/ML Engineer - AdTech USD 300K-400KAWS | Ad Exchanges | Apache Kafka | Apache Spark | CassandraEmployee discounts | Employee equity | Medical, dental & vision coverage | Pet insurance | Unlimited PTOSenior-level Full TimeRemote - United States R1d ago
-
Lead AI Engineer USD 200K-215KA/B | A/B Testing | AWS Bedrock | Agentic LLM | Agentic LLM systemsDental insurance | Employee discounts | Employee equity | Health insurance | Pet insuranceSenior-level Full TimeRemote - United States R1d ago
-
Data Engineer USD 135K-200KAPI Integration | AWS Firehose | AWS Kinesis | AWS Lambda | Amazon ECS401k | Dental insurance | Disability insurance | EAP | Employee assistance programSenior-level Full TimeNew York, NY (remote) R1d ago
-
HPC - AI/ML Platform Engineer USD 113K-190KAnsible | Bash | CI/CD | GPU scheduling | GrafanaDental insurance | Employee resource groups | Flexible family care | Health insurance | Paid HolidaysMid-level Full TimeUnited States R1d ago
-
Senior Data Engineer USD 143K-229KAnalysis Services | Azure Data | Azure Data Factory | Azure DevOps | Azure Gen2Mentorship | Remote work opportunity | Travel as requiredSenior-level Full TimeDenver, CO, United States R1d ago
-
Senior Data Engineer USD 143K-229KAnalysis Services Tabular | Azure Analysis | Azure Analysis Services | Azure Analysis Services Tabular | Azure DataMentorship | Remote work optionSenior-level Full TimeKansas City, MO, United States R1d ago
-
Databricks Pipeline Architect USD 150K-180KAWS Glue | AWS Lambda | AWS S3 | Agile | Amazon Web ServicesPublic trust clearance support | Remote workSenior-level Full TimeWork from home, VA, United States R1d ago
-
Senior Software Engineer - Data Platform USD 186K-218KAccess Control | Airflow | Apache Kafka | Apache Spark | CachingSenior-level Full TimeRemote - USA R2d ago