Staff Data Engineer- Data Lake
Tasks
- Architect data lake platforms
- Build and scale distributed ETL ELT pipelines
- Design batch and near real time processing frameworks
- Implement monitoring observability and governance
- Improve data quality validation normalization standardization
- Ingest structured and unstructured datasets
- Manage incident response and platform operations
- Mentor engineers technical leadership and architecture reviews
- Optimize Spark compute and storage performance
- Support secure scalable data delivery
- Troubleshoot production data and infrastructure issues
Perks/Benefits
- Flexible work hours
- Health insurance
- Paid time off
- Retirement options
- Wellness holidays
- Work from anywhere
Skills/Tech-stack
AWS | AWS EMR | AWS Glue | Airflow | Amazon Athena | Amazon Redshift | Amazon S3 | Apache Spark | Argo Workflows | Avro | Data Lake | Data Lake Architecture | Data Normalization | Data Quality | Data Standardization | Data Validation | Docker | ELT | ETL | File Formats | Java | Kubernetes | Monitoring | ORC | Observability | Parquet | Partitioning | PySpark | Python | SQL | Scala
Education
N/A
Roles
Regions
Countries
States
Cities
Related jobs
-
Senior ML/AI Modeler, Risk Automation Machine Learning USD 160K-283KAPI Integration | AWS | Airflow | Artificial Intelligence | Batch ProcessingFlexible time off | Medical insurance | Modern family planning | Remote work | Retirement savings plansSenior-level Full TimeSeattle, WA, United States of America R2h ago
-
Staff Data Engineer, Ads USD 248K-279KAPI Integration | Airflow | Alerting | Anomaly Detection | BigQuerySenior-level Full TimeRemote (U.S.) R9h ago
-
A/B | A/B Testing | AWS | Alerting | B testingAnnual refresh grants | Equity grant | Flex First Work Options | On-call rotation | Remote workSenior-level Full TimeUnited States - Remote R12h ago
-
Staff Data Engineer - Emerald USD 170K-190KAWS | Amazon EMR | Amazon Redshift | Amazon S3 | Apache AvroFlexible work hours | Health and charitable donation stipends | Health insurance options | Paid time off | Retirement optionsSenior-level Full TimeNew York R14h ago
-
Senior-level Full TimeWork from home, VA, United States R15h ago
-
Sr. Staff Machine Learning Engineer USD 170K-235KAWS | Apache Spark | Azure | CI/CD | Data Pipelines401k matching | Company equity | Free subscription | Medical/Dental/Vision | Paid HolidaysSenior-level Full TimeUSA R15h ago
-
C++ | Computer Vision | Data Association | Deep learning | Feature estimation401k match | Commuter benefits | Dental insurance | Employee assistance program | Health insuranceSenior-level Full TimeDearborn, Michigan, United States, Palo Alto, … R16h ago
-
Senior Machine Learning Engineer (Inference Platform) USD 175K-225KAWS | Alerting | CI/CD | Continuous batching | Data ProcessingSenior-level Full TimeRemote - USA R16h ago
-
A/B | A/B Testing | B testing | CI/CD | Data PipelinesSenior-level Full TimeRemote - USA R18h ago
-
Data Engineer (Multiple Levels) USD 105K-200KAWS | Apache Spark | CI/CD | Cloud platform | Code reviewRemote work in U SMid-level Full Time1668 S. Garfield Ave. 2nd Floor, … R1d ago
-
Machine Learning Engineer USD 161K-200KA/B | A/B Testing | B testing | Kafka | Kubernetes401k matching | Disability insurance | Employer-paid life insurance | Fertility benefits | Health insuranceSenior-level Full TimeBellevue, WA R1d ago
-
Data Engineer USD 111K-204KApache Airflow | Apache Spark | Azure Data | Azure Data Factory | Azure Data LakeContinuous learning | Employee ownership | Inclusive culture | Mentorship | Remote workSenior-level Full TimeRemote - VA, United States R1d ago
-
API Design | Angular | Azure | CI/CD | CSS3Mid-level Full TimeRemote Location, United States R1d ago
-
API Design | AWS | Algorithms | Amazon SQS | AzureFlexible time off | Healthcare benefits | Hybrid work model | Leave benefits | Retirement benefitsSenior-level Full TimeSF4-San Francisco - 400 Howard Street, … R1d ago
-
Applied AI Engineers USD 151K-332KASR | Barge In | CRM Integrations | Evaluation Frameworks | GoHybrid work | Remote work optionsMid-level Full TimeRemote (US), United States R1d ago
-
Manager, Applied AI Engineer USD 171K-375KAI/ML | ASR | Barge In | CRM | Enterprise IntegrationsCommunity impact | Employee benefits | Hybrid work | Remote work | Work-life balanceSenior-level Full TimeRemote (US), United States R1d ago
-
Data Engineer USD 100K-138K800-53 | API Integration | AWS GovCloud | Agile | Automated testing401k matching | Healthcare benefits | Life insurance | Paid Holidays | Paid time offMid-level Full TimeUnited States - Remote R1d ago
-
Data Engineer - Healthcare USD 97K-133KArtificial Intelligence | Azure | Big Data | Cause analysis | DBT401k retirement savings plan | Life insurance | Long-term disability | Medical, dental, vision benefits | Occasional travel for training or meetingsSenior-level Full TimeRemote US, United States R1d ago
-
Sr Assessor Data Quality Engineer (Hybrid/Remote) USD 87K-111KData Analysis | Data Auditing | Data Integrity | Data Modeling | Data QualitySenior-level Full Time4 First American Way, Santa Ana, … R1d ago
-
Lead Machine Learning Engineer - REMOTE USD 30K-190KAWS SageMaker | Batch inference | Data Quality | Drift Detection | Experiment tracking401k matching | Healthcare benefits | Paid parental leave | Personal day | Remote work scheduleSenior-level Full TimeBoston MA - Virtual, United States R1d ago
-
Principal MLOps Engineer USD 142K-196KAWS | Apache Airflow | Authority to Operate | Automated Deployment | Automated deployment pipelinesComprehensive healthcare benefits | Onsite onboarding travel up to 10 percent domestic | Paid time off | Remote work | Retirement benefitsSenior-level Full TimeRemote - Pennsylvania, United States R1d ago
-
Senior AI Engineer USD 216K-277KAWS | Agent systems | Autonomous Agents | Azure | By DesignCareer development | Home workspace stipend | MacBook provided | Medical, dental, and vision insurance | Mental health benefitsSenior-level Full TimeAustin, TX R1d ago
-
Data Engineer USD 130K-160KAWS | Change Data Capture | DBT | Data Capture | Data GovernanceEmployer-matched 401k | Employer-paid health insurance | Health & Wellness reimbursements | PTO | Paid HolidaysSenior-level Full TimeRemote (United States) R1d ago
-
Data Engineer I IS - Remote USD 104K-208KAPI Integration | Alerting | Bash | CDC | CI/CD401k with employer matching | Comprehensive benefits package | Health insurance (medical, dental, vision) | Paid parental leave | Paid time offEntry-level Full TimeRenton, WA, United States R1d ago
-
Senior Data Engineer USD 135K-165KAmazon Kinesis | Amazon Redshift | Apache Airflow | Apache Iceberg | Apache Kafka401k | Healthcare benefits | Paid time offSenior-level Full TimeVirtual, United States R1d ago