Data Engineer
Tasks
- Add observability and monitoring
- Architect data platforms on AWS
- Build Spark based ETL ELT pipelines
- Collaborate with stakeholders to translate data requirements into solutions
- Ensure secure data handling
- Establish lineage tracking
- Implement CI/CD best practices
- Implement data quality governance and reliability
- Maintain code reviews and documentation standards
- Manage cloud costs
- Manage end-to-end data lifecycle
- Model and transform data
- Optimize platform performance and scalability
- Orchestrate data workflows
- Serve data for analytics
- Set up testing frameworks and data validation
- Use infrastructure as code
Perks/Benefits
Skills/Tech-stack
AWS | AWS Lambda | Amazon DynamoDB | Amazon EMR | Amazon Redshift | Amazon S3 | Amazon SNS | Amazon SQS | Apache Airflow | Apache Hive | Apache Kafka | Apache Spark | CI/CD | DBT | Data Governance | Data Modeling | Data Quality | Data Validation | Data handling | Docker | GitHub Actions | Infrastructure as Code | Lineage | Looker | Observability | Python | Scala | Secure Data | Secure Data Handling | Terraform | “as-code”
Education
Roles
Regions
Countries
States
Cities
Related jobs
-
Senior GenAI Software Engineer (North America) USD 165K-230KA/B | A/B Testing | B testing | Debugging | EvaluationEquity | Health, dental, and vision benefits | In person team gatherings quarterly | Remote-first work | Wellness stipendsSenior-level Full TimeUnited States R15h ago
-
Machine Learning Scientist, BioML USD 200K-330KAWS | Azure | Bioinformatics | Cloud Computing | Computational Biology401k employer match | Equity participation | Health, dental, vision insurance | Paid time off | Professional developmentMid-level Full TimeEmeryville, California, United States; Hybrid (2-3 … R16h ago
-
Machine Learning Platform Engineer USD 135K-160KAmazon SageMaker | Apache Flink | C++ | CI/CD | Cloud PubSub401k match | Annual bonus | Company equipment provided | Company medical dental vision plans | Disability benefitsMid-level Full TimeAtlanta, GA preferred, Remote R17h ago
-
Senior Developer Advocate - Modern App Development USD 194K-237KAPI Integrations | AWS | Cloud platform | Code Quality | Google CloudCommunity groups | Employee stock purchase plan | Inclusion talks | Mental health benefits | Mentor/Buddy programSenior-level Full TimeCalifornia, USA, Remote; Nevada, USA, Remote; … R17h ago
-
Staff Software Engineer, AI Developer Tools USD 180K-245KAPI Design | Agent systems | CI/CD | Compliance | Data PrivacySenior-level Full TimeDenver, CO;San Francisco, CA;New York, NY;Seattle, … R18h ago
-
Staff Software Engineer, Big Data Storage USD 177K-364KApache Flink | Apache Hive | Apache Iceberg | Apache Spark | Column BackfillSenior-level Full TimePalo Alto, CA, US; Remote, US R18h ago
-
Senior AI Data Engineer USD 160K-200KAWS Glue | AWS Lambda | Amazon Kinesis | Amazon Redshift | Amazon S3401k matching | Dental insurance | Disability insurance | Life insurance | Medical insuranceSenior-level Full TimeSan Diego, California, United States R18h ago
-
Senior Embedded Software Engineer - Future Forward USD 153K-201KAuthentication | Board Bring-up | Bring-up | C# | C++Senior-level Full TimeSunnyvale, CA, United States R18h ago
-
Senior Software Engineer, Data Authoring Platform USD 196K-230KAPI Design | Anomaly Detection | Automated testing | DSL | Data GovernanceEmployee travel credits | Remote eligibleSenior-level Full TimeRemote USA R19h ago
-
Lead AI Engineer, Business Operations (Hybrid or Remote USD 150K-220KAPI Design | Backend Development | Cloud Platforms | Evaluation Frameworks | Fine Tuning401k company match | Career advancement opportunities | Dental insurance | Flexible time off policy | Life insuranceSenior-level Full TimeDallas, Texas, United States; United States R19h ago
-
AWS | Airflow | Apache Spark | Azure Synapse | Azure Synapse Analytics401k matching | Disability insurance | Employee assistance program | Life insurance | Medical/Dental/Vision insuranceMid-level Full TimeRemote, USA ; Remote, Canada R20h ago
-
Principal Data Engineer/ Technical Lead USD 219K-298KAWS | Access Layer | Aggregation pipelines | Apache Kafka | Apache Spark401k match | Employer paid medical/dental/vision | Flexible spending account | Paid parental leave | Remote first work from homeSenior-level Full TimeUnited States (Remote) R21h ago
-
Senior Software Engineer II - (AI Core Platform) USD 100K-177KAPI Development | API Gateway | AWS | Agile | AlertingMid-level Full TimeRemote, United States R21h ago
-
Senior Software Engineer I - AI/ML USD 145K-190KAPI Development | Agile | Alerting | CI/CD | Data ModelingSenior-level Full TimeRemote, United States R21h ago
-
AI Expert USD 148K-175KAWS | Agile | Batch Processing | Data Mapping | Data ModelingHybrid work | Public Trust Clearance | Remote workSenior-level Full TimeMemphis, TN, United States R21h ago
-
Machine Learning Engineer II USD 160K-210KAirflow | Apache_Spark | Autoscaling | C++ | CI_CDDental insurance | Disability insurance | Flexible vacation | Health insurance | Life insuranceSenior-level Full TimeRemote, USA R22h ago
-
People Analytics AI Engineer USD 146K-221KAPI Integration | AWS | Amazon Redshift | Automation | Data ModelingFlexible working | Health benefits | Parental leave plans | Professional development stipend | Remote ModelSenior-level Full TimeRemote - Seattle R22h ago
-
Senior AI Integration Engineer USD 190K-190KAWS | AgenticAI | AmazonS3 | Bash | BedrockPart-time remote workSenior-level Full TimeNew York, New York, United States R1d ago
-
Sr . SAP Datasphere + Databricks Engineer - Hybrid USD 180K-248KAPI | Access Control | CI/CD | Data Classification | Data GovernanceHybrid workSenior-level ContractDurham or Philadelphia, United States R1d ago
-
VP II AI, Machine Learning|US Remote* USD 202K-210KApache Spark | Azure | Databricks | ETL | Flume401k match | Medical/Dental/Vision insurance | Paid time offMid-level Full TimeRemote, United States R1d ago
-
Data Engineer - AWS/Databricks - Mid Level USD 121K-170KAWS | AWS Glue | Adaptive query execution | Amazon CloudWatch | Amazon RDSComprehensive benefits | Mentorship | Mentorship and personalized development plans | Training budget | Work/life balance focusMid-level Full TimeReston, VA, United States R1d ago
-
Assistant Director, Data Science (STP) USD 139K-226KData Visualization | GLM | Insurance pricing | MLOps | Machine LearningDomestic travel | TelecommutingExecutive-level Full TimeBoston, MA, United States R1d ago
-
Inference Engineer USD 180K-250KCUDA | Continuous batching | Distributed Systems | Generative Models | Machine Learning401k | Commuter allowance | Dental insurance | Flexible PTO | Health insuranceMid-level Full Time*HQ - San Francisco, CA R1d ago
-
Principal Machine Learning Engineer USD 205K-230KAWS Lambda | BigQuery | C# | CI/CD | Cloud Functions401k | Dental insurance | Health insurance | Life insurance | Paid HolidaysSenior-level Full TimeUnited States of America - Remote … R1d ago
-
Generative AI Engineering Intern (Graduate) USD 70K-70KAWS | Agile | Azure OpenAI | Azure OpenAI Service | CI/CDDedicated mentorship | Flexible scheduling | Networking opportunities | Potential full-time employment | Remote friendly schedulingEntry-level Full Time InternshipUnited States R1d ago