Lead Data Engineer
Tasks
- Architect end-to-end data solutions
- Build and maintain data pipelines and applications
- Build streaming data solutions
- Design data pipeline architecture on AWS
- Develop ETL and ELT processes
- Implement CI/CD strategies
- Implement data ingestion from on premises and AWS
- Implement serverless applications
- Migrate data to AWS data lakes and warehouses
- Optimize for cost reliability and scalability
- Perform unit testing and code reviews
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS CloudFormation | AWS Glue | AWS IAM | AWS KMS | AWS Secrets | AWS Secrets Manager | AWS Step Functions | Amazon Athena | Amazon DynamoDB | Amazon EMR | Amazon Kinesis | Amazon Lambda | Amazon Redshift | Amazon S3 | Amazon SQS | Apache Spark | CI/CD | Data Governance | Data Lakes | Data Modeling | Data Warehousing | Data integration | ELT | ETL | Python | SQL | Secrets Manager | Shell | Step Functions
Education
Bachelor of Arts | Bachelor of Engineering | Bachelor of Science | Bachelor of Science in Computer Science
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R7d ago
-
Power BI Technical Lead (New Jersey / US) USD 113K-132KAgile | Azure | Azure DevOps | BI Gateway | DAXSenior-level Full TimeNew Jersey, United States4h ago
-
A/B | A/B Testing | Apache Airflow | Apache Kafka | Apache SparkSenior-level ContractSanta Monica, United States4h ago
-
Senior Data Engineer ID75059 USD 156K-190KAPI Integration | AWS | Advanced SQL | Advanced SQL optimization | AirflowEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeFort Lauderdale, United States4h ago
-
Senior Data Engineer ID75059 USD 156K-190KAWS | Apache Airflow | Apache Spark | Avro | Columnar StorageFlexible schedule | Mentorship | Personalized growth roadmaps | Remote work options | TechtalksSenior-level Full TimeRichmond, United States4h ago
-
Senior Data Engineer ID75059 USD 156K-190KAPI Integration | AWS | Advanced SQL | Advanced SQL optimization | AirflowEducation budget | Exciting projects | Fitness budget | Flexible schedule | MentorshipSenior-level Full TimeMiami, United States4h ago
-
Senior Data Engineer ID75059 USD 156K-190KAPI Integration | AWS | Apache Airflow | Apache Spark | AvroEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionSenior-level Full TimeTexas City, United States4h ago
-
Senior Data Engineer ID75059 USD 156K-190KAWS | AWS SageMaker | Apache Airflow | Apache Spark | AvroFlextime | Mentorship | Personalized growth roadmaps | Professional growth | Remote work optionsSenior-level Full TimeBoca Raton, United States4h ago
-
Senior Data Engineer ID75059 USD 156K-190KAPI Integration | AWS | AWS SageMaker | Airflow | Apache SparkEducation budget | Exciting projects | Fitness budget | Flexible schedule with remote and office options | FlextimeSenior-level Full TimeBaltimore, United States4h ago
-
Senior Data Engineer ID75059 USD 156K-190KAWS | Amazon S3 | Apache Airflow | Apache Spark | AvroFlexible schedule | Mentorship | Personalized growth roadmaps | Remote and office options | TechtalksSenior-level Full TimeIrving, United States4h ago
-
Senior Data Engineer ID75059 USD 156K-190KAPIs | AWS | Airflow | Apache Spark | AvroEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeJersey City, United States4h ago
-
Senior Data Engineer ID75059 USD 156K-190KAPI Integration | AWS | Airflow | Avro | Big DataExciting projects | Flexible schedule | Flextime | Mentorship | Office optionsSenior-level Full TimeOrlando, United States4h ago
-
Senior Data Engineer ID75059 USD 156K-190KAPI Integration | AWS | Apache Airflow | Apache Scala | Apache SparkExciting projects | Flexible schedule | Global collaboration | Mentorship | Modern solutionsSenior-level Full TimeHouston, United States4h ago
-
Senior Data Engineer ID75059 USD 156K-190KAPI Integration | AWS | Advanced SQL | Advanced SQL optimization | AirflowEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeTallahassee, United States4h ago
-
Senior Data Engineer ID75059 USD 156K-190KAPI Integration | AWS | Airflow | Apache Spark | AvroEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionSenior-level Full TimeBlacksburg, United States4h ago
-
Senior Data Engineer ID75059 USD 156K-190KAPIs | AWS | Airflow | Apache Spark | AvroEducation budget | Exciting projects | Fitness budget | Flexible schedule | MentorshipSenior-level Full TimeDallas, United States4h ago
-
Senior Data Engineer ID75059 USD 156K-190KAPI Integration | AWS | Apache Airflow | Apache Spark | AvroEducation budget | Fitness budget | Flextime | Mentorship | Office optionsSenior-level Full TimeWest Palm Beach, United States4h ago
-
Senior Data Engineer ID75059 USD 156K-190KAWS | Apache Airflow | Apache Spark | Avro | Cloud platformFlexible schedule | Mentorship | Personalized growth roadmaps | Remote and office options | TechtalksSenior-level Full TimeAustin, United States4h ago
-
Senior Data Engineer ID75059 USD 156K-190KAWS | Airflow | Avro | Big Data | Columnar StorageFlexible schedule | Mentorship | Office options | Personalized growth roadmaps | Professional growthSenior-level Full TimeLos Angeles, United States4h ago
-
Senior Data Engineer ID75059 USD 156K-190KAWS | AWS SageMaker | Apache Airflow | Apache Spark | AvroEducation budget | Fitness budget | Flextime | Mentorship | Office work optionSenior-level Full TimePort Charlotte, United States4h ago
-
Senior Data Engineer ID75059 USD 156K-190KAWS | Amazon Web Services | Apache Airflow | Apache Spark | AvroFlexible schedule | Mentorship | Office option | Personalized growth roadmaps | Professional growthSenior-level Full TimeAtlanta, United States4h ago
-
Senior Data Engineer ID75059 USD 156K-190KAWS | Apache Airflow | Apache Spark | Avro | BigQueryEducation budget | Fitness budget | Flexible schedule | Mentorship | Office work optionsSenior-level Full TimeJacksonville, United States4h ago
-
Senior Data Engineer ID75059 USD 156K-190KAWS | Airflow | Apache Avro | Apache Jupyter | Apache ParquetFlextime | Mentorship | Office options | Personalized growth roadmaps | Remote optionsSenior-level Full TimeBoston, United States4h ago
-
Senior Data Engineer ID75059 USD 156K-190KAPIs | AWS | Airflow | Apache Kafka | Apache SparkEducation budget | Fitness budget | Flexible schedule | Mentorship | Professional growthSenior-level Full TimeChicago, United States4h ago
-
Senior Data Engineer ID75059 USD 156K-190KAWS | Airflow | Apache Spark | Avro | Columnar StorageExciting projects | Flexible schedule | Flextime | Mentorship | Personalized growth roadmapsSenior-level Full TimeNew York, United States4h ago