Lead AWS Data Engineer
Reston Town Center, United States
USD 141K-184K Senior-level Full Time
Tasks
- Act as technical lead and mentor engineers
- Analyze complex datasets for data mapping and integration
- Automate deployment using CI/CD and infrastructure-as-code
- Build monitoring and performance tuning strategies
- Build workflow orchestration with Airflow or Step Functions or Glue Workflows
- Define and implement data quality checks
- Design AWS data lake architectures
- Develop data pipelines and ETL ELT workflows
- Diagnose and resolve EMR cluster performance issues
- Gather requirements and translate into technical solutions
- Implement data ingestion transformation validation and publishing
- Optimize PySpark workloads for cost and performance
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Bedrock | AWS EMR | AWS Glue | AWS Glue Workflows | AWS Lambda | AWS S3 | AWS Step Functions | Amazon Athena | Amazon Redshift | Amazon Web Services | Apache Airflow | Apache Spark | CI/CD | Data Ingestion | Data Lake | Data Modeling | Data Quality | Data Transformation | Data Validation | Data lake governance | ELT | ETL | Generative AI | Glue Catalog | Infrastructure as Code | Lake Formation | PySpark | SQL | Step Functions | Web Services | Workflow Orchestration | “as-code”
Education
Roles
Related jobs
-
Senior Data Engineer - Knowledge Platform USD 160K-260KApache Airflow | Apache NiFi | Batch Processing | BigQuery | Cloud platformEquity compensation | Fully stocked kitchen | Open office space | Team building eventsSenior-level Full TimeUS - San Francisco7h ago
-
Software Engineer II - Abnormal Data Platform USD 149K-214KAerospike | Amazon DynamoDB | Apache Spark | Data Storage | DatabricksDistributed team collaboration | Remote work | Technical mentorshipMid-level Full TimeRemote - USA R7h ago
-
Robotics Application & Product Security Engineer USD 90K-300KAPI Security | Adversarial analysis | Application Security | Artifact signing | AuthenticationHybrid or remote optionSenior-level Full TimeIrvine, CA7h ago
-
Senior Analytics Engineer USD 87K-161KData Lakehouse | Data mesh | Databricks | Delta Lake | ETL401k | Health insurance | Hybrid work | Paid time off | Remote workSenior-level Full TimeRemote-MO, United States R10h ago
-
Data Engineer II USD 63K-114KData Processing | ETL | Real Time | Real-time Data | Real-time Data Processing401k | Flexible work schedule | Health insurance | Paid time off | Tuition reimbursementMid-level Full TimeRemote-MN, United States R10h ago
-
Data Warehouse Engineer USD 46K-60KCorepoint | Data Modeling | Data Quality | Data Validation | Data Warehousing401k match | Dental insurance | Discount programs | Employee counseling | FSAEntry-level Full TimeRemote, United States R12h ago
-
Senior Machine Learning Engineer USD 170K-237KA/B | A/B Testing | Apache Airflow | B testing | Deep learningSenior-level Full TimeUS TX Austin12h ago
-
AWS Batch | AWS EC2 | AWS IAM | AWS Lambda | AWS S3Annual bonus | Company paid benefits | Equity | Paid time offSenior-level Full TimeLos Angeles, California12h ago
-
Staff Applied AI Engineer, Enterprise GenAI USD 216K-270KAWS | Cloud platform | Data Analysis | Generative AI | Google CloudCommuter stipend | Equity compensation | Health, dental, vision insurance | Learning and development stipend | Paid time offSenior-level Full TimeSan Francisco, CA; Seattle, WA; New …12h ago
-
Principal Engineer, Data & ML Platform USD 119K-180KAPIs | Automated testing | Cloud Native | Cloud platform | Continuous DeploymentSenior-level Full TimeScottsdale, AZ13h ago
-
Principal Machine Learning Engineer USD 245K-393KCloud infrastructure | Data Science | Distributed Systems | Infrastructure as Code | ML pipelinesSenior-level Full TimeChicago, Illinois, USA R13h ago
-
Sr Sales Engineer, West USD 160K-196KAnalytics | Apache Spark | Artificial Intelligence | Dataiku | Kubernetes401k match | Dental insurance | Employer paid disability coverage | Flexible spending accounts | Medical insuranceSenior-level Full TimeUnited States, Remote R13h ago
-
Data Engineer USD 129K-178KApache Kafka | Apache Spark | Cloud Platforms | Data Compliance | Data GovernanceMid-level Full TimeUS - Remote R13h ago
-
Data Analytics Engineer USD 150K-160KAmazon Redshift | BI | DBT | Data Marts | Data ModelingEquity package | Flexible working environment | Learning and development stipend | Paid Maternity Leave | Paid paternity leaveMid-level Full TimeNew York, NY14h ago
-
Data Engineer USD 140K-160KAI workflows | DBT | JavaScript | N8n | Python401k access | Dental insurance | Health insurance | Life insurance | Paid parental leaveMid-level Full TimeNew York, NY14h ago
-
Sr. Data Engineer USD 145K-160KAPI Development | AWS | AWS Glue | AWS Lambda | Amazon AthenaComplimentary club membership | Personal training | Pilates | Shop discounts | SpaßSenior-level Full TimeNew York, NY, United States14h ago
-
Distinguished Software Engineer, Data Infrastructure USD 248K-406KAI | Batch Processing | Data Infrastructure | Data Privacy | Data ProcessingExecutive-level Full TimeMountain View, CA, United States14h ago
-
Senior Machine Learning Engineer, Operations Research USD 173K-218KCombinatorial Optimization | Deep learning | Keras | Machine Learning | Mathematical ProgrammingAnnual refresh grants | Equity grant | Flexible work policy | Remote workSenior-level Full TimeUnited States - Remote R14h ago
-
Analytics Engineer USD 125K-150KAmazon Redshift | Business Intelligence | DBT | Data Modeling | Data VisualizationCaregiver support | Company holidays | Dental insurance | Fertility benefits | Flexible PTOMid-level Full TimeRemote - USA R15h ago
-
Machine Learning Engineer USD 217K-260KAWS | Cloud platform | Dash | Database Management | Docker401k employer match | Comprehensive healthcare benefits | Family planning support | Flexible vacation | Gender-affirming careSenior-level Full TimeSan Francisco, CA15h ago
-
Machine Learning Engineer USD 260K-303KAmazon Web Services | Apache Beam | Apache Spark | Cassandra | Cloud platform401k employer match | Comprehensive healthcare benefits | Family planning support | Flexible vacation | Full-time Telecommuting OptionMid-level Full TimeNew York City, NY15h ago
-
Senior Data Engineer - Snowflake USD 165K-216KAWS | Azure | Cloud platform | Data Governance | Data IntegrityFlexible work arrangements | Onsite collaboration in Manhattan New York | Professional development opportunitiesSenior-level Full TimeNew York, New York, United States15h ago
-
Data/Analytics Engineering Co-op USD 67K-67KApache Airflow | Cloud infrastructure | Dagster | Looker | PowerBIHybrid workEntry-level Full TimeBoston or NYC16h ago
-
Data & Analytics Engineer USD 115K-150KCI/CD | CTE | Clustering | DBT | Data Lineage401k matching | Birthday time off | Cell phone reimbursement | Childcare expense reimbursement | Company-Paid HolidaysMid-level Full TimeUnited States16h ago
-
Sr. Staff Software Engineer, Data Product Platform USD 208K-429KAI coding | AI coding tools | AI-assisted analytics | Apache Airflow | Apache SupersetEquity | Flexible work modelSenior-level Full TimeSan Francisco, CA, US; Remote, US R16h ago