Lead AWS Data Engineer
Reston Town Center, United States
USD 141K-184K Senior-level Full Time
Tasks
- Act as technical lead and mentor engineers
- Analyze complex datasets for data mapping and integration
- Automate deployment using CI/CD and infrastructure-as-code
- Build monitoring and performance tuning strategies
- Build workflow orchestration with Airflow or Step Functions or Glue Workflows
- Define and implement data quality checks
- Design AWS data lake architectures
- Develop data pipelines and ETL ELT workflows
- Diagnose and resolve EMR cluster performance issues
- Gather requirements and translate into technical solutions
- Implement data ingestion transformation validation and publishing
- Optimize PySpark workloads for cost and performance
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Bedrock | AWS EMR | AWS Glue | AWS Glue Workflows | AWS Lambda | AWS S3 | AWS Step Functions | Amazon Athena | Amazon Redshift | Amazon Web Services | Apache Airflow | Apache Spark | CI/CD | Data Ingestion | Data Lake | Data Modeling | Data Quality | Data Transformation | Data Validation | Data lake governance | ELT | ETL | Generative AI | Glue Catalog | Infrastructure as Code | Lake Formation | PySpark | SQL | Step Functions | Web Services | Workflow Orchestration | “as-code”
Education
Roles
Related jobs
-
Automation Testing | CI/CD | CSS | Cypress | Feature DevelopmentMedical, dental & vision coverage | Paid time off | Parental leave | Reimbursement programs | Retirement planMid-levelRaleigh, United States R11d ago
-
Senior Developer, Data & IT - AI Solutions USD 120K-142KAI Agents | API Integration | AWS | AWS Bedrock | AWS SageMakerDental insurance | Dependent Care Account | Health insurance | Health savings account | Mental health counseling supportSenior-level Full TimeNew York, NY, United States7h ago
-
Senior Data Engineer USD 120K-142KApache Airflow | C# | Continuous integration | DBT | Data Modeling401b retirement savings program | Dental insurance | Dependent Care Account | Employer match | Flexible spending accountsSenior-level Full TimeNew York, NY, United States8h ago
-
Principal AI Engineer - Nexus Black USD 135K-160KCI/CD | Cloud Native | Cloud Native Architecture | Distributed Systems | EvaluationHybrid workSenior-level Full TimeItasca, United States9h ago
-
Distinguished Software Engineer, Data Infrastructure USD 248K-406KAI Inference | AI Training | Batch Processing | Compliance | Data InfrastructureExecutive-level Full TimeMountain View, CA, United States10h ago
-
Senior-level Full TimeMorristown, NJ, United States11h ago
-
Manager, Data Engineering USD 130K-166KAWS | Access Controls | Apache Airflow | Audit Logging | AzureCollaborative team culture | Remote work | Work-life balanceSenior-level Full TimeRemote, United States R12h ago
-
AI Search | API Development | AWS | AWS Bedrock | Azure401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceSenior-level Contract Full TimeRidgefield Park, NJ, United States12h ago
-
AWS S3 | Access Control | Active IQ | Ansible | Azure Blob Storage401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceSenior-level Contract Full TimeRidgefield Park, NJ, United States12h ago
-
Product Engineering, Full Sack Engineer USD 85K-142K.NET | .Net Core | AWS | Agile | AngularMentorship | Professional development | Travel opportunitiesNone Full TimeNew York, New York, United States16h ago
-
Content Safety | Data Modeling | Feature Engineering | Graph Databases | Information RetrievalSenior-level Full TimeSan Jose, California, United States16h ago
-
Partner Engineering GenAI - US USD 133K-203KAPIs | Artificial Intelligence | C plus plus | Claude | Cloud ComputingSenior-level Full TimeMenlo Park, CA | Seattle, WA …17h ago
-
Software Developer, Scaled Ops AI Acceleration Team USD 147K-203KAI infrastructure | Data Mining | Fine Tuning | Hack | JavaScriptSenior-level Full TimeSunnyvale, CA | Austin, TX | …17h ago
-
Automated testing | C++ | CSS | Debugging | GraphQLSenior-level Full TimeMenlo Park, CA17h ago
-
Code review | Contamination Checking | Data Generation | Data Pipelines | Data ProcessingEntry-level Full TimeMenlo Park, CA17h ago
-
Business Support Engineer USD 136K-197KCall Support | Cloud Computing | Data Analysis | Data Mining | Docker24x7 on-call rotationEntry-level Full TimeMenlo Park, CA17h ago
-
Business Support Engineer USD 159K-223KCloud Computing | Data Analysis | Data Mining | Distributed Systems | Docker24x7 on-call rotation | Cross-functional team collaboration | Global partner supportSenior-level Full TimeMenlo Park, CA17h ago
-
Senior-level Full TimeMenlo Park, CA | New York, …17h ago
-
Research Engineer, Media Data Research - MSL FAIR USD 170K-251KComputer Vision | Data Curation | Data Generation | Data Scaling Laws | Data mixingSenior-level Full TimeMenlo Park, CA17h ago
-
Technical Solutions Engineer, Cloud AI, Google Cloud USD 150K-218KAI Model Training | AI model | Apache Beam | Apache Hadoop | Apache SparkSenior-level Full TimeSunnyvale, CA, USA; Austin, TX, USA17h ago
-
Principal AI Engineer - Core Platform USD 250K-290KAWS | Agents SDK | Anomaly Detection | Automated testing | Classification401k match | Company-provided phone | Health insurance | Hybrid work | PTOSenior-level Full TimeNew York, New York, United States1d ago
-
Senior-level Full TimeDes Moines, IA, United States1d ago
-
Engineer, AI Dev Tools USD 90K-120KAPI Integration | Agent architecture | Artificial Intelligence | Containerization | Data Modeling401k | Dental insurance | Health insurance | Hybrid work | Paid HolidaysMid-level Full TimeMinnetonka, MN, US1d ago
-
AWS Glue | AWS Lambda | Amazon SQS | Apache Spark | Ataccama401k match | Dental insurance | Employee assistance program | Employee stock purchase plan | Health insuranceSenior-level Full TimeIrving - 6011 Connection, United States1d ago
-
Pr Data Steward, Scientific/CMC USD 137K-235KControlled vocabulary | Data Curation | Data Dictionary | Data Governance | Data ModelingMid-level Full TimeUS026 PA Spring House - 1400 …1d ago