Principal Engineer, AWS Athena and Glue ETL
Tasks
- Architect platform convergence
- Deliver customer price performance improvements
- Design and implement compute orchestration
- Drive compute latency optimization
- Drive operational excellence
- Improve engineering development process
- Lead cross-team technical alignment
- Mentor and develop engineers
- Optimize compute utilization
- Own platform components end-to-end
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Athena | AWS Glue | Amazon Web Services | Apache Iceberg | Apache Spark | Capacity Planning | Cold Start | Cold Start Latency | Data Lake | Distributed Systems | Hive Metastore | Latency optimization | Linux | Multi Provider Routing | Multi provider | Multi-tenant | Observability | Operational excellence | Platform Telemetry | Presto | Price Performance | Provider Routing | Resource orchestration | SQL | Scheduling | Spark SQL | Trino | VPC | VPC Networking | Web Services | Workload routing
Education
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R11d ago
-
Forward Deployed AI Engineer USD 180K-230KAPI | AWS | Azure | CI/CD | Cloud platform5-day workweek | Collaborative work culture | Flexible working hours | Supportive work environmentSenior-level Full TimeNew York, New York, United States11h ago
-
Principal AI Engineer USD 200K-245KAgent-based | Agent-based architecture | Amazon Web Services | Azure | CI/CD5 days per week | Collaborative culture | Flexible working hours | Supportive work environmentSenior-level Full TimeNew York, New York, United States11h ago
-
Sr. Embedded Software/Firmware Engineer USD 180K-240KARM | ASPICE | AUTOSAR | C# | C++Competitive compensation | Dental insurance | Flexible hours | Medical insurance | Pre-IPO stock optionsSenior-level Full TimeUnited States - Remote R12h ago
-
Data Engineer USD 112K-160KAWS | AWS S3 | Airflow | Azure | CI/CD401k match | Family leave | Medical, dental, and vision insurance | PTO | Paid HolidaysMid-level Full TimeSanta Monica, CA, United States12h ago
-
Senior Numerical Optimization Engineer USD 191K-253KAPIs | C++ | CI/CD | CPLEX | Cloud ComputingComprehensive benefits | Health insurance | Paid on-call supportSenior-level Full TimeCosta Mesa, California, United States13h ago
-
Sr. Software Engineer, AI Infrastructure USD 144K-236KApache Beam | Apache Flink | Apache Spark | C# | C++Career development | Hybrid work | Stock grantsSenior-level Full TimeSunnyvale, CA, United States13h ago
-
Senior AI Engineer, Tools & Agents USD 200K-240KAPI Design | Agent Orchestration | Knowledge Base | LLM | Multi-tenantDental insurance | Flexible PTO | Health insurance | Parental leave | Visa supportSenior-level Full TimeSan Francisco R13h ago
-
Google Cloud Platform (GCP) Data Engineer USD 100K-203KApache Beam | BigQuery | Broadcast joins | CI/CD | CachingMid-level Full TimeArlington, VA13h ago
-
Google Cloud Platform (GCP) Data Engineer USD 100K-203KApache Beam | BigQuery | CI/CD | Cloud Storage | Cloud platformSecurity clearance providedMid-level Full TimeArlington, VA13h ago
-
Senior Data Engineer USD 180K-210KAirflow | Anomaly Detection | BigQuery | CI/CD | Cloud platform401k employer match | Annual Company Holidays | Catered lunches | Company retreat | Comprehensive health coverageSenior-level Full TimeNew York City13h ago
-
Senior Software Engineer; Analytics Infrastructure USD 167K-230KAPI Design | Backend Engineering | Caching | Columnar Databases | Data ModelingBack up child care support | Employee stock purchase program ESPP | Flexible time off | Home office & equipment stipend | Learning and development stipendSenior-level Full TimeSan Francisco, CA15h ago
-
Data Solutions Engineer - HYBRID/NC RESIDENTS ONLY USD 119K-164KApache Spark | Azure | Azure Data | Azure Data Factory | Azure Data Lake401k match | Dental insurance | Employee referral program | Flexible spending account | Health insuranceEntry-level Full TimeDurham, North Carolina, United States R15h ago
-
Senior ECAD Library & Engineering Data Engineer USD 160K-225K3D Component Models | APIs | Altium 365 | Altium Designer | Altium ScriptingOnsite collaborationSenior-level Full TimeSouth San Francisco, California, USA15h ago
-
Staff Software Engineer, Data Integrations USD 210K-275KAlerting | Concurrency | Container Orchestration | DNS | DashboardsSenior-level Full TimeMountain View, CA15h ago
-
Senior Software Engineer, MLOps USD 175K-220KAgile | Batch Processing | Consistency guarantees | Data Modeling | Data Pipelines401k match | Charitable donation match | Commuter benefits | Dental insurance | Flexible time offSenior-level Full TimeRemote - United States R15h ago
-
Software Engineer (Data Engineer) USD 90K-135KAPI | AWS | Apache Airflow | Apache Spark | Azure401k plan | Employer health insurance | Employer life and disability insurance | Paid government holidays | Paid time offMid-level Full TimeHerndon, VA16h ago
-
Senior Data Engineer USD 144K-187KAWS Lambda | Amazon DynamoDB | Amazon ECS | Amazon EKS | Amazon S3401k employer contribution | Dental insurance | Flexible Remote Friendly Work Options | Health Savings Account employer contribution | Health insuranceSenior-level Full TimeAustin, Texas16h ago
-
Senior Data Engineer - Finance USD 172K-203KARR | AWS | Apache Iceberg | Apache Spark | CRMDental insurance | Employee discounts | Flexible wellness time off | Health insurance | Hybrid workSenior-level Full TimeHybrid - San Francisco, California R16h ago
-
LA Kings - Sr. Data Engineer USD 111K-135KAlerting | Apache Spark | Batch Processing | Cost Optimization | Data GovernanceSenior-level Full TimeEl Segundo, CA16h ago
-
Senior-level Full TimeRemote - United States R17h ago
-
Staff Software Engineer (Data Engineer) USD 140K-165KAWS Lake | AWS Lake Formation | Amazon Athena | Apache Airflow | Apache Flink401k match | Dental insurance | Health insurance | Life insurance | Vision insuranceSenior-level Full TimeUnited States17h ago
-
Sr. Data Engineer (HYBRID) USD 145K-160KAWS | AWS Glue | AWS Lambda | Amazon Athena | Amazon DynamoDBComplimentary club membership | Hybrid work schedule | Personal training | Pilates | Shop discountsSenior-level Full TimeNew York, NY, United States R17h ago
-
Staff Data Engineer - Data Engineering USD 207K-275KAccess Control | Apache Fluss | Apache Hudi | Apache Iceberg | Apache Paimon401k matching | Dental insurance | Disability insurance | Employee stock purchase program | Flexible PTOSenior-level Full TimeLivingston, NJ / New York, NY …17h ago
-
Claims data | Dashboarding | Data Governance | Data Modeling | Data Quality401k | Dental insurance | Long term incentive program eligibility | Medical insurance | Paid time offSenior-level Full TimeMettawa, IL, United States17h ago