Senior Data Engineer
USD 112K-146K Senior-level Full Time
Tasks
- Build AWS data pipelines
- Collaborate with architects and analytics teams
- Design ELT data pipelines
- Implement CI/CD pipelines with GitOps
- Implement data validation and anomaly detection
- Ingest and process vendor data files
- Integrate data for Power BI reporting
- Model dimensional data with SCD
- Optimize queries with partitioning clustering materialization
- Provision AWS infrastructure with Terraform
- Track lineage and manage metadata
- Transform data with SQL Python PySpark
- Troubleshoot data pipeline issues
Perks/Benefits
Skills/Tech-stack
AWS | AWS Glue | AWS Lambda | AWS Step Functions | Agile | Alerting | Amazon Athena | Amazon Redshift | Amazon S3 | Amazon SNS | Amazon SQS | Bitbucket | CI/CD | Data Catalog | Data Lineage | Data Quality | Dimensional Modeling | ELT | Event Driven | Event-driven architecture | Git | GitHub | GitOps | Logging | Medallion Lakehouse | Metadata Management | Monitoring | Power BI | PySpark | Python | SCD | SQL | Shell Scripting | Spark | Star Schema | Step Functions | Terraform | Unix/Linux
Education
Roles
Related jobs
-
Data Engineer (remote) USD 85K-100KApache Spark | Azure Data | Azure Data Factory | Data Factory | Data Governance401k match | Employee assistance program | Flexible schedule | Health insurance | Life insuranceMid-level Full TimeWork From Home, United States R6h ago
-
Lead Data Engineer USD 133K-174KAzure Data | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Azure Databricks PipelinesAgile team environment | Inclusive work environment | Mentoring and training opportunitiesSenior-level Full TimeColumbus, GA, United States7h ago
-
Senior AI Engineer – Azure (Enterprise AI & Secure Systems) | W2 Only (No OPT's please) | A USD 120K-304KAI Studio | API Development | Access Management | Azure AI | Azure AI StudioW2 employment onlySenior-level Full TimeChicago, IL7h ago
-
Senior Data Engineer - Full Stack USD 166K-190KAPIs | CI/CD | Command Line | Command-line Interface | DatabricksHybrid workSenior-level Full TimeNew York, New York, United States …9h ago
-
Senior Snowflake Developer USD 176K-216KAWS Lambda | AWS S3 | Amazon CloudWatch | Azure Blob | Azure Blob StorageSenior-level Full TimeChicago Heights9h ago
-
Senior-level Full TimeHuntsville, United States9h ago
-
AWS | Access Management | Amazon IAM | Amazon S3 | Amazon VPCHybrid work scheduleSenior-level Full TimeMiami, United States9h ago
-
Mid-level Full TimeArlington/Rosslyn, Virginia, United States10h ago
-
AI Models | Kubernetes | LLM Inference | Linux | Machine LearningSenior-level Full TimeSan Jose, California, United States11h ago
-
Ads Targeting Data Engineer, Ads Core USD 212K-389KAccess Control | Apache Kafka | Apache Spark | Batch Processing | Data EngineeringSenior-level Full TimeSan Jose, California, United States11h ago
-
Partner Engineering GenAI - US USD 140K-203KAPI Integration | Agent Orchestration | Artificial Intelligence | Bias Mitigation | C++Senior-level Full TimeMenlo Park, CA | Seattle, WA …11h ago
-
API Design | Agentic Workflows | C plus plus | C# | Computer VisionSenior-level Full TimeRedmond, WA11h ago
-
Mid-level Full TimeBellevue, WA11h ago
-
Machine Learning Solutions Engineer, Google Cloud USD 153K-222KApache Beam | C++ | ELT | ETL | Generative AISenior-level Full TimeChicago, IL, USA; Atlanta, GA, USA12h ago
-
Software Engineer III, AI/ML GenAI, Google Ads USD 147K-211KC++ | Data Processing | Data Storage | Debugging | Distributed ComputingSenior-level Full TimeMountain View, CA, USA12h ago
-
Software Engineer, AI/ML, Platforms and Devices USD 147K-211KAndroid | C plus plus | Data Processing | Debugging | Distributed SystemsMid-level Full TimeMountain View, CA, USA12h ago
-
Software Engineer, Agentic AI Infrastructure USD 147K-211KC++ | Compute Technologies | Data Structures | Data Structures and Algorithms | Distributed SystemsMid-level Full TimeNew York, NY, USA12h ago
-
Fullstack - Data Platform (Autonomy) USD 170K-210KAWS | Amazon RDS | Database Indexing | Database Query | Database Query OptimizationBonuses | Equity compensation | Medical/Dental/Vision insurance | Overtime pay | Paid time offSenior-level Full TimeSouth San Francisco, California, USA19h ago
-
Software Engineer - Embedded Firmware USD 125K-210KAvionics | C Programming | C++ | Debugging | Embedded LinuxHybrid work environment | Medical, dental, and vision insurance | Paid time offSenior-level Full TimeSouth San Francisco, California, USA19h ago
-
Senior-level Full TimeSouth San Francisco, California, USA19h ago
-
3D Perception Engineer - Autonomy (Droid) USD 180K-265K3D Geometry | Aerial survey | Autonomy | CNN | Camera CalibrationBonus pay | Dental insurance | Equity compensation | Medical insurance | Paid time offMid-level Full TimeSouth San Francisco, California, USA19h ago
-
Senior Software Engineer (Cloud & Data Platforms) USD 140K-165KAPI Design | AWS CloudWatch | AWS Copilot | AWS Lambda | Amazon DynamoDB401k matching | Disability insurance | Health insurance | Life insurance | Medical savings accountSenior-level Full TimePhiladelphia, PA, United States20h ago
-
Data and AI Software Engineer II USD 170K-201KAgile | Angular | Artificial Intelligence | CI/CD | Cloud technologiesBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersMid-level Full TimeJersey City, NJ, United States21h ago
-
Senior Applied AI Engineer USD 182K-207KAPIs | Causal Inference | Data Pipelines | Data Storage | Distributed SystemsOnsite workSenior-level Full TimeSan Francisco HQ22h ago
-
Machine Learning Engineer (Active Secret Clearance) USD 175K-205KAgile | Algorithms | Asynchronous programming | CI/CD | Data Structures401k plan | FSA | HSA | Medical/Dental/Vision insurance | Paid disability insuranceMid-level Full TimeSchofield Barracks, Hawaii, United States22h ago