Senior Data Engineer
Tasks
- Build ETL/ELT pipelines
- Collaborate with SRE and product teams on requirements
- Design data pipelines
- Develop and maintain data workflows
- Implement and monitor data workflows
- Monitor troubleshoot and resolve data processing issues
- Optimize pipeline performance scalability reliability cost
- Recommend data infrastructure improvements
- Write and optimize SQL queries
Perks/Benefits
Skills/Tech-stack
Apache Spark | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Databricks | Azure Synapse | Big Data | Cause analysis | Data Lake Storage Gen2 | Data Modeling | Data Warehousing | ELT | ETL | Git | Integration Services | Python | Root Cause Analysis | Root cause | SAS | SQL | SQL Server | SQL Server Integration Services | SQL Server integration | Server Integration Services
Education
Bachelor of Engineering | Bachelor of Science | Bachelor of Science in Computer Science | Bachelor of Science in Data Science | Bachelor of Science in Engineering | Bachelor of Science in Information Technology
Roles
Related jobs
-
Staff Machine Learning Engineer, Embeddings USD 253K-354KA/B | A/B Testing | B testing | C++ | Cloud ComputingCaregiving support | Comprehensive healthcare benefits | Employer 401k match | Family planning support | Flexible vacationSenior-level Full TimeRemote - United States R16h ago
-
AI systems | APIs | Agent Frameworks | Architecture Design | DebuggingCompetitive equity | Relocation support | Remote work | Travel occasionallySenior-level Full TimePalo Alto, CA; Onsite R20h ago
-
Software Engineer AI/ML USD 112K-150KA/B | A/B Testing | AWS | Anomaly Detection | Artificial IntelligenceDental insurance | Employee assistance program | Health coaching program | Health insurance | Retirement benefitsMid-level Full TimeEvendale, United States R20h ago
-
AI Services | AWS Glue | AWS Lambda | AWS Step Functions | Amazon AICareer advancement | Certification opportunities | Exposure to cutting-edge technologies | Mentorship programs | Ongoing trainingMid-level Full TimeUnited States - Remote R20h ago
-
Senior Data Engineer, Knowledge & Information USD 153K-238KAWS | Alerting | Apache Airflow | Apache Spark | CI/CD401k company match | Dental insurance | Disability insurance | Flexible time off | Health insuranceSenior-level Full TimeUnited States R22h ago
-
Quantitative Engineer USD 140K-155KAI Assistant | API Design | AWS | CI/CD | Credit facility401k | Dental insurance | Fitness fund | Health insurance | Learning and development fundSenior-level Full TimeRemote - USA R23h ago
-
Senior, ML Engineer - Auto Tagger USD 177K-212KAWS | Apache Arrow | Apache Beam | Apache Spark | Cloud platform401k match | Company holiday office closures | Company-paid medical, dental & vision | Disability insurance | Flexible scheduleSenior-level Full TimeAnn Arbor, MI, Remote - US R23h ago
-
Enterprise Sales Engineer - Southern California USD 118K-157K.NET | CRM | Csharp | Go | JavaCareer pathing | Community guilds | Continuous professional development | Hybrid workplace | Inclusion talksSenior-level Full TimeCalifornia, USA, Remote R1d ago
-
Senior AI Engineer USD 160K-250KAPI Design | Agent Orchestration | Agent systems | Audit Logging | Authentication401k eligibility | Flexible work environment | Hybrid work option | Paid time off | Parental leave eligibilitySenior-level Full TimeUnited States (Remote) R1d ago
-
Senior Analytics Engineer, GTM USD 175K-244KBigQuery | ClickHouse | DBT | LLMs | PythonFlexible time off | Flexible work environment | Global gatherings | Healthcare employer contributions | Home office setupSenior-level Full TimeSan Francisco, USA (Hybrid) R1d ago
-
Senior Analytics Engineer, Product USD 175K-244KAI Automation | AI automation frameworks) | Analytics engineering | Automation frameworks | BigQueryEquity stock options | Flexible time off | Flexible work environment | Global gatherings | Healthcare employer contributionsSenior-level Full TimeSan Francisco, USA (Hybrid) R1d ago
-
Software Engineer II, Computational Platform USD 124K-154KAPIs | AWS | Cloud Networking | Data Modeling | Docker401k plan | Commuter support | Company-provided laptop | Flexible paid time off | Holiday payMid-level Full TimeRemote; Watertown, Massachusetts, United States R1d ago
-
Senior-level Full TimeRemote - United States R1d ago
-
Staff SW Engineer, Machine Learning USD 150K-180KAWS | ClearML | Computer Vision | Deep learning | Docker401k match | Dental insurance | Disability insurance | Employee assistance program | Employee stock purchase programSenior-level Full TimeRemote, USA R1d ago
-
Senior AI Engineer USD 90K-150KAWS | Agentic Workflows | Amazon Bedrock | BigQuery | Call Support401k match | Insurance | PTO | Stock option grants | Stock purchase planSenior-level Full TimeRemote - United States R1d ago
-
Senior Data Engineer IS - Remote USD 122K-208KAPI Integration | Access Control | Alerting | Bash | CDCRotational on-callSenior-level Full TimeRenton, WA, United States R1d ago
-
Senior-level Full TimeRemote - US R1d ago
-
Machine Learning Engineer USD 128K-214KAWS | Agile | Azure | Cloud platform | GitHealth insurance | Holiday pay | Learning and development | Life insurance | Long-term disabilityMid-level Full TimeUSA-Remote Work R1d ago
-
Staff Data Engineer USD 170K-190KAWS | Amazon EMR | Amazon Kinesis | Apache Airflow | Apache SparkBusiness resource groups | Charitable donation stipend | Flexible work hours | Health insurance | Health stipendSenior-level Full TimeNew York R1d ago
-
MLOps Catastrophe & Geo-Analytics USD 77K-179KAWS | Agile | Automated testing | CI/CD | Cloud Computing401k matching | Education assistance | Flexible work options | Health insurance | Paid time offEntry-level Full TimeRemote, United States R1d ago
-
Entry-level Full TimeUnited States - Remote R1d ago
-
CI/CD | Docker | Drift Detection | Embeddings | Experiment trackingMentorship | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Machine Learning Engineer II USD 131K-184KAzure | Batch inference | Data Pipelines | Databricks | Distributed SystemsContinuous learning | Flexible ways of working | Growth mindset cultureMid-level Full TimeUSA TX Houston Hybrid, United States R1d ago
-
Backend Software Engineer (GenAI) USD 104K-180KAPI Development | AWS | Amazon Bedrock | Amazon SageMaker | CI/CDMid-level Full TimeUnited States Remote, United States R1d ago
-
AI Developer – Customer Services and Support USD 112K-214KAPI Integration | Backend Development | Embeddings | Evaluation | FreshdeskAnnual wellness days | Flexible work environment | Global collaboration | Recognition for contributions | Volunteer daysMid-level Full TimeUtah, United States R1d ago