Senior Data Engineer
Tasks
- Build batch and streaming ingestion pipelines
- Contribute to estimation and project planning
- Design data platforms
- Develop dimensional models
- Engineer data pipelines with Spark and SQL
- Establish engineering standards and reusable frameworks
- Implement lakehouse architectures
- Lead architecture and solution reviews
- Optimize data transformation workflows
- Recommend data governance and security best practices
Perks/Benefits
- N/A
Skills/Tech-stack
AKS | Apache Spark | Automated testing | Azure Cosmos | Azure Cosmos DB | Azure Data | Azure Data Factory | Azure Databricks | Azure Kubernetes | Azure Kubernetes Service | Azure SQL | Azure Synapse | Azure Synapse Analytics | Container registries | Cosmos DB | Data Factory | Data Governance | Data Lineage | Data Modeling | Databricks | Delta Lake | DevOps | Docker | GitHub | Kubernetes | Kubernetes Service | Medallion Architecture | Microsoft Azure | Microsoft Fabric | Monitoring | Networking | Power BI | PySpark | Python | SQL | Spark SQL | Synapse Analytics | Unity Catalog
Education
Roles
Related jobs
-
Senior Product Engineer, Machine Learning Accelerators USD 144K-209KBash | Bench testing | Board assembly | Bring-up | Cause analysisSenior-level Full TimeSunnyvale, CA, USA1h ago
-
Software Engineer, Storage Everywhere, Google Cloud USD 147K-211KBack-end | Back-end development | C++ | Cloud Platforms | Data StructuresMid-level Full TimeSunnyvale, CA, USA1h ago
-
Senior Staff Software Engineer, Torch TPU USD 262K-365KAlgorithms | C++ | Cloud Computing | Computer Vision | Data ProcessingSenior-level Full TimeSunnyvale, CA, USA1h ago
-
Senior Software Engineer, AI/ML GenAI, Google Cloud USD 174K-252KC plus plus | Computer Vision | Data Processing | Debugging | Distributed ComputingSenior-level Full TimeSunnyvale, CA, USA1h ago
-
Senior Software Engineer, AI/ML GenAI, Google Play USD 174K-252KAndroid | C++ | Computer Vision | Data Processing | Data StorageSenior-level Full TimeMountain View, CA, USA1h ago
-
Staff Software Engineer, AI/ML GenAI, Google Cloud USD 207K-300KAlgorithms | C++ | Cloud infrastructure | Computer Vision | Data ProcessingSenior-level Full TimeSunnyvale, CA, USA; San Francisco, CA, …1h ago
-
Senior Software Engineer, AI/ML, Google Workspace USD 174K-252KC++ | Data Processing | Debugging | Language Processing | ML InfrastructureSenior-level Full TimeNew York, NY, USA; Sunnyvale, CA, …1h ago
-
Senior Software Engineer, Data Cloud Memorystore USD 174K-252KC++ | Caching | Cloud Computing | Cloud Networking | Cloud platformSenior-level Full TimeKirkland, WA, USA1h ago
-
RTL Design Engineer, Machine Learning Accelerators USD 138K-198KASIC design | Code review | High Performance | High-Performance Design | Low powerMid-level Full TimeSunnyvale, CA, USA1h ago
-
C# | C++ | Data Structures | Data Structures and Algorithms | DebuggingSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA1h ago
-
Software Engineer III, AI/ML, Google Fi USD 147K-211KData Processing | Debugging | Distributed Systems | Java | Language ProcessingSenior-level Full TimeMountain View, CA, USA; San Francisco, …2h ago
-
Cloud & Data Engineer USD 83K-187KAWS | Azure | Big Data | CI/CD | Container Security401k savings plan | Disability insurance | Employee assistance program | Flexible vacation | Life insuranceEntry-level Full TimeLexington, MA, US5h ago
-
AWS Data Engineer USD 118K-178KAWS CloudFormation | AWS Data | AWS Data Migration | AWS Data Migration Service | AWS EMR401k matching | Dental insurance | Education assistance program | Health insurance | Holiday payMid-level Full TimeWheeling, IL, US6h ago
-
AI Solution Principal Systems Development Engineer USD 148K-222KCluster management | Containerization | GPU Computing | Generative AI | Hardware/Software Integration401k plan | Choice of medical coverage | Fitness reimbursement | Generous Time Off Programs | Team member discounts on Dell productsSenior-level Full TimeAustin, Texas, United States, United States13h ago
-
Lead Cloud Data Engineer USD 116K-155KAWS Glue | AWS IAM | AWS Lake Formation | Amazon Athena | Amazon AuroraDental insurance | Hybrid work | Life insurance | Medical insurance | Paid time offSenior-level Full TimeFL - Saint Petersburg - 880 …13h ago
-
AI Search | Azure AI | Azure AI Search | CI/CD | Chroma401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceSenior-level Contract Full TimeRidgefield Park, NJ, United States13h ago
-
API Security | AWS | Adversarial inputs | Agent Frameworks | Application SecurityCiti Bike membership | Flexible paid time off | Gym membership | Health and mental health services | Home office stipendSenior-level Full TimeSan Francisco, California, United States; Seattle, …13h ago
-
Applied AI ML, Senior Associate USD 171K-245KAgentic AI | Cloud services | Continuous integration | Data Analysis | Data PipelinesBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimeHouston, TX, United States15h ago
-
APIs | Artificial Intelligence | Automation | Decision support | Generative AI401k | Cafe Amenities | Fitness Center | Health insurance | Recreational facilitiesEntry-level Full TimeBroomfield, CO, United States16h ago
-
Agentic AI | Data Analysis | Data Pipelines | Financial Data | Financial Data AnalysisBackup childcare | Financial coaching | Health care coverage | Mental health support | On Site Health Wellness CentersEntry-level Full TimeJersey City, NJ, United States16h ago
-
Applied AI Engineer (AI Adoption) USD 200K-250KAI Evaluation | Agent Design | Automation | LLM APIs | Machine LearningDental insurance | Group pension scheme | Income protection | Life assurance | Paid HolidaysMid-level Full TimeNew York, Chicago, London16h ago
-
Sr. Staff Embedded AI Engineer USD 165K-200KBare Metal | C# | C++ | CMSIS NN | Code generationEmployee resource groups | Flexible work environment | Hybrid schedule | Remote work optionSenior-level Full TimeColumbia, MARYLAND, United States16h ago
-
Senior Software Engineer, Robotics USD 141K-194KAlgorithms | C++ | CI/CD | Computer Vision | Constraint SatisfactionCompany holidays | Health insurance | Learning reimbursement | Life insurance | Long-term disabilitySenior-level Full TimeTorrance, California, United States16h ago
-
Senior Data Engineer USD 157K-218KAWS Athena | AWS EMR | AWS Glue | AWS Lambda | Amazon S3Beverages | Commuter stipend | Hybrid work schedule | Lunch stipend | Relocation stipendSenior-level Full TimeDenver, Colorado, United States; San Francisco, …16h ago
-
Principal Machine Learning Engineer USD 157K-223KA/B | A/B Testing | AI Agents | Airflow | B testingSenior-level Full TimeUS TX Austin16h ago