Azure Data Engineer
Tasks
- Build CI/CD pipelines
- Build analytics-ready data layers
- Build and orchestrate data pipelines in Azure Data Factory
- Design and maintain data models
- Design cloud data solutions on Microsoft Azure
- Develop Python or PySpark transformation logic
- Develop SQL transformation logic
- Document data architecture and data lineage
- Follow security privacy and compliance requirements
- Implement data quality checks and validation rules
- Implement monitoring alerting and error handling
- Manage code and deployments using Git and Azure DevOps
Perks/Benefits
Skills/Tech-stack
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure DevOps | Azure SQL | Azure Synapse | Azure Synapse Analytics | CI/CD | Data Factory | Data Governance | Data Lake Storage Gen2 | Data Modeling | Data Quality | Databricks | Dimensional Modeling | Git | Microsoft Azure | Microsoft Purview | Performance Tuning | PySpark | Python | Query Performance Tuning | Query performance | SQL | Stored Procedures | Synapse Analytics | Window Functions
Education
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R13d ago
-
Data Engineer, gUP Engineering USD 106K-151KApache Flume | Apache Spark | Cloud Dataflow | Data Analysis | Data ModelingMid-level Full TimeBoulder, CO, USA1h ago
-
Data Engineer, GCS Data Science USD 106K-151KBig Data | C plus plus | Data Documentation | Data Modeling | Data ValidationEntry-level Full TimeNew York, NY, USA; Mountain View, …1h ago
-
Agent Engine | Agentic Development Kit | Agentic development | Cloud platform | Computer VisionSenior-level Full TimeSunnyvale, CA, USA1h ago
-
Senior Software Engineer, AI/ML GenAI, Google Cloud USD 174K-253KC++ | Computer Vision | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeSunnyvale, CA, USA1h ago
-
Senior Data Engineer USD 170K-200KApache Airflow | Apache Spark | ClickHouse | Data Contracts | Data Modeling401k | Catered lunches | Commuter benefits | Continued education benefit | Equity compensationSenior-level Full TimeNew York, New York, United States7h ago
-
Senior Data Engineer USD 170K-200KApache Airflow | Apache Spark | Data Contracts | Data Modeling | Data Quality401k | Catered lunches | Commuter benefits | Company wellness day off | Continued education benefitSenior-level Full TimeLos Angeles, California, United States7h ago
-
Senior Data Engineer USD 170K-200KApache Airflow | Apache Spark | Data Contracts | Data Modeling | Data Quality401k | Catered lunches | Commuter benefits | Continued education benefit | FSASenior-level Full TimeSan Francisco, California, United States7h ago
-
AI Engineer USD 113K-180KAngular | Apache Kafka | CI/CD | Context Management | DevOps401k matching | Charitable matching | Community outreach groups | Flexible paid time off | Life insuranceMid-level Full TimeLeawood, KS, US R8h ago
-
Applied AI Engineer USD 80K-120KAPIs | Agent Orchestration | Data Pipelines | Evaluation | FedRAMPDental insurance | Equity compensation | Health insurance | Travel benefits | Vision insuranceMid-level Full TimeSF Bay Area, CA, USA8h ago
-
Data Insights & Analytics Lead USD 120K-180KAmplitude | Blockchain Analytics | Contract analytics | Data Visualization | Dune AnalyticsCollaborative work culture | Dental insurance | Global team | Health insurance | Professional developmentSenior-level Full TimeCayman R12h ago
-
Senior Data Science Engineer USD 116K-198KApache Airflow | CI/CD | DBT | Databricks | Databricks AutoloaderFlexible work optionsSenior-level Full TimeRemote (United States) R13h ago
-
AWQ | Benchmarking | CUDA | CUDA kernels | Chunked prefill401k match | Career growth | Collaborative culture | Disability insurance | FlexibilitySenior-level Full TimePalo Alto, California, United States14h ago
-
CUDA | Checkpointing | DTensor | Data parallelism | DeepSpeed401k plan | Career growth and learning opportunities | Collaborative culture | Disability insurance | Flexibility and ownershipSenior-level Full TimePalo Alto, California, United States14h ago
-
APIs | Behavior Trees | C++ | Dashboards | Data PipelinesSenior-level Full TimeIrvine, CA14h ago
-
Machine Learning Engineer, Local Search & Marketplace USD 190K-300KA/B | A/B Testing | Apache Spark | B testing | C++Senior-level Full TimeMountain View, California, United States14h ago
-
Machine Learning Engineer, Local Search & Marketplace USD 190K-300KA/B | A/B Testing | Algorithms | B testing | C++Senior-level Full TimeMountain View, California, United States14h ago
-
AI Engineer USD 230K-315KAPI Design | Caching | Concurrent programming | Context Window Pruning | Context caching401k matching | Comprehensive medical/dental/vision coverage | Fertility benefits | Flexible PTO | Lunch CreditSenior-level Full TimeSan Francisco, CA14h ago
-
Member of Technical Staff, Applied AI Research USD 203K-299KAgentic technology | Apache Cassandra | Apache Kafka | Caching | Capacity PlanningSenior-level Full TimeSan Francisco, CA; Sunnyvale, CA14h ago
-
Senior-level Full TimeColumbia, MD15h ago
-
AI Data Engineer USD 133K-258KAWS | Agile | Apache Kafka | Apache Spark | AzureAnnual bonus eligibility | Health and wellness benefits | Hybrid work schedule | Paid time off | Retirement planSenior-level Full TimeBaltimore, Maryland, United States15h ago
-
Applied Data Solutions Program (Full-Time Opportunities) USD 107K-171KAutomation | Data Pipelines | Data Science | Forecasting | Fraud DetectionCareer development | Project based rotations | Supportive teamEntry-level Full TimeAustin; Cupertino15h ago
-
Applied Data Solutions Program (Full-Time Opportunities) USD 107K-171KAutomation | Data Engineering | Data Pipelines | Data Science | DataikuEntry-level Full TimeAustin; Cupertino15h ago
-
Senior Software Engineer, Data Enablement USD 160K-283KAWS | Apache Spark | CloudEvents | DBT | DatabricksFlexible time off | Medical insurance | Modern family planning | Remote work | Retirement savings plansSenior-level Full TimeBay Area, CA, United States of …15h ago
-
Software Engineer - Platform & Application USD 175K-315KAPI serving | AWS | Agent Frameworks | Apache Airflow | Apache FlinkCollaborative team environment | Mentorship | Production responsibilityMid-level Full TimeSanta Clara HQ15h ago