Senior Data Engineer (Azure & Databricks)
Dallas, TX, United States
USD 175K-247K (estimate) Senior-level Full Time
Tasks
- Build batch and near real time processing pipelines
- Build data pipelines in Databricks
- Build ingestion pipelines for structured and semi structured data
- Build scalable data pipelines
- Collaborate with engineering teams for data ecosystem improvements
- Create golden records across systems
- Define data modeling and pipeline standards
- Deliver high quality datasets for AI applications
- Design scalable data systems
- Develop data models for analytics and operations
- Enable datasets for machine learning and AI
- Ensure data platform scalability reliability and security
- Implement data governance lineage and quality frameworks
- Implement master data management platform
- Implement monitoring observability and alerting
- Ingest and transform enterprise data
- Optimize large-scale data processing jobs
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Apache Spark | Azure | CRM Integration | Cloud platform | Data Architecture | Data Governance | Data Lineage | Data Management | Data Modeling | Data Processing | Data Quality | Databricks | Delta Lake | Distributed data | Distributed data processing | ELT | ERP integration | ETL | Google Cloud | Google Cloud Platform | Lakehouse Architecture | MDM | Master Data | Master Data Management | Metadata Management | Python | SQL
Education
N/A
Roles
Related jobs
-
Analytics Engineer USD 164K-229KAirflow | Apache Spark | Data Governance | Data Modeling | Data Visualization401k match | Caregiving support | Family planning support | Flexible vacation | Gender-affirming careSenior-level Full TimeRemote - United States R6h ago
-
Senior Analytics Engineer USD 190K-267KAirflow | Apache Spark | D3.js | Data Governance | Data Modeling401k employer match | Flexible vacation | Healthcare benefits | Mental health and coaching | Paid parental leaveSenior-level Full TimeRemote - United States R6h ago
-
Machine Learning Engineer II USD 75K-85KAPIs | AWS | Agentic Architectures | Algorithms | Azure401k match | Comprehensive medical coverage | Dental and vision options | Life and disability insurance | Paid vacation and holidaysMid-level Full TimeSaint Charles, MO, United States7h ago
-
Data Engineer II, DBS BI USD 132K-178KAWS | AWS Glue | AWS Lake Formation | Amazon Athena | Amazon EMRMid-level Full TimeBellevue, Washington, USA7h ago
-
Data Engineer II, DBS BI USD 132K-178KAWS Glue | AWS Lake Formation | Amazon Athena | Amazon EMR | Amazon QuickSightMid-level Full TimeBellevue, Washington, USA7h ago
-
Machine Learning Systems Engineer USD 144K-192KCUDA | GPU Kernels | Kernel Fusion | Machine Learning | Nsight401k match | Dental insurance | Health savings account | Life insurance | Medical insuranceSenior-level Full TimeRemote U.S. R7h ago
-
Machine Learning Systems Engineer USD 144K-192KCUDA | Kernel Fusion | Nsight | PyTorch | PyTorch Profiler401k match | Dental insurance | Health Accounts | Health savings account | Life insuranceSenior-level Full TimeLas Vegas, Nevada, United States R7h ago
-
Machine Learning Systems Engineer USD 144K-192KCUDA | Distributed Training | GPU Performance | GPU performance profiling | Kernel Fusion401k match | Dental insurance | Health savings account | Life insurance | Medical insuranceSenior-level Full TimePittsburgh, Pennsylvania, United States R7h ago
-
Machine Learning Systems Engineer USD 144K-192KCUDA | Distributed Training | Kernel Fusion | Nsight | PyTorch401k match | Dental insurance | Health savings account | Life insurance | Medical insuranceSenior-level Full TimeBoston, Massachusetts, United States R7h ago
-
AWS Amazon Connect Agentic AI Engineer USD 153K-227KAWS CDK | AWS Lambda | Amazon Bedrock | Amazon CloudWatch | Amazon ConnectMid-level Full TimeUnited States - Remote R8h ago
-
Staff Machine Learning Engineer - Edge AI USD 178K-319KC++ | Computer Vision | Data Pipelines | Edge Computing | Machine LearningHealth insurance | Parental leave | Professional development stipend | Remote workSenior-level Full TimeRemote - US R8h ago
-
Senior Software Engineer, Content Storage Gateway USD 198K-248KAlerting | Amazon Web Services | Cloud platform | Distributed Systems | GoEquity and benefits | In office collaboration 3 days per weekSenior-level Full TimeRedwood City, CA8h ago
-
Senior Analytics Engineer, People Data USD 166K-220KAWS Redshift | AWS S3 | Apache Airflow | Apache Iceberg | Apache SparkSenior-level Full TimeBoston, Massachusetts, United States; Costa Mesa, …9h ago
-
Mid-level Full TimeChicago, Illinois, United States9h ago
-
Machine Learning Engineer, Infrastructure USD 167K-210KAWS | Airflow | Apache Beam | Apache Spark | AzureSenior-level Full TimeMenlo Park, California, United States9h ago
-
Data Engineer USD 119K-170KAWS | Amazon Web Services | Apache Spark | Automation | Cloud ArchitectureSecurity ClearanceSenior-level Full TimeArlington, VA11h ago
-
Mid-level Full TimeDallas, TX, United States11h ago
-
Senior-level Full TimeUnited States12h ago
-
Senior Data Engineer (5307) USD 125K-180KAWS | Azure | CI/CD | Case design | Data ModelingHealth insurance | Learning and development opportunities | Paid leave | RetirementSenior-level Full TimeArlington, VA12h ago
-
Senior-level Full TimeWashington, D.C.12h ago
-
Principal GenAI Data Engineer USD 182K-260KArize Phoenix | Clustering | CrewAI | Data Engineering | Data IngestionEducation reimbursement | Health plans | Parental leave | Remote work | Retirement optionsSenior-level Full TimeUSA - Update Location R12h ago
-
AI Savvy Data Analyst USD 127K-214KAnomaly Detection | Cause analysis | Data Governance | Data Management | Data ModelingAdditional day off | Competitive benefits package | ESG focused mission | Flex days | Flexible work hoursMid-level Full TimeDenver, CO, United States R13h ago
-
Principal AI/ML Engineer - AdTech USD 300K-400KAWS | Apache Kafka | Apache Spark | Artificial Intelligence | CassandraEmployee discounts | Employee equity | Medical, dental & vision coverage | Pet insurance | Unlimited PTOSenior-level Full TimeRemote - United States R13h ago
-
Principal AI/ML Engineer - AdTech USD 300K-400KAWS | Ad Exchanges | Apache Kafka | Apache Spark | CassandraEmployee discounts | Employee equity | Medical, dental & vision coverage | Pet insurance | Unlimited PTOSenior-level Full TimeNew York, New York, United States13h ago
-
Principal AI/ML Engineer - AdTech USD 300K-400KAI Agents | AWS | Ad Exchanges | Apache Spark | CassandraEmployee discounts | Employee equity | Medical, dental & vision coverage | Pet insurance | Unlimited PTOSenior-level Full TimeSan Francisco, California, United States13h ago