Senior Data Engineer (Azure & Databricks)
Dallas, TX, United States
USD 175K-247K (estimate) Senior-level Full Time
Tasks
- Build batch and near real time processing pipelines
- Build data pipelines in Databricks
- Build ingestion pipelines for structured and semi structured data
- Build scalable data pipelines
- Collaborate with engineering teams for data ecosystem improvements
- Create golden records across systems
- Define data modeling and pipeline standards
- Deliver high quality datasets for AI applications
- Design scalable data systems
- Develop data models for analytics and operations
- Enable datasets for machine learning and AI
- Ensure data platform scalability reliability and security
- Implement data governance lineage and quality frameworks
- Implement master data management platform
- Implement monitoring observability and alerting
- Ingest and transform enterprise data
- Optimize large-scale data processing jobs
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Apache Spark | Azure | CRM Integration | Cloud platform | Data Architecture | Data Governance | Data Lineage | Data Management | Data Modeling | Data Processing | Data Quality | Databricks | Delta Lake | Distributed data | Distributed data processing | ELT | ERP integration | ETL | Google Cloud | Google Cloud Platform | Lakehouse Architecture | MDM | Master Data | Master Data Management | Metadata Management | Python | SQL
Education
N/A
Roles
Related jobs
-
Machine Learning Engineer II USD 75K-85KAPIs | AWS | Agentic Architectures | Algorithms | Azure401k match | Comprehensive medical coverage | Dental and vision options | Life and disability insurance | Paid vacation and holidaysMid-level Full TimeSaint Charles, MO, United States6h ago
-
Data Engineer II, DBS BI USD 132K-178KAWS | AWS Glue | AWS Lake Formation | Amazon Athena | Amazon EMRMid-level Full TimeBellevue, Washington, USA6h ago
-
Data Engineer II, DBS BI USD 132K-178KAWS Glue | AWS Lake Formation | Amazon Athena | Amazon EMR | Amazon QuickSightMid-level Full TimeBellevue, Washington, USA6h ago
-
Mid-level Full TimeChicago, Illinois, United States8h ago
-
Mid-level Full TimeDallas, TX, United States10h ago
-
Senior-level Full TimeUnited States11h ago
-
Senior Data Engineer (5307) USD 125K-180KAWS | Azure | CI/CD | Case design | Data ModelingHealth insurance | Learning and development opportunities | Paid leave | RetirementSenior-level Full TimeArlington, VA11h ago
-
Principal GenAI Data Engineer USD 182K-260KArize Phoenix | Clustering | CrewAI | Data Engineering | Data IngestionEducation reimbursement | Health plans | Parental leave | Remote work | Retirement optionsSenior-level Full TimeUSA - Update Location R11h ago
-
AI Savvy Data Analyst USD 127K-214KAnomaly Detection | Cause analysis | Data Governance | Data Management | Data ModelingAdditional day off | Competitive benefits package | ESG focused mission | Flex days | Flexible work hoursMid-level Full TimeDenver, CO, United States R12h ago
-
Principal AI/ML Engineer - AdTech USD 300K-400KAWS | Apache Kafka | Apache Spark | Artificial Intelligence | CassandraEmployee discounts | Employee equity | Medical, dental & vision coverage | Pet insurance | Unlimited PTOSenior-level Full TimeRemote - United States R12h ago
-
Principal AI/ML Engineer - AdTech USD 300K-400KAWS | Ad Exchanges | Apache Kafka | Apache Spark | CassandraEmployee discounts | Employee equity | Medical, dental & vision coverage | Pet insurance | Unlimited PTOSenior-level Full TimeNew York, New York, United States12h ago
-
Principal AI/ML Engineer - AdTech USD 300K-400KAI Agents | AWS | Ad Exchanges | Apache Spark | CassandraEmployee discounts | Employee equity | Medical, dental & vision coverage | Pet insurance | Unlimited PTOSenior-level Full TimeSan Francisco, California, United States12h ago
-
Senior Cloud Data Ops Engineer USD 140K-180KAWS Aurora | AWS RDS | Backup and Restore | Bash | BigQuery401k match | Childcare benefits | Dental insurance | Disability insurance | Health insuranceSenior-level Full TimeQuincy, MA, United States13h ago
-
Lead AI Engineer USD 180K-280KAWS SageMaker | Azure ML | CI/CD | ColBERTv2 | Docker401k match | Childcare benefits | Dental insurance | Disability coverage | Health insuranceSenior-level Full TimeQuincy, MA, United States13h ago
-
AI Engineer USD 128K-170KAgent systems | Agentic Architectures | Amazon Web Services | Azure | DatabricksMid-level Full TimeLATAM (Remote), US (Remote) R13h ago
-
AI Solutions Specialist USD 128K-200KAI Search | Artificial Intelligence | Azure AI | Azure AI Search | Azure OpenAIHybrid work | Training supportMid-level Full TimeKansas City, MO, United States14h ago
-
AI Architect - Business Applications USD 138K-225KA/B | A/B Testing | Access Control | Agent Frameworks | B testingCareer growth opportunities | Hybrid work optionSenior-level Full TimeSan Francisco, CA, United States15h ago
-
Senior AI Engineer - AI & Credit Analytics USD 135K-215KAWS | CI/CD | Cloud Computing | Data Governance | Generative AIRemote workSenior-level Full Time,, ,, United States R15h ago
-
Senior Applied Scientist USD 136K-165KAudio Processing | C++ | Cloud Computing | Continuous Deployment | Dialog Systems401k retirement plan | Dental insurance | Diversity and inclusion programs | Employee referral bonus | Employee resource groupsSenior-level Full TimeSeattle, WA15h ago
-
Data Engineer USD 86K-176KApache Iceberg | Apache Kafka | Apache Spark | Batch Processing | ClickHouseSenior-level Full TimeArlington, VA15h ago
-
Data Engineer USD 116K-243KAI Ready | AI-Ready Data | AI-ready data pipelines | ClickHouse | CybersecurityCertifications | Hands-on experience | Industry trainingSenior-level Full TimeArlington, VA15h ago
-
Senior AI Engineer USD 175K-220KAI orchestration | API Development | AWS | AWS GenAI | Artificial IntelligenceRemote work | TravelSenior-level Full TimeUnited States15h ago
-
Agentic AI | Anomaly Detection | Data Preprocessing | Distributed Computing | Feature Engineering401k | Flexible PTO | Ground floor equity | Health/Dental/Vision | Home office stipendSenior-level Full TimeNew York15h ago
-
Airflow | Amazon Redshift | BigQuery | CI/CD | ClusteringRelocation support | Visa transfer supportSenior-level Full TimeNew York15h ago
-
Azure Data Engineer (Telecommunications) USD 135K-165KApache Spark | Azure | CI/CD | DBT | Data QualitySenior-level ContractFrisco, United States16h ago