Senior Data Engineer (Azure & Databricks)
Tasks
- Build Databricks Spark Delta Lake pipelines
- Build batch and near real time processing
- Create golden records across systems
- Design scalable data pipelines
- Develop data models for analytics and AI
- Enable machine learning datasets
- Implement data architecture standards
- Implement master data management
- Ingest and transform enterprise data
- Monitor observability and alerting
- Optimize data processing for performance and cost
- Set up data governance lineage and quality
Perks/Benefits
Skills/Tech-stack
AWS | Apache Spark | Azure | Data Governance | Data Lineage | Data Management | Data Modeling | Data Quality | Databricks | Delta Lake | Distributed Systems | ELT | ETL | Lakehouse | Master Data | Master Data Management | Metadata Management | Python | SQL
Education
N/A
Roles
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R25d ago
-
Mid-level Full TimeNew York, NY, United States11h ago
-
Multimodal AI Agent Algorithm Engineer USD 122K-160KAgent architecture | C++ | Deep learning | Distributed Training | Environmental simulationSenior-level Full Time圣何塞12h ago
-
Senior-level Full Time圣何塞12h ago
-
Mid-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL14h ago
-
Lead Data Engineer USD 110K-120KAmazon Redshift | Amazon Web Services | Azure | Azure Synapse | CDCSenior-level Full TimeWarsaw, IN, US16h ago
-
Business Intelligence | Dashboard Development | Data Architecture | Data Modeling | Data PipelinesSenior-level ContractLansing, United States16h ago
-
Software Infrastructure Developer (Agentic AI Focus) USD 160K-213KAWS | Agent SDK | Anthropic API | Asynchronous | AzureSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL16h ago
-
Embedded System Engineer Co-Op USD 56K-60KC# | C++ | Communication Protocols | Electronic Hardware | Electronics designDental insurance | Disability insurance | Educational assistance | Flexible spending account | Health savings accountEntry-level Full TimeNorwich, New York17h ago
-
(General Hire) Machine Learning Engineer Graduate (TikTok Recommendation) - 2027 Start USD 116K-177KAlgorithms | C++ | Computer Vision | Data Structures | Deep learningEntry-level Full TimeSan Jose, California, United States17h ago
-
(General Hire) Machine Learning Scientist Graduate (TikTok Recommendation) - 2027 Start (PhD) USD 119K-177KAlgorithms | C plus plus | C# | Data Structures | Deep learningEntry-level Full TimeSan Jose, California, United States17h ago
-
Asynchronous Scheduling | Batch Processing | CUDA | Distributed Systems | Load BalancingEntry-level Full TimeSan Jose, California, United States17h ago
-
Algorithms | C++ | Data Mining | Data Pipelines | Data StructuresEntry-level InternshipSan Jose, California, United States17h ago
-
Machine Learning Engineer Graduate (TikTok-Data-Search-Search Quality) - 2027 Start (PhD) USD 136K-205KComputer Vision | Data Mining | Distributed Systems | Evaluation | Information RetrievalEntry-level Full TimeSan Jose, California, United States17h ago
-
C++ | Computer Vision | Data Mining | Data Pipelines | DatabasesEntry-level Full TimeSan Jose, California, United States17h ago
-
Computer Vision | Data-Driven Strategies | Data-driven | Language Models | Language ProcessingEntry-level Full TimeSeattle, Washington, United States17h ago
-
Machine Learning Engineer Intern (TikTok-Data-Search-Basic Ranking) - 2027 Start (PhD) USD 136K-205KAlgorithms | Data Pipelines | Data Structures | Databases | Distributed SystemsEntry-level InternshipSan Jose, California, United States17h ago
-
Machine Learning Engineer Graduate (TikTok-Data-Search-Basic Ranking) - 2027 Start (PhD) USD 136K-205KComputer Vision | Data Mining | Distributed Systems | Information Retrieval | Language ModelsEntry-level Full TimeSan Jose, California, United States17h ago
-
Backend Development | C++ | Computer Vision | Data Mining | Data PipelinesEntry-level Full TimeSan Jose, California, United States17h ago
-
Algorithms | Backend Services | C++ | Data Mining | Data PipelinesEntry-level InternshipSan Jose, California, United States17h ago
-
Backend systems | C++ | Computer Vision | Data Mining | Data PipelinesEntry-level Full TimeSan Jose, California, United States17h ago
-
Machine Learning Engineer Intern (TikTok-Data-Search-Visual Search) - 2027 Start (PhD) USD 136K-205KData Mining | Data Pipelines | Distributed Systems | Experimentation | Information RetrievalEntry-level InternshipSan Jose, California, United States17h ago
-
Backend Development | C++ | Computer Vision | Data Mining | Data PipelinesEntry-level Full TimeSan Jose, California, United States17h ago
-
Machine Learning Engineer Graduate (TikTok-Data-Search-Visual Search) - 2027 Start (PhD) USD 136K-205KComputer Vision | Data Mining | Distributed Systems | Evaluation | Information RetrievalEntry-level Full TimeSan Jose, California, United States17h ago
-
Research Engineer Graduate (Monetization Technology - Business Integrity) - 2027 Start USD 145K-250KAgentic Systems | Computer Vision | Data Pipelines | Debugging | DeepSpeedEntry-level Full TimeSan Jose, California, United States17h ago