Senior Data Engineer (Azure & Databricks)
Boston, MA, United States
USD 175K-247K (estimate) Senior-level Full Time
Tasks
- Architect master data management platform
- Build analytics and operational data models
- Build batch and near real time ingestion pipelines
- Create datasets for machine learning and AI applications
- Define data modeling and pipeline design standards
- Design scalable data pipelines
- Develop Databricks pipelines with Spark and Delta Lake
- Ensure scalability, reliability, and security
- Establish data governance lineage and quality
- Implement data monitoring and observability
- Implement golden record data models
- Ingest and transform enterprise data
- Optimize data processing jobs for performance and cost
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Azure | Data Architecture | Data Governance | Data Lineage | Data Management | Data Modeling | Databricks | Delta Lake | Distributed Systems | ELT | ETL | Lakehouse | Master Data | Master Data Management | Metadata Management | Python | SQL
Education
N/A
Roles
Regions
Countries
States
Cities
Related jobs
-
ETL Developer - US Healthcare Experience USD 90K-130KAWS Glue | Apache Spark | Azure Data | Azure Data Factory | Azure SQLMid-level Full TimeChantilly, United States3h ago
-
Apex | Azure DevOps | CI/CD | Claude Code | Data cloudSenior-level Full TimeArlington/Rosslyn, Virginia, United States3h ago
-
Palantir AI and Data Science Engineer USD 102K-155KAnalytics | Analytics product development | Cloud Computing | Data Architecture | Data EngineeringMentorship | Professional development | Travel opportunitiesEntry-level Full TimeHuntsville, Alabama, United States3h ago
-
AI and Data Science Engineer (TS/SCI Poly) USD 93K-155KAPI | Advanced Analytics | Analytical products | Artificial Intelligence | CI/CDProfessional development | Travel opportunitiesMid-level Full TimeMcLean, Virginia, United States3h ago
-
Acceptance Testing | Data Visualization | Data analytics | Microsoft Office | Relational databasesEntry-level Full TimeArlington/Rosslyn, Virginia, United States3h ago
-
Lead Analytics & Insights Engineer II USD 93K-162KAnalytics | Data Modeling | Data Visualization | Data integration | Investigative researchFlexible project benefits package | Mentorship | Professional development | Team collaborationSenior-level Full TimeArlington/Rosslyn, Virginia, United States3h ago
-
Cloud Engineer - Project Delivery Specialist USD 97K-179KAWS | AWS Fault Injection Simulator | Amazon EKS | Ansible | BashLimited travel | On-call rotationMid-level Full TimeDallas, Texas, United States3h ago
-
Deep learning | GPU resource management | Language Models | Large Language Models | Machine LearningEntry-level InternshipSan Jose, California, United States3h ago
-
Asset & Wealth Management- New York- Associate, Quantitative Internal Product Specialists- 9649762 USD 191K-191KC# | Component analysis | Derivatives | Excel | Hypothesis TestingMentorship | Travel reimbursementEntry-level Full TimeNew York, NY, United States4h ago
-
Cloud Computing | Data Processing | Data Storage | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeSunnyvale, CA, USA5h ago
-
C++ | Data Processing | Data Storage | Debugging | Distributed ComputingSenior-level Full TimeMountain View, CA, USA5h ago
-
Senior Software Engineer, Managed Spark, Open Source USD 174K-252KApache Hadoop | Apache Hive | Apache Spark | Data Analysis | DebuggingSenior-level Full TimeSunnyvale, CA, USA5h ago
-
C++ | Data Processing | Debugging | Embeddings | Information RetrievalMid-level Full TimeMountain View, CA, USA5h ago
-
Software Engineer III, Knowledge Catalog For AI USD 147K-211KArtificial Intelligence | BigQuery | C++ | Cloud Computing | Data CatalogSenior-level Full TimeSunnyvale, CA, USA5h ago
-
Software Engineer, Embedded Systems Security, Silicon USD 147K-211KAndroid system | Android system architecture | C# | C++ | Consumption analysisMid-level Full TimeMountain View, CA, USA; San Diego, …5h ago
-
C++ | Control Plane | Data Structures | Data Structures and Algorithms | Data analyticsHealth and wellness benefits | Paid time off | Retirement savings planSenior-level Full TimeSunnyvale, CA, USA5h ago
-
Data and Analytics - AI Engineer II USD 100K-148KAI Foundry | AIOps | Azure | Azure AI | C#Continuous learning | Hybrid work environment | Professional growth | Supportive collaborative environmentMid-level Full TimeOmaha, NE, 68102, USA8h ago
-
Bash | Buildkite | C++ | CI/CD | Catch2401k | Dental insurance | Equity program | Fully stocked kitchen | Green card supportSenior-level Full TimeMilpitas, CA10h ago
-
Senior Applied AI Engineer USD 190K-250KAWS | Agentic Workflows | Automated Evaluation | Data Processing | Data orchestration401k plan | Dental insurance | Disability insurance | HSA contributions | Health insuranceSenior-level Full TimeSan Francisco11h ago
-
Electrical Engineer, Robotics USD 295K-380KActuator interfaces | Bring-up | C# | C++ | Circuit designIn person work 4 days per weekSenior-level Full TimeSan Francisco13h ago
-
Senior-level Full TimeAustin, Texas15h ago
-
Principal Data Engineer USD 246K-311KApache Airflow | Apache Kafka | Backwards Compatibility | CDC | Change Data Capture401k match | Flexible work from home or in office | Health benefits | Learning and development budget | Mentorship and coachingSenior-level Full TimeUSA15h ago
-
Machine Learning Engineer USD 100K-140K3GPP | Adaptive modulation | Anomaly Detection | Beamforming | C#Background check clearance | Drug Test Clearance | Hybrid schedule | Onsite days Mondays Wednesdays ThursdaysMid-level Full TimeLos Angeles CA R15h ago
-
Principal Process Development Engineer - Data Analytics USD 164K-273KANOVA | Capability analysis | Cause analysis | Control Charts | Design of ExperimentsCareer development | Comprehensive benefits | Tuition reimbursementSenior-level Full TimeSan Diego, United States16h ago
-
Manager, Data Engineer (Remote) USD 100K-174KApache Spark | Azure | CI/CD | Data Modeling | Data Quality401k matching | Backup child and elder care | Dental insurance | Health insurance | Life insuranceMid-level Full TimeRaleigh, NC, United States R16h ago