Senior Data Engineer (Azure & Databricks)
Boston, MA, United States
USD 175K-247K (estimate) Senior-level Full Time
Tasks
- Architect master data management platform
- Build analytics and operational data models
- Build batch and near real time ingestion pipelines
- Create datasets for machine learning and AI applications
- Define data modeling and pipeline design standards
- Design scalable data pipelines
- Develop Databricks pipelines with Spark and Delta Lake
- Ensure scalability, reliability, and security
- Establish data governance lineage and quality
- Implement data monitoring and observability
- Implement golden record data models
- Ingest and transform enterprise data
- Optimize data processing jobs for performance and cost
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Azure | Data Architecture | Data Governance | Data Lineage | Data Management | Data Modeling | Databricks | Delta Lake | Distributed Systems | ELT | ETL | Lakehouse | Master Data | Master Data Management | Metadata Management | Python | SQL
Education
N/A
Roles
Regions
Countries
States
Cities
Related jobs
-
Apex | Azure DevOps | CI/CD | Claude Code | Data cloudSenior-level Full TimeArlington/Rosslyn, Virginia, United States2h ago
-
Acceptance Testing | Data Visualization | Data analytics | Microsoft Office | Relational databasesEntry-level Full TimeArlington/Rosslyn, Virginia, United States2h ago
-
Lead Analytics & Insights Engineer II USD 93K-162KAnalytics | Data Modeling | Data Visualization | Data integration | Investigative researchFlexible project benefits package | Mentorship | Professional development | Team collaborationSenior-level Full TimeArlington/Rosslyn, Virginia, United States2h ago
-
Cloud Computing | Data Processing | Data Storage | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeSunnyvale, CA, USA4h ago
-
C++ | Data Processing | Data Storage | Debugging | Distributed ComputingSenior-level Full TimeMountain View, CA, USA4h ago
-
Senior Software Engineer, Managed Spark, Open Source USD 174K-252KApache Hadoop | Apache Hive | Apache Spark | Data Analysis | DebuggingSenior-level Full TimeSunnyvale, CA, USA4h ago
-
C++ | Data Processing | Debugging | Embeddings | Information RetrievalMid-level Full TimeMountain View, CA, USA4h ago
-
Software Engineer III, Knowledge Catalog For AI USD 147K-211KArtificial Intelligence | BigQuery | C++ | Cloud Computing | Data CatalogSenior-level Full TimeSunnyvale, CA, USA4h ago
-
Software Engineer, Embedded Systems Security, Silicon USD 147K-211KAndroid system | Android system architecture | C# | C++ | Consumption analysisMid-level Full TimeMountain View, CA, USA; San Diego, …4h ago
-
C++ | Control Plane | Data Structures | Data Structures and Algorithms | Data analyticsHealth and wellness benefits | Paid time off | Retirement savings planSenior-level Full TimeSunnyvale, CA, USA4h ago
-
Bash | Buildkite | C++ | CI/CD | Catch2401k | Dental insurance | Equity program | Fully stocked kitchen | Green card supportSenior-level Full TimeMilpitas, CA9h ago
-
Senior Applied AI Engineer USD 190K-250KAWS | Agentic Workflows | Automated Evaluation | Data Processing | Data orchestration401k plan | Dental insurance | Disability insurance | HSA contributions | Health insuranceSenior-level Full TimeSan Francisco10h ago
-
Electrical Engineer, Robotics USD 295K-380KActuator interfaces | Bring-up | C# | C++ | Circuit designIn person work 4 days per weekSenior-level Full TimeSan Francisco12h ago
-
Senior-level Full TimeAustin, Texas14h ago
-
Principal Data Engineer USD 246K-311KApache Airflow | Apache Kafka | Backwards Compatibility | CDC | Change Data Capture401k match | Flexible work from home or in office | Health benefits | Learning and development budget | Mentorship and coachingSenior-level Full TimeUSA14h ago
-
Machine Learning Engineer USD 100K-140K3GPP | Adaptive modulation | Anomaly Detection | Beamforming | C#Background check clearance | Drug Test Clearance | Hybrid schedule | Onsite days Mondays Wednesdays ThursdaysMid-level Full TimeLos Angeles CA R15h ago
-
Principal Process Development Engineer - Data Analytics USD 164K-273KANOVA | Capability analysis | Cause analysis | Control Charts | Design of ExperimentsCareer development | Comprehensive benefits | Tuition reimbursementSenior-level Full TimeSan Diego, United States15h ago
-
Staff Machine Learning Engineer, Fulfillment Planning USD 137K-299KData Science | Deep learning | Knowledge Distillation | LLM | Machine Learning401k plan with employer matching | Basic life insurance | Commuter benefits match | Disability insurance | Family-forming assistanceSenior-level Full TimeSan Francisco, CA; Sunnyvale, CA15h ago
-
Senior Analytics Engineer, Go-To-Market Data USD 138K-225KAgent Frameworks | Airflow | Analytics engineering | DBT | Data ArchitectureHybrid work | MentorshipSenior-level Full TimeMountain View, CA, United States15h ago
-
Forward Deployed AI Engineer (Post-Sales) USD 230K-300KAWS | Azure | Compute Orchestration | Configuration Management | Data Pipelines401k company match | Daily meals and snacks | Health benefits | Learning & development stipend | Relocation assistanceMid-level Full TimeRedwood City16h ago
-
Sr. Data Governance Engineer USD 149K-205KAsset Management | CCPA | Data Asset | Data Asset Management | Data Catalog401k match | Disability insurance | Employee assistance program | Generous paid time off | Health insuranceSenior-level Full TimeUtah | Hybrid R16h ago
-
AI Engineer, Agent Platform USD 120K-220KAPI Development | Caching | DPO | Database Design | Evaluation401k matching | Commuter benefits | Dental insurance | FSA | HSASenior-level Full TimeMountain View, California, United States16h ago
-
Customer Success AI Architect USD 120K-165KAPI Integration | Artificial Intelligence | Automation | Data Governance | Data Modeling401k | Daily catered lunches | Dental insurance | Employee recognition programs | Holiday partiesSenior-level Full TimeRemote US R16h ago
-
ALCOA plus | ALCOA+ Principles | AWS | Artificial Intelligence | Azure401k employer match | Commuter benefits | Dental insurance | FSA | Health savings accountSenior-level Full TimeKing of Prussia, PA (Remote) R16h ago
-
AI Dev (Features + CHQ)_Tempe,AZ USD 56K-196KAPI Integration | AWS | Agile | Angular | Artificial Intelligence401k retirement plan | Dental benefits | Independent contractor | Medical benefits | Paid HolidaysMid-level Full TimeUnited States17h ago