Senior Data Engineer (Databricks / AWS)
Tasks
- Build data ingestion pipelines
- Build data transformation pipelines
- Design lakehouse data platform
- Develop data quality frameworks
- Direct AI agents for code generation
- Implement CDC
- Implement data governance catalog
- Integrate data quality into CICD pipelines
- Integrate data sources
- Investigate legacy data quality issues
- Manage schema evolution
- Optimize Delta Lake tables
- Optimize data workflows
- Orchestrate data pipelines with Airflow
- Write Python scripts
- Write SQL queries
Perks/Benefits
- Dental coverage
- Employee referral program
- Extra holidays
- Family insurance
- Flexible hybrid working
- Free parking
- Health insurance
- Remote work option
- Social events
- Sports card sponsorship
- Training budget
Skills/Tech-stack
AWS | Amazon Kinesis | Amazon S3 | Apache Airflow | CDC | CI/CD | Data Quality | Databricks | Delta Lake | Great Expectations | Kafka | PySpark | Python | SQL | Schema evolution | Unity Catalog
Education
N/A
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R10d ago
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R23d ago
-
Azure | Data Governance | Data Modeling | Data Pipelines | Data QualityChildcare assistance | Coding Sessions | Continuous learning | Dental insurance | Flexible benefits cardMid-level Full TimeBrazil6h ago
-
ASIL | Admittance control | Auto Docking | BLDC | C++Mid-level Full TimeIrvine, CA7h ago
-
Product Design & HRI Engineer, Robotics Hardware USD 119K-300K3D Printing | Acoustic Performance Evaluation | Audio Systems | CAD | CESenior-level Full TimeIrvine, CA7h ago
-
AWS Glue | AWS Glue Data Catalog | Access Management | Alation | Amazon BedrockCareer growth resources | Inclusive team culture | Mentorship | Work-life balanceSenior-level Full TimeZurich, Zurich, CHE8h ago
-
Embedded Software Engineer SEK 336K-420KAgile | Automotive Communication Protocols | Automotive communication | Bash | Build systemsEntry-level Full TimeMalmö, Skåne County, Sweden13h ago
-
We're Hiring: AI/ML Engineer (LLM & NLP) USD 128K-200KAI Agents | Amazon Web Services | Azure | BERT | ChromaDBContinuous learning opportunities | Cross-functional collaboration | Professional growthMid-level Full TimeBanani, Bangladesh14h ago
-
API Integration | Data Pipelines | Evaluation | Information Retrieval | Language ModelsEquity | Fast-learning environment | Real ownership | Remote-friendlyMid-level Full TimeTel Aviv-Yafo, Tel Aviv District, Israel21h ago
-
Mid-level Full TimeBelfast, GB1d ago
-
Data Engineer GBP 52K-70KAWS | Apache Flink | Apache Spark | Cloud platform | ElasticsearchHealth and wellness benefits | Opportunity for career growth | Remote work optionMid-level Full TimeLondon R1d ago
-
Mid-level Full TimeWarsaw1d ago
-
Data Engineer EUR 72KAzure Data | Azure Data Factory | Azure Databricks | Azure Synapse | Azure Synapse AnalyticsHealth insurance discount | Home working | Home-office allowance | Laptop | Mobility budgetMid-level Full TimeAmsterdam, Noord-Holland, Nederland1d ago
-
Space Operations Engineer (Embedded Software) USD 119K-160KARM | C# | C++ | Communication Protocols | Data ProcessingMid-level Full TimeSan Francisco, CA1d ago
-
データエンジニア・City Data Platform Development(障がい者雇用) JPY 6000K-8500KAWS | Batch Processing | C# | C++ | Data AnalysisFlexible working hours | Google Meet interviews | Housing allowance | Loaner car support | Paid time offMid-level Full Time東京都中央区 R1d ago
-
Forward Deployed Engineer USD 153K-215KAPI Integration | AWS | Azure | Cloud Native | Cloud Native ArchitectureEquity | Health benefits | Parental leave | Travel up to 20 percentMid-level Full TimeRemote R1d ago
-
AI Product Engineer INR 1500K-3000KAI APIs | AI Evaluation | APIs | Cloud services | Computer VisionMid-level Full TimeKarnataka, Bengaluru, India1d ago
-
Alerting | Amazon Aurora | Amazon Aurora PostgreSQL | Amazon Redshift | Aurora PostgreSQLCollaborative cross-functional team | Opportunity for ownership and impact | Remote workSenior-level Full TimeRemote R1d ago
-
AI | Alerting | Dashboards | Data Architecture | Data Governance401k match | Dental insurance | Life insurance | Long-term disability | Medical insuranceSenior-level Full TimeNew York1d ago
-
Senior Data Engineer USD 133K-158KAKS | Azure Data | Azure Data Factory | Azure Data Lake | Azure DatabricksSenior-level Full TimeCincinnati, Ohio, United States1d ago
-
Mid-level Full TimeAtlanta, Georgia, United States; Dallas, Texas, …1d ago
-
Entry-level Full TimeChicago, Illinois, United States; Dallas, Texas, …1d ago
-
Senior-level Full TimeIN-HR-Gurgaon1d ago
-
Mid-level Full TimeIN-HR-Gurgaon1d ago
-
Classifier Modeling | Data Mining | Data Structures | Data Structures and Algorithms | Machine LearningSenior-level Full TimeSingapore1d ago