Senior Data Engineer (Databricks / AWS)
Tasks
- Build data ingestion pipelines
- Build data transformation pipelines
- Design lakehouse data platform
- Develop data quality frameworks
- Direct AI agents for code generation
- Implement CDC
- Implement data governance catalog
- Integrate data quality into CICD pipelines
- Integrate data sources
- Investigate legacy data quality issues
- Manage schema evolution
- Optimize Delta Lake tables
- Optimize data workflows
- Orchestrate data pipelines with Airflow
- Write Python scripts
- Write SQL queries
Perks/Benefits
- Dental coverage
- Employee referral program
- Extra holidays
- Family insurance
- Flexible hybrid working
- Free parking
- Health insurance
- Remote work option
- Social events
- Sports card sponsorship
- Training budget
Skills/Tech-stack
AWS | Amazon Kinesis | Amazon S3 | Apache Airflow | CDC | CI/CD | Data Quality | Databricks | Delta Lake | Great Expectations | Kafka | PySpark | Python | SQL | Schema evolution | Unity Catalog
Education
N/A
Roles
Related jobs
-
Senior Machine Learning Engineer PLN 267K-384KAPIs | AWS | CI/CD | Containerization | Distributed SystemsEmployee referral program | Medical care | Sport card | Subscription benefit | Wellbeing benefitsSenior-level Full TimeWarsaw, Poland7h ago
-
ARM | ASIC | Arc | Bitbucket | C#Entry-level Full TimeBengaluru, KA, India14h ago
-
Data Insights - Tech Senior Associate BRL 234K-300KApache Airflow | Business Intelligence | CRM | Classification | Data AnalysisEnglish Portuguese fluency support | Hybrid workSenior-level Full TimeSão Paulo, SP, Brazil R1d ago
-
AWS | Amazon Redshift | Data Observability | Data Quality | Data ReconciliationInternational team collaboration | Remote work LATAMSenior-level Contract Full TimeGuatemala, Guatemala (Remote) R1d ago
-
AWS | AWS Redshift | AWS Redshift Administration | Amazon Redshift | AutomationRemote workSenior-level Full TimeGuatemala, Guatemala (Remote) R1d ago
-
Agentic Systems | BGP | DNS | Distributed Systems | EnvoyBerlitz tutoring | Catered meals | Flexible learning support | Language tutoring | MentorshipSenior-level Full TimeMontreal, Quebec; Toronto, Ontario; Remote, Canada; … R1d ago
-
AI | ClickHouse | Confluence | ETL | Git401k match | Educational assistance | Federal Holidays | Health insurance | Paid time offMid-level Full TimeColumbia, Maryland1d ago
-
Data Governance | Data Modeling | Data Structures | Data pipeline | Java401k matching | Educational assistance | Federal Holidays | Healthcare coverage | Paid time offMid-level Full TimeAnnapolis Junction, Maryland1d ago
-
Software Engineer 2 - (Cloud, Analytics, Spark) USD 208K-254KAlgorithm Development | Data Querying | MapReduce | NoSQL | NumPy11 federal holidays | 24 days PTO | 401k 100 Percent Vested | Education assistance | Healthcare coverageSenior-level Full TimeAnnapolis Junction, Maryland; Annapolis Junction, Maryland1d ago
-
Software Engineer 1 - (Python, UI/UX, LLMs) USD 163K-199KAWS | Argo CD | CI/CD | Containerization | Docker401k match | Educational assistance | Federal Holidays | Health insurance | Paid time offMid-level Full TimeAnnapolis Junction, Maryland1d ago
-
Software Engineer 1 - (AI, Python, LLMs) USD 163K-199KAWS | Argo CD | CI/CD | Docker | Helm401k match | Federal Holidays | Health insurance | Paid time offMid-level Full TimeAnnapolis Junction, Maryland1d ago
-
APIs | Agent systems | Databricks Genie | Databricks Workflows | Delta LakeSenior-level Full TimeSan Jose, San Jose, CA1d ago
-
Software Engineer, Machine Learning Infrastructure USD 140K-230KAPI Development | AWS | Airflow | Alerting | CI/CD401k access | Flexible PTO | Health, dental, vision coverage | Paid mealsMid-level Full TimeSan Francisco, CA, US1d ago
-
APIs | AWS | Apache Spark | Azure | Azure Data401k matching | Dental insurance | Flexible working arrangements | Health insurance | Life insuranceSenior-level Full TimeSkokie, United States1d ago
-
Software Engineer II – GenAI Quality Engineering CAD 104K-142KAutomation frameworks | C++ | CI/CD | Cloud services | Content validationDental insurance | Disability insurance | Health insurance | Life insurance | Paid parental leaveMid-level Full TimeLocations: Vancouver, British Columbia, Canada1d ago
-
Anomaly investigation | Bitbake | Bitbucket Pipelines | C# | C++Travel up to 20 percentMid-level Full TimeHerndon, United States1d ago
-
Software Engineer II – GenAI Quality Engineering CAD 89K-123KAutomated testing | Automation frameworks | C# | C++ | CI/CDFree games | Health insurance | Hybrid work | Mental health support | Paid time offMid-level Full Time地点：Vancouver, British Columbia, Canada1d ago
-
Software Engineer II – GenAI Quality Engineering CAD 89K-123KAutomated testing | Automation frameworks | C# | C++ | CI/CDFree games | Health insurance | Hybrid work schedule | Mental health support | Paid time offMid-level Full Time地点：Vancouver, British Columbia, Canada1d ago
-
Data Engineer, PDPO - Offense & Defense USD 147K-269KApache Spark | ClickHouse | Data Modeling | Data Warehousing | Distributed SystemsEntry-level Full TimeSan Jose, California, United States1d ago
-
Senior-level Full TimeHyderabad, India1d ago
-
Senior-level Full TimeLondon, UK1d ago
-
Software Engineer Systems Machine Learning - Frameworks USD 112K-166KC# | C++ | CPU | CUDA | Compiler optimizationEntry-level Full TimeSunnyvale, CA | Bellevue, WA1d ago
-
Research Scientist, ML H/W-SW Codesign USD 177K-251KC# | C++ | Deep learning | GPU Architecture | Hardware accelerationMid-level Full TimeSunnyvale, CA1d ago
-
Robotics Verification & Validation Engineer USD 170K-230KAI Risk | AI Risk Assessment | Automated testing | Bias Mitigation | C++Senior-level Full TimeBurlingame, CA1d ago
-
Senior Software Developer, Machine Learning, Applied AI USD 174K-252KAI Agents | Agentic development | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeSunnyvale, CA, USA; Toronto, ON, Canada1d ago