Senior Data Engineer (Databricks / AWS)
Tasks
- Build data ingestion pipelines
- Build data transformation pipelines
- Design lakehouse data platform
- Develop data quality frameworks
- Direct AI agents for code generation
- Implement CDC
- Implement data governance catalog
- Integrate data quality into CICD pipelines
- Integrate data sources
- Investigate legacy data quality issues
- Manage schema evolution
- Optimize Delta Lake tables
- Optimize data workflows
- Orchestrate data pipelines with Airflow
- Write Python scripts
- Write SQL queries
Perks/Benefits
- Dental coverage
- Employee referral program
- Extra holidays
- Family insurance
- Flexible hybrid working
- Free parking
- Health insurance
- Remote work option
- Social events
- Sports card sponsorship
- Training budget
Skills/Tech-stack
AWS | Amazon Kinesis | Amazon S3 | Apache Airflow | CDC | CI/CD | Data Quality | Databricks | Delta Lake | Great Expectations | Kafka | PySpark | Python | SQL | Schema evolution | Unity Catalog
Education
N/A
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R11d ago
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R24d ago
-
Data Engineer Pleno BRL 120K-120KAmazon Web Services | Apache Airflow | Configuration Management | DBT | DatahubRemote work | Work from BrazilMid-level Full TimeBrasil R6h ago
-
Data Engineer Sr BRL 119K-119KAmazon Web Services | Apache Airflow | DBT | Datahub | DockerRemote workSenior-level Full TimeBrasil R6h ago
-
API Development | Artificial Intelligence | Automation | BigQuery | Data ModelingSenior-level Full TimeSudeste,Brazil6h ago
-
Senior-level Full TimeOrlando, FL, United States7h ago
-
AI Requirements Engineer USD 120K-145KAWS | Acceptance criteria | Agile | Analytics | Artificial IntelligenceMid-level Full TimeArlington, VA, United States7h ago
-
Data Analytics & Engineering Opportunities USD 65K-105KBusiness Intelligence | Microstrategy | Python | R | SQL401k match | Dental insurance | Disability insurance | Firm paid holidays | Health insuranceEntry-level Full TimeWashington, DC, United States7h ago
-
API Design | Analytical Engine | Automated testing | CI/CD | Cloud platformMid-level Full TimeRamat Gan, Israel, IL9h ago
-
Artificial Intelligence | C plus plus | CUDA | Camera Calibration | Computer VisionVisa sponsorship not availableMid-level Full TimeKenner, LA, United States9h ago
-
Member of Technical Staff - AI/ML Engineer INR 2500K-4500KAnomaly Detection | BM25 | Computer Vision | Document Understanding | Entity ResolutionEquity | Professional developmentSenior-level Full TimeHyderabad, TS, IN10h ago
-
Senior Data Engineer - Azure USD 119K-258KApache Spark | Azure Data | Azure Data Factory | Azure Synapse | Azure Synapse AnalyticsSenior-level Full TimeLahore, Pakistan10h ago
-
Artificial Intelligence | Classification | Credit Scoring | Data Management | DatabricksCorporate university | Dental insurance | Fitness program | Health insurance | Life insuranceMid-level Full TimeIndaiatuba,Sao Paulo,Brazil10h ago
-
AI-Native Software Developer INR 2500K-4000K.NET | AI Evaluation | AI Orchestration Framework | AI guardrails | AI orchestrationMid-level Full TimeBangalore - Karnataka - India10h ago
-
Marketing Data Engineer - m/f/d CZK 688K-1032KApache Airflow | DBT | Data Architecture | Data Warehousing | Dimensional ModelingCafeteria benefits budget | Childcare support | Company canteen | E meal vouchers | Employee offers and discountsMid-level Full TimePrague - Prague - Czechia10h ago
-
Solutions Engineer USD 95K-130KAgile | Audit controls | Bug Fixing | Dashboards | Data LineageOnsite positionMid-level Full TimeNew Albany, OH, United States10h ago
-
DevOps Team Leader - Infra and DevEx ILS 420K-504KAI Agents | AI coding | AI coding tools | AWS EKS | AWS IAMDevelopment programs | Flexible work schedule | Hybrid work | Mental health insurance | Occasional long weekendsSenior-level Full TimeBnei Brak, Tel Aviv District, IL10h ago
-
Senior-level Full TimeSouthfield, Michigan, USA, 4807611h ago
-
Deep learning | Generative AI | Language Models | Language Processing | Large Language ModelsMid-level Full TimeAbu Dhabi, United Arab Emirates11h ago
-
Reindeer- Software Engineer (Infrastructure) USD 180K-250KAPI Integration | AWS | Authentication | Authorization | AzureSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL11h ago
-
Senior-level Full TimeIslamabad, Pakistan11h ago
-
Senior-level Full TimeMaharashtra, Pune, India11h ago
-
Mid-level Full TimeIN-AP-Hyderabad11h ago
-
Senior-level Full TimeIN-AP-Hyderabad11h ago
-
Senior-level Full TimeIN-AP-Hyderabad11h ago