Senior Data Engineer | Databricks (26DE02ES)
Tasks
- Build and evolve data lake and lakehouse architectures
- Build and maintain batch and streaming data processing
- Define data engineering standards best practices design patterns
- Design data pipelines and platforms
- Ensure data quality integrity availability performance
- Evaluate emerging data technologies and best practices
- Implement data workflows with orchestration and monitoring
- Provide technical guidance and mentorship
- Support software development lifecycle source control testing CI CD deployment
Perks/Benefits
Skills/Tech-stack
AWS | Agile | Apache Spark | CI/CD | Data Governance | Data Lake | Data Lakehouse | Data Lineage | Data Privacy | Data Processing | Data Quality | Data Retention | Data Security | Databricks | Distributed data | Distributed data processing | Docker | Git | Machine Learning | PySpark | Python | SQL | Workflow Orchestration
Education
N/A
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R11d ago
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R24d ago
-
Data Engineer Pleno BRL 120K-120KAmazon Web Services | Apache Airflow | Configuration Management | DBT | DatahubRemote work | Work from BrazilMid-level Full TimeBrasil R7h ago
-
Data Engineer Sr BRL 119K-119KAmazon Web Services | Apache Airflow | DBT | Datahub | DockerRemote workSenior-level Full TimeBrasil R7h ago
-
AWS CloudTrail | AWS CloudWatch | AWS EMR | Apache Beam | Apache SparkCooptation bonuses | Disability support | Employee stock ownership | Equipment allowance | Great Place to Work certificationSenior-level Full TimeLyon, Auvergne-Rhône-Alpes, France R13h ago
-
Senior AI Engineer (m/w/d) EUR 60K-68KAI Safety | AWS | Agentic Workflows | Artificial Intelligence | CI/CDAssistance with transportation | Development budget | Employer pension contributions | Ergonomic workplace | Events and partiesMid-level Full TimeRemote / Düsseldorf R14h ago
-
Applied Gen AI Engineer EUR 70K-80KAWS | Agile | Angular | Azure | CI/CDFlexible working hours | Health insurance | Meal vouchers | Paid time off | TeleworkSenior-level Full TimeLevallois-Perret, IDF, France R15h ago
-
Mid-level Full TimeBangalore, Karnataka, India R15h ago
-
Apache Spark | Cluster management | Data Engineering | Data Pipelines | DatabricksCoaching and mentoring | Employee stock purchase plan | Health insurance | International mobility | Meal vouchersMid-level Full TimeLyon, Auvergne-Rhône-Alpes, France R17h ago
-
Azure | Azure Data | Azure Data Factory | Azure Synapse | Azure Synapse AnalyticsHealth insurance | Meal vouchers | Mentoring | Mobility support | Sport activitiesEntry-level Full TimeLyon, Auvergne-Rhône-Alpes, France R17h ago
-
Senior Specialist - AI Strategy (Mobility) INR 3000K-5000KAgentic AI | Agile delivery | Anomaly Detection | Artificial Intelligence | Cloud ArchitectureSenior-level Full TimePune, Maharashtra, IND, 411013 R17h ago
-
AI Governance | Airflow | Alerting | Anomaly Detection | Artifact RegistryMid-level Full TimePune, Maharashtra, India R18h ago
-
AWS | Authentication | Autovacuum | Backup and Restore | Client LibrariesAnnual offsites | Coworking allowance | Employee equity | Flexible schedule | Fully remoteSenior-level Full TimeIndia R20h ago
-
Principal Data Engineer USD 129K-180KAdobe Analytics | Adobe XD | Amazon Web Services | Bitbucket | CI/CDRelocation Support N/A | Remote work permittedSenior-level Full TimeUnited States R21h ago
-
Agentic AI | Backend Engineering | Cloud Computing | Deployment | Generative AIAnnual bonus programs | Equity incentives | Health wellness and retirement benefits | Paid leave | Professional development budgetSenior-level Full TimeCanada R23h ago
-
Apache Spark | Azure | Cost Optimization | Data Governance | Data ModelingFully remote work setup | Professional growth opportunities | Supportive work cultureSenior-level Full TimeIndia R1d ago
-
AI Engineer INR 3200K-5000KAPI Integration | AWS | Airflow | Azure | CI/CDMentorship | Remote workSenior-level Full TimeBangalore or Remote, KA, IN R1d ago
-
Mid-level Full TimeNoida, India R1d ago
-
Computer Scientist 2 INR 3470K-4580KAWS | Asynchronous Event Driven | Asynchronous Event Driven Systems | Automated testing | AzureSenior-level Full TimeBangalore, India R1d ago
-
Alerting | Azure | Azure Service | Azure Service Bus | BLEFlexible schedule with mandatory availability | Freelance Or Service Agreement | Remote workMid-level Full TimeVietnam - Remote R1d ago
-
Azure | Data Drift | Data Modeling | Data Processing | Data QualityFlexible schedule | Freelance service agreement | Remote workMid-level Full TimePortugal - Remote R1d ago
-
Data Platform Engineer GBP 75K-90KApache Airflow | Apache Iceberg | BigQuery | Cloud Composer | Cloud platformCareer development opportunities | Distributed team | International environment | Remote-first work | Welcoming supportive teamSenior-level Full TimeUnited Kingdom - Remote R1d ago
-
C++ | CI/CD | GEM DBA | GPON | IEEE-1588Hybrid workSenior-level Full TimeKuala Lumpur, Federal Territory of Kuala … R1d ago
-
Cyber Security AI Engineer (Cybersecurity Platforms) PLN 237K-353KAgent Orchestration | Azure | CI/CD | Django | DockerCompany events | Discounts and perks | Employee capital plans | Fitness and wellness programs | Free parkingSenior-level Full Time(HE)Remote KRK Pawia, Poland R1d ago
-
AI/ML Technical Practice Lead CAD 131K-170KAWS Agentic AI | AWS CloudFormation | AWS ECS | AWS Fargate | AWS IAMContinuous learning culture | Professional development | Remote work | Training sessions | Travel opportunitiesSenior-level Full TimeCanada - Remote R1d ago