Data Engineer (Databricks)
Tasks
- Aggregate process and analyze data from diverse sources
- Collaborate with data science on machine learning projects
- Design scalable data processing pipelines for streaming and batch processing
- Develop CI/CD and MLOps processes
- Develop data pipelines with Apache Airflow
- Develop data transformations using Databricks and dbt
- Translate business requirements into technical solutions and optimize performance and quality
Perks/Benefits
- Career growth
- Eye care
- Flexible work arrangements
- Integration budget
- Knowledge sharing
- Medical benefits
- Paid time off
- Psychotherapy coaching
- Remote work
- Sponsorship for training and conferences
- Sports package
- Team building events
- Wellbeing support
- Work equipment provided
Skills/Tech-stack
Apache Airflow | Apache Spark | Azure | CI/CD | DBT | Dagster | Data Governance | Data Management | Data Modeling | Data Quality | Databricks | Delta Live Tables | Delta Live) | Dimensional Modeling | MLOps | Power BI | PySpark | Python
Education
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R3d ago
-
Staff Engineer, AJO,RTCDP INR 2520K-3880KAPI Integration | Adobe Campaign | Adobe Campaign Classic | Adobe Campaign Classic v8 | Adobe ExperienceSenior-level Full TimeRemote, India R7h ago
-
Intermediate Backend Engineer - Analytics Instrumentation INR 2000K-3370KAt-Scale | Backend Development | ClickHouse | Cloud Native | Data QualityEquity compensation | Flexible paid time off | Growth and development fund | Parental leave | Remote workMid-level Full TimeRemote, India R8h ago
-
AWS Glue | Apache Airflow | Apache Kafka | Apache Spark | BigQueryCollaborative environment | Continuous learning | Fully remote work | Professional growth opportunitiesMid-level Full TimeBrazil R9h ago
-
API Design | AWS | Amazon SageMaker | Automated retraining | CI/CDAutonomy and ownership | Continuous learning | Fully remote | High-growth environment | Professional developmentSenior-level Full TimeIndia R9h ago
-
Senior-level Full TimeUS - Remote; Canada - Remote R10h ago
-
Databricks Solution Architect INR 2000K-3000KAWS | Azure | CI/CD | CloudWatch | Data GovernanceOn-site client work | Remote work flexibilitySenior-level Full TimeIndia - Remote R15h ago
-
Senior Consultant (Databricks) INR 2000K-2800KAmazon Web Services | Apache Airflow | Apache Spark | Azure | Azure DataSenior-level Full TimeIndia - Remote R15h ago
-
Apache Spark | Azure | Azure Data | Azure Data Factory | CI/CDDental insurance | Employee assistance program | Flexible work hours | Gympass | Life insuranceMid-level Full TimeSão Paulo, BR R20h ago
-
Senior Software Engineer Remote/Travel- Active Secret -Top Secret clearance(SCI-eligibility) USD 145K-204KAPI Testing | Cypher | Data Processing | DataOps | DevOpsCompetitive benefits | Growth opportunity | Remote work | TravelSenior-level Full TimeReston, VA, United States R22h ago
-
AI Engineer - FDE (Forward Deployed Engineer) GBP 80K-110KAWS | Apache Spark | Azure | Cloud platform | Data EngineeringConference presentations | Remote work | Travel opportunitiesSenior-level Full TimeRemote - United Kingdom R23h ago
-
Senior-level Full TimeTel Aviv/ Hybrid (Israel), Israel R1d ago
-
Airflow | Amazon SageMaker | Apache Beam | Argo Workflows | Attention MechanismSenior-level Full TimeTel Aviv/ Hybrid (Israel), Israel R1d ago
-
Senior-level Full TimeTel Aviv/ Hybrid (Israel), Israel R1d ago
-
Mid-level Full TimeTel Aviv/ Hybrid (Israel), Israel R1d ago
-
Azure | Azure Data | Azure Data Explorer | Azure Event | Azure Event HubsMid-level Full TimeTel Aviv/ Hybrid (Israel), Israel R1d ago
-
Senior Staff Generative AI Scientist USD 185K-210KAWS | Apache Spark | Artificial Intelligence | Azure | Cloud platform401k matching | Dental insurance | Disability insurance | Health insurance | Life insuranceSenior-level Full TimeRemote, United States R1d ago
-
Senior-level Full TimeUkraine - Remote R1d ago
-
Data Engineer, Platform EUR 42K-55KAmazon Web Services | Apache Spark | Databricks | Git | KubernetesAdditional paid leave | Career growth | Employee stock options | Paid volunteering opportunities | Performance bonusMid-level Full TimeRemote R1d ago
-
Mid-level Full TimeIndia - Remote R1d ago
-
AI Research Engineer USD 205K-344KCryptography | Distributed Systems | Federated Learning | Fine Tuning | GoEntry-level Full TimeAnywhere R1d ago
-
Deployment Strategist - North America USD 150K-245KAI Agent | AI Agent Frameworks | API Integration | Agent Frameworks | Agent OrchestrationAnnual company offsite | Annual travel stipend | Co-working stipend | Professional development stipendMid-level Full TimeUnited States R1d ago
-
Experienced Data Engineer - Streaming Platform EUR 55K-95KAWS Kinesis | Amazon Web Services | Apache Beam | Apache Flink | Apache KafkaChild day care support | Gym membership | Lunch vouchers | Premium healthcare coverage | Relocation supportMid-level Full TimeParis R1d ago
-
Data Engineer GBP 50K-70KAmazon Web Services | Apache Flink | Apache Kafka | Apache Spark | Cloud platformBenefits package | Flexible work schedule | Remote work one day per weekMid-level Full TimeLondon R1d ago
-
AI Lead (Brazil) BRL 144K-146KAI Platform | Analytics | Data Analysis | Language Processing | Machine LearningCareer growth opportunities | Remote-first companySenior-level Full TimeRemote/Brazil R1d ago