Senior Data Engineer | Databricks (26DE02ES)
Tasks
- Build and evolve data lake and lakehouse architectures
- Build and maintain batch and streaming data processing
- Define data engineering standards best practices design patterns
- Design data pipelines and platforms
- Ensure data quality integrity availability performance
- Evaluate emerging data technologies and best practices
- Implement data workflows with orchestration and monitoring
- Provide technical guidance and mentorship
- Support software development lifecycle source control testing CI CD deployment
Perks/Benefits
Skills/Tech-stack
AWS | Agile | Apache Spark | CI/CD | Data Governance | Data Lake | Data Lakehouse | Data Lineage | Data Privacy | Data Processing | Data Quality | Data Retention | Data Security | Databricks | Distributed data | Distributed data processing | Docker | Git | Machine Learning | PySpark | Python | SQL | Workflow Orchestration
Education
N/A
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R10d ago
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R23d ago
-
AWS | Authentication | Autovacuum | Backup and Restore | Client LibrariesAnnual offsites | Coworking allowance | Employee equity | Flexible schedule | Fully remoteSenior-level Full TimeIndia R5h ago
-
Agentic AI | Backend Engineering | Cloud Computing | Deployment | Generative AIAnnual bonus programs | Equity incentives | Health wellness and retirement benefits | Paid leave | Professional development budgetSenior-level Full TimeCanada R8h ago
-
Apache Spark | Azure | Cost Optimization | Data Governance | Data ModelingFully remote work setup | Professional growth opportunities | Supportive work cultureSenior-level Full TimeIndia R9h ago
-
AI Engineer INR 3200K-5000KAPI Integration | AWS | Airflow | Azure | CI/CDMentorship | Remote workSenior-level Full TimeBangalore or Remote, KA, IN R10h ago
-
Mid-level Full TimeNoida, India R10h ago
-
Computer Scientist 2 INR 3470K-4580KAWS | Asynchronous Event Driven | Asynchronous Event Driven Systems | Automated testing | AzureSenior-level Full TimeBangalore, India R10h ago
-
Senior AI Engineer EUR 75K-125KA/B | A/B Testing | Anthropic | B testing | Function CallingCompany provided MacBook | Flexible independent contractor agreement | Paid national holidays | Remote work environment | Unlimited PTOSenior-level Full TimeEuropean Union R15h ago
-
Agent architecture | Context Tuning | LLM orchestration | Langchain | Language ModelsCo-working space option | Paid public holidays | Paid time off | Remote work flexibilitySenior-level Full TimeSão Paulo, State of São Paulo, … R1d ago
-
AWS | Agent workflows | Auth | Azure | CI/CDAutonomy | Direct client collaboration | English practice | Flexible nearshore location | Long-term engagementSenior-level Contract Full TimeBuenos Aires, Buenos Aires, Argentina - … R1d ago
-
(Senior) AI Engineer (all genders) EUR 65K-80KCloud Computing | Containerization | DevOps | Docker | Language ModelsBike benefit | E-learning support | Family-friendly benefits | Fitness program | Flexible working hoursMid-level Full TimeBremen, Munich, Mannheim, Mainz, Berlin, Remote R1d ago
-
AI Research Engineer USD 202K-312KBlockchain | Cryptography | Decentralized networks | Distributed Systems | Federated LearningMid-level Full TimeAnywhere R1d ago
-
Staff/Lead Python Engineer (FastAPI, Orchestration) EUR 82K-112KAsynchronous programming | Cloud platform | Concurrent programming | FastAPI | GenAIAnnual learning and development budget | Co-working budget | Company laptop | Enhanced parental leave | Flexible scheduleSenior-level Full TimeRemote Anywhere R1d ago
-
Mid-level Full TimeIndia - Remote R1d ago
-
Senior AI Engineer UAH 1377K-1549KAWS | Artificial Intelligence | Cloud platform | Data Ethics | Deep learningCharity involvement | Conference participation | Learning budget | Mentorship | Paid time offSenior-level Full TimeRemote – Ukraine R1d ago
-
Machine Learning Engineer USD 139K-250KData Analysis | Deep learning | Java | Machine Learning | PyTorchSenior-level Full TimeRemote job R1d ago
-
Natural Language Processing (NLP) Engineer USD 107K-215KC plus plus | Data Analysis | Deep learning | Java | Language ProcessingMid-level Contract Full TimeRemote job R1d ago
-
Algorithm Design | Amazon Web Services | Continuous Deployment | Continuous integration | CouchbaseEquipment program | Flexible scheduling | Paid time off | Performance bonuses | Remote workMid-level Full TimeRemote job R1d ago
-
Data Engineer GBP 52K-70KAWS | Apache Flink | Apache Spark | Cloud platform | ElasticsearchHealth and wellness benefits | Opportunity for career growth | Remote work optionMid-level Full TimeLondon R1d ago
-
データエンジニア・City Data Platform Development（障がい者雇用） JPY 6000K-8500KAWS | Batch Processing | C# | C++ | Data AnalysisFlexible working hours | Google Meet interviews | Housing allowance | Loaner car support | Paid time offMid-level Full Time東京都中央区 R1d ago
-
Forward Deployed Engineer USD 153K-215KAPI Integration | AWS | Azure | Cloud Native | Cloud Native ArchitectureEquity | Health benefits | Parental leave | Travel up to 20 percentMid-level Full TimeRemote R1d ago
-
Alerting | Amazon Aurora | Amazon Aurora PostgreSQL | Amazon Redshift | Aurora PostgreSQLCollaborative cross-functional team | Opportunity for ownership and impact | Remote workSenior-level Full TimeRemote R1d ago
-
Apache Spark | Automation | Azure Data | Azure Data Services | Data GovernanceRemote workSenior-level Full TimeIndia - Remote R2d ago
-
AWS | AWS SageMaker | Data 360 | Data Federation | Data ModelingFully remote | Opportunity for Greenfield Work | Supportive collaborative cultureMid-level Full TimeCanada R2d ago