Sr. Databricks Azure Data Engineer
Tasks
- Build automated test suites for data parity
- Design data solutions on Spark and Flink
- Develop Python SDKs
- Document solutions and workflows
- Enforce data governance and security practices
- Implement data quality rules
- Maintain CI/CD pipelines
- Manage Azure and Databricks resources
- Monitor and optimize data pipelines
- Participate in agile activities
- Transform and prepare data using SQL, Python, Java
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Apache Spark internals | Automated testing | Azure DevOps | Azure Security | CI/CD | Catalyst Optimizer | Data Modeling | Data Warehousing | Databricks | Dataframes | Deequ | Delta Lake | Encryption | GitHub | Great Expectations | JUnit | Logical Plans | PySpark | Pytest | Python | Spark internals
Education
N/A
Roles
Related jobs
-
Senior Data Engineer INR 2516K-3356KAWS | Athena | CI/CD | DBT | DatabricksBonus opportunities | Employee well-being programs | Paid Holidays | Paid time off | Work-life balance programsSenior-level Full TimeRemote - India R17h ago
-
Senior E Commerce Developer (Analytics tagging) INR 2400K-3380KAJAX | Agile | Agile Framework | Azure DevOps | BootstrapApparel discounts | Flexible Fridays | Paid parental leave | Remote work | Tuition reimbursementSenior-level Full TimeASIA - IND - India - … R1d ago
-
Sr Software Engineer - Data Analytics - Remote INR 3000K-4000KALM Toolkit | Apache Spark | Azure Data | Azure Data Factory | Azure DevOpsCareer development | Continuous learning | Holiday pay | Hybrid working model | Leave policySenior-level Full TimeBangalore, karnataka R1d ago
-
Machine Learning Engineer, Chakra INR 2000K-4600KBenchmarking | Conversational AI | Data Pipelines | Deep learning | DockerMid-level Full TimeHybrid in Bangalore, India R1d ago
-
Senior Data Engineer II INR 2520K-3380KAPI Development | AWS | AWS RDS | Amazon Redshift | Apache SparkFlexible working model | Health and parental leave plans | Professional development stipend | Remote work optionSenior-level Full TimeBengaluru - BLR1 R1d ago
-
Amazon Redshift | DBT | Data Architecture | Data Modeling | Data QualityFully remote work | Healthcare coverage | Home office equipment allowance | Learning and development budget | Paid parental leaveSenior-level Full TimeIndia R2d ago
-
AWS | C# | C++ | CI/CD | Cloud platformSenior-level Full TimePune - Tower 6, India R2d ago
-
Software Engineer INR 1200K-1400KAWS | Apache Flink | Apache Spark | Data Modeling | Data WarehousingHybrid work | Remote workMid-level Full TimeRemote (IND), India R2d ago
-
Automation and AI Solutions Lead INR 2520K-4000KAWS | AWS Bedrock | Agent systems | AgentCore) | Async ProgrammingEmployee incentive programs | Flexible work-life balance | Headspace app access | Hybrid work model | Mental health daysSenior-level Full TimeIndia, Bengaluru, Karnataka R2d ago
-
Senior Engineer, AI & Machine Learning INR 3000K-4500KAWS | Agent Studio | Agile | Airflow | Apache KafkaSenior-level Full TimeIndia-Hybrid R2d ago
-
Machine Learning Engineer 3 INR 2500K-3800KAgentic AI | Context engineering | Deep learning | Evaluation Frameworks | Fine TuningEntry-level Full TimeBangalore, India R2d ago
-
Machine Learning Engineer 4 INR 2500K-3800KAI Evaluation | Accuracy evaluation | Agentic AI | Context engineering | Deep learningMid-level Full TimeBangalore, India R2d ago
-
Data Engineer, Azure Databricks USD 36K-60KAWS | Azure | Data Engineering | Data Pipelines | DatabricksCollaborative work environment | Equity mission | Professional development opportunities | Remote work flexibilityMid-level Full TimeRemote - Türkiye, or Hybrid - … R3d ago
-
Sr.EM Data Engineering INR 2800K-3500KAPI Development | AWS | Automated testing | CI/CD | Data ProcessingDental insurance | Flexible time off | Medical insurance | Paid parental leave | SabbaticalSenior-level Full TimeIndia (Remote-First) R3d ago
-
AWS Data Engineer (Senior) INR 2500K-3100KAWS | Amazon Athena | Amazon EMR | Amazon Glue | Amazon RedshiftSenior-level Full TimeMumbai, MH R3d ago
-
Senior Research Machine Learning Engineer INR 1800K-2400KAWS | Bash | Classification | Data Pipelines | Data VisualizationSenior-level Full TimeBangalore, India R3d ago
-
AI/ML Engineer II INR 950K-1250KAWS | Azure | Containerization | Data Preprocessing | Deep learningMid-level Full TimeRemote, India R3d ago
-
AI/ML Engineer II INR 950K-1250KAmazon Web Services | Azure | Cloud platform | Data Preprocessing | Deep learningMid-level Full TimeRemote, India R3d ago
-
Senior-level Full TimeIndia - Hyderabad - Remote R3d ago
-
Platform Analyst III INR 2000K-2400KApache Solr | CI/CD | Cause analysis | Data Pipelines | ElasticsearchSenior-level Full TimeIndia - Hyderabad - Remote R3d ago
-
Senior-level Full TimeIndia - Bangalore - 5th floor, … R3d ago
-
Data Engineer - Technology and Operations - Analyst INR 1500K-6000KAzure | Java | NoSQL | Python | SQLComprehensive healthcare | Flexible time off | Retirement plan | Support for working parents | Tuition reimbursementExecutive-level Full TimeHA3-Gurugram - DLF Cyber City, India R3d ago
-
Principal Analytics Engineer (Power BI Development) INR 1431K-2040KAWS | Agile | Alerting | Azure | CI/CDMedical insurance | Provident fund | Remote work flexibilitySenior-level Full TimeIndia Remote R3d ago
-
Staff Machine Learning Engineer (L4) INR 3380K-4600KAWS | Apache Spark | Big Data | Deep learning | DynamoDBDonation support | Generous time off | Healthcare | Parental leave | Remote workSenior-level Full TimeRemote - India R3d ago
-
Data Engineer INR 1500K-2000KADLS | AWS | Airflow | Azure | DBTBonuses | Broadband reimbursement | Medical insurance | Paid certifications | Professional development allowanceMid-level Full TimeIndia - Remote R4d ago