IN_Senior Associate_Databricks_D&A_Advisory_Mumbai
Mumbai Shivaji Park, India
INR 2040K-3285K (estimate) Senior-level Full Time
Tasks
- Automate data workflows
- Build ETL ELT pipelines with PySpark
- Conduct code reviews and performance tuning
- Design data processing pipelines
- Develop and optimize ETL processes
- Document data solutions and configurations
- Ensure data quality and governance
- Implement data engineering best practices
- Ingest and transform data
- Optimize Spark jobs performance and cost
- Write and optimize SQL queries
Perks/Benefits
Skills/Tech-stack
APIs | Airflow | Amazon S3 | Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | DLT | Data Factory | Data Governance | Data Lake | Data Quality | Data pipeline | Databricks | Databricks Workflows | Delta Tables | ELT | ETL | Git | PySpark | SQL | Unity Catalog
Related jobs
-
Senior Data Engineer (Databricks) INR 1200K-2000KAWS Glue | AWS IAM | AWS Lambda | AWS S3 | AWS VPCSenior-level Full TimeMaharashtra, Pune, India4h ago
-
Mid-level Full TimeIndia-Bangalore5h ago
-
Manager, ML CV Ops Engineer INR 1000K-1400KAWS | Airflow | ArgoCD | Azure | CI/CDCareer growth | Mentorship | TrainingMid-level Full TimeIndia-Bangalore5h ago
-
Business Analyst - ML Engineer INR 2000K-2500KARIMA | Docker | Embeddings | Experimentation | FastAPIEntry-level Full TimeIndia-Gurugram5h ago
-
Software Engineer II - Python, Kubernetes, GenAI/ML INR 1000K-2000KAgile | Application Resiliency | CI/CD | Debugging | Development Life CycleMid-level Full TimeBengaluru, Karnataka, India5h ago
-
Mid-level Full TimeIN-KA-Bangalore5h ago
-
Senior-level Full TimeIN-TN-Chennai5h ago
-
Software Engineer III - Databricks, SQL , Python INR 2500K-3900KApache Spark | Data Lake | Data Warehouse | Databricks | ETLSenior-level Full TimeBengaluru, Karnataka, India6h ago
-
Senior Lead Software Engineer - DataBricks, SQL INR 2000K-3300KAWS | Apache Spark | Data Lake | Data Warehouse | DatabricksSenior-level Full TimeBengaluru, Karnataka, India6h ago
-
Tech Lead/Senior Tech Lead - Embedded Software Development INR 1170K-2156KARM | C# | C++ | CAN | Code AnalysisSenior-level Full TimePUNE, MAHARASHTRA, India7h ago
-
(#1316 )- Python and Machine Learning Engineer INR 1800K-2500KClustering | Deep learning | Django | Flask | GitContinuous learningMid-level Full TimeAndhra Pradesh, Visakhapatnam, India7h ago
-
Data Engineer, YouTube INR 1500K-2000KApache Flume | Apache Spark | Cloud platform | Data Analysis | Data EngineeringMid-level Full TimeBengaluru, Karnataka, India7h ago
-
Data Engineer, Cross Play Intelligence INR 1500K-2000KAutomation | C++ | Data Analysis | Data Modeling | Data PreparationMid-level Full TimeBengaluru, Karnataka, India7h ago
-
AWS Data Engineer INR 1500K-2000KAWS Glue | AWS S3 | Amazon Athena | Amazon EMR | Apache SparkHybrid workMid-level Full TimeBengaluru, Karnataka, India7h ago
-
AWS | Apache Kafka | Apache NiFi | Apache Spark | Batch ProcessingHybrid workMid-level Full TimeBengaluru, INDIA, India8h ago
-
Sr. SW Test Engineer (3-5 years of experience in Big Data Testing, Pyspark, ETL Testing, SQL) INR 1536K-2500KCI/CD | Data Quality | ETL | Hive | PySparkHybrid workSenior-level Full TimeBengaluru, INDIA, India8h ago
-
Software Engineer III – SQL, Python, Spark, AWS INR 2000K-3200KAWS Glue | Amazon S3 | Amazon Web Services | Apache Spark | Application ResiliencySenior-level Full TimeMumbai, Maharashtra, India9h ago
-
Senior Research Engineer - Applied AI/ML INR 2500K-3500KA/B | A/B Testing | AWS | Amazon SageMaker | Apache AirflowSenior-level Full TimeGurugram, India9h ago
-
Data Engineer III - Big Data, Java, Scala INR 2000K-2755KAWS | Agile | Apache Spark | Big Data | CI/CDSenior-level Full TimeBengaluru, Karnataka, India9h ago
-
Intigration & Data Governance INR 1500K-2900KAPI | Business Intelligence | Csharp | Data Cleansing | Data GovernanceSenior-level Full TimeAhmedabad, Gujarat, India10h ago
-
Software Engineer III-( Java, AWS & Pyspark ) INR 2000K-2755KAWS | AWS Glue | AWS IAM | AWS Lake Formation | AWS LambdaSenior-level Full TimeMumbai, Maharashtra, India10h ago
-
Assistant Manager-Business Analytics INR 1500K-2000KAI Agents | API Integration | BigQuery | Cloud platform | Data LakesMid-level Full TimeAhmedabad, Gujarat, India11h ago
-
Alteryx & Analytics Developer - Associate Consultant INR 900K-1200KAlteryx | DAX | Data Governance | Data Modeling | Data QualityMid-level Full TimeBangalore, Karnataka, India11h ago
-
Databricks & GCP Data Platform Architect INR 1500K-2040KAlerting | Apache Spark | Audit Logging | BigQuery | CI/CDSenior-level Full TimeHyderabad, //TS, India12h ago
-
Senior Data Platform Engineer INR 1244K-4600KCost Optimization | Data Engineering | Data Lake | Data Lifecycle Management | Data ProcessingSenior-level Full TimeChennai12h ago