Data Services Engineering - Assistant Vice Presidnet
Tasks
- Build Databricks ETL pipelines using Apache Spark
- Develop data processing frameworks for ingestion transformation and validation
- Optimize Databricks jobs clusters and workflows for performance reliability and cost
- Orchestrate scheduling and job pipelines in Databricks
- Support production stability and critical pipeline troubleshooting
- Troubleshoot Databricks job failures performance bottlenecks and pipeline issues
- Tune clusters parallelize jobs and batch processing for execution efficiency
Perks/Benefits
Skills/Tech-stack
Apache Spark | Azure | Azure DevOps | CI/CD | Cluster tuning | Data Quality | Data Validation | Databricks | Delta Lake | ETL | PySpark | SQL | Scala | Snowflake | Unity Catalog
Education
N/A
Roles
Related jobs
-
Staff - Software Engineering INR 2515K-3500KAWS | AWS Glue | AWS Lambda | Amazon Kinesis | Amazon SNSCareer growth and development | Flexible workSenior-level Full TimePune5h ago
-
Principal Engineer - Data Engineering INR 1500K-5800KApache Iceberg | Apache Spark | Change Data Capture | Cloud Architecture | Data CaptureExecutive-level Full TimeHyderabad, India6h ago
-
Staff Software Engineer (Python) INR 3000K-5000KAPIs | Alerting | Amazon Web Services | Authentication | Cloud platformCollaborative team environment | Diverse projects | Global consulting environment | Leadership development | Training sessionsSenior-level Full TimeMumbai, MH, India7h ago
-
Senior Software Engineer INR 2500K-3465KAPIs | Amazon Web Services | CI/CD | Cloud platform | Distributed SystemsEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimePune, MH, India7h ago
-
(Services) Data Engineer INR 1500K-2400KAPI Integration | Apache Spark | Azure | Azure Data | Azure Data FactorySenior-level Full TimeHyderabad8h ago
-
FinOps Engineer INR 1500K-3500KAWS | Amazon QuickSight | Amazon Redshift | Azure | Cloud billingCross-functional collaboration | Hybrid work | Mandatory office days 3 per weekSenior-level Full TimeBangalore8h ago
-
DE-Legacy Modernization-Gen AI Developer-UC-GDSF02 INR 1850K-3550K.NET | AI Foundry | API Gateway | AS400 | AWSMid-level Full TimeHyderabad, TG, IN, 50008111h ago
-
Apprentice - Data Ops Engineer INR 360K-400KNumPy | Power BI | Python | SQL | SciPyApprenticeship | MentorshipEntry-level ApprenticeshipNoida, Uttar Pradesh, India13h ago
-
Senior Data Engineer (SSIS/SSRS) INR 2000K-2500KData Modeling | Data Pipelines | Data Warehousing | Data integration | ETLSenior-level Full TimeIN KA Bengaluru, India13h ago
-
Data Test Engineer (ETL Testing) INR 1500K-2000KAzure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageCross-functional team collaboration | Hybrid work | Remote workMid-level Full TimeNCR Region, DL, IN13h ago
-
DBT/Snowflake Engineer INR 1200K-2000KAzure DevOps | CI/CD | DBT | Data Modeling | Dimensional ModelingSenior-level Full TimeBangalore, KA, IN13h ago
-
Senior-level Full TimeBangalore, KA, IN13h ago
-
Agile methodology | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeGurugram 10 C, India13h ago
-
DBT/Snowflake Engineer INR 1200K-2000KAzure DevOps | CI/CD | DBT | Data Warehousing | Dimensional ModelingSenior-level Full TimeBangalore, KA, IN13h ago
-
Archiving Squad Data Engineer-Senior INR 3000K-4000KAWS S3 | Appian | Azure Blob | Azure Blob Storage | Blob StorageSenior-level Full TimeNoida, UP, IN, 20130113h ago
-
Lead Software Engineer - Full Stack Developer and Gen AI INR 2755K-3500KAPI Integration | Agent Orchestration | Angular | Asynchronous programming | Azure DevOpsSenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India13h ago
-
A/B | A/B Testing | AWS Glue | AWS Lambda | AWS Model RegistrySenior-level Full TimeHyderabad - Phoenix Equinox Tower 2, …13h ago
-
A/B | A/B Testing | AUC-ROC | AWS Lambda | AWS S3Career growth opportunities | Flexible career development | MentorshipSenior-level Full TimeHyderabad - Phoenix Equinox Tower 2, …13h ago
-
AWS | CI/CD | Databricks | Delta Lake | Feature StoreMid-level Full TimeHyderabad - Phoenix Equinox Tower 2, …13h ago
-
A/B | A/B Testing | AUC-ROC | Amazon Web Services | B testingCareer development | Collaborative work environment | Flexible growth opportunities | MentoringSenior-level Full TimeHyderabad - Phoenix Equinox Tower 2, …13h ago
-
Machine Learning Engineer, Specialist INR 2500K-4800KAWS Glue | AWS Lambda | Amazon S3 | Amazon SageMaker | CI/CDFinancial wellness programs | Hybrid work model | Personal wellness resources | Physical wellness benefits | Wellness supportSenior-level Full TimeHyderabad, India13h ago
-
Senior Software Engineer with Python & Gen AI experience INR 2000K-2829KAWS | Agile Scrum | Azure | CI/CD | DevOpsEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India17h ago
-
Software Engineer - Infra + Data INR 2200K-3465KAWS Glue | Alerting | Amazon EKS | Apache Iceberg | Apache KafkaEntry-level Full TimeBangalore22h ago
-
Data Quality Analyst ( ETL/Data Warehouse ) INR 800K-1600KAgile | Anomaly Detection | Azure Data | Azure Data Factory | CI/CDMid-level Full TimeHome - India (HOMEIND)23h ago
-
Data Scientist III, Forecasting INR 3000K-4000KAnomaly Detection | Azure | Computer Vision | Data Engineering | Data PipelinesAccidental insurance | Casual leave | Earned Leave | Maternity leave | Medical insuranceSenior-level Full TimeRemote - India R23h ago