Data Engineer - Assistant Vice President
Location(s): Pune, Maharashtra, India
INR 4000K-5199K (estimate) Executive-level Full Time
Tasks
- Administer Databricks workspaces on AWS or GCP
- Build semantic layers for reporting
- Collaborate with data science to operationalize machine learning models
- Configure data storage using Delta Lake
- Deploy scalable ETL and ELT pipelines
- Design and develop data pipelines
- Establish automated CI CD pipelines
- Implement data quality, validation, and monitoring
- Lead code reviews and enforce coding standards
- Manage metadata with Unity Catalog
- Mentor data engineers
- Optimize Spark and SQL performance
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Athena | AWS EC2 | AWS EMR | AWS IAM | AWS KMS | AWS S3 | Amazon Redshift | Apache Spark | Apache Vault | Automated testing | Azure Key Vault | BigQuery | CI/CD | CTE | Compute Engine | DBT | Data Validation | Databricks | Databricks Workflows | Delta Lake | Delta Lake Z ORDER | Delta Live Tables | Delta Live) | Dimensional Modeling | ELT | ETL | GCP Compute Engine | GCP Dataproc | GCP GCS | GCP IAM | GCP compute | GitHub Actions | GitLab | Jenkins | Key Vault | Medallion Architecture | PySpark | Python | SQL | Slow-changing dimensions | Snowflake Schema | Spark SQL | Star Schema | Unity Catalog | Window Functions | Z-Order
Education
N/A
Roles
Related jobs
-
Databricks and Splunk Engineer - Senior Associate INR 3264K-4500KAmazon Web Services | Analytics | Azure | Cloud Computing | Cyber ThreatEmployee networks | Flexible work/life support | Hybrid work schedule | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeBangalore, India R4h ago
-
Senior Software Engineer INR 2771K-4064KAngular | Apache Hadoop | Apache Hive | Apache Spark | DockerSenior-level Full TimeBangalore, India5h ago
-
Senior-level Full TimeBangalore North, India11h ago
-
Senior-level Full TimeBangalore North, India11h ago
-
Senior-level Full TimeBangalore North, India11h ago
-
Data Engineer (ETL ODI) - AMS INR 1500K-2500KAPIs | Data Governance | Data Integrator | Data Modeling | Data QualityMid-level Full TimeBangalore North, India11h ago
-
Mid-level Full TimeGurugram - Haryana - India Pune …12h ago
-
Advanced Engineer - AI/ML with Devops(GCP,AWS) INR 2500K-4200KAWS | Airflow | Amazon Web Services | Apache Spark | Artificial IntelligenceAccess to cutting-edge technologies | Collaborative work environment | Professional development | Training opportunitiesSenior-level Full TimeBangalore - Karnataka, India - Kalyani …13h ago
-
Sr AI Solutions Engineer (Generative AI & Agentic AI) INR 3242K-4062KAI Agent Builder | Agent Builder | Agent Orchestration | BigQuery | Claude APISenior-level Full TimePune, MH, India14h ago
-
Data Engineer INR 3000K-4000KAWS | Amazon Aurora | Automation | Azure | Data ManagementBike to work | Career development program | Educational assistance | Employee assistance program | Employee discountSenior-level Full TimeBengaluru, KA, India R15h ago
-
AI Development Strategy Lead INR 2500K-5000KAgent Orchestration | BI frameworks | Business Intelligence | C++ | Cloud DataSenior-level Full TimeBengaluru, Karnataka, India15h ago
-
Data and AI Engineer, Google Cloud INR 2000K-3300KAlgorithms | Architectural frameworks | Batch Processing | Cloud platform | Data PipelinesSenior-level Full TimeBengaluru, Karnataka, India; Hyderabad, Telangana, India15h ago
-
Software Engineer INR 1200K-2500KAgentic AI | Agile | Artifactory | Azure DevOps | Backend DevelopmentEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India15h ago
-
Senior-level Full TimeGurugram, Haryana, India16h ago
-
Mid-level Full TimeBengaluru, Karnataka, India16h ago
-
Principal Software Engineer INR 2475K-4800KAPI Design | Agent Orchestration | Agentic Systems | Automation | By DesignAgile environment | Feature flags | High autonomy | Inclusive culture | Mentorship and coachingSenior-level Full TimeIndia, Telangana, Hyderabad16h ago
-
FDH Support Leader INR 2500K-3500KAlerting | CI/CD | Data Contracts | Data Lineage | Data ObservabilitySenior-level Full TimePune, Maharashtra, IND, 41101316h ago
-
Associate Engineer INR 1500K-2500KAnalysis Services | Analysis Services Tabular | Azure Analysis | Azure Analysis Services | Azure Analysis Services TabularMid-level Full TimeHyderabad, IN16h ago
-
Robotics Engineer Fresher INR 300K-400KArduino | Artificial Intelligence | Automation | C plus plus | ElectronicsCareer growth opportunities | Exposure to robotics competitions | Hands on experience with robotics and AI | Opportunity to mentor students globallyEntry-level Full TimeBangalore, Karnataka, India16h ago
-
Senior Data Engineer- Managed services INR 3000K-4000KAzure Cloud | Azure Cloud Adoption | Azure Cloud adoption framework | Azure Data | Azure Data FactoryRemote work opportunitySenior-level Full TimePune, MH, India16h ago
-
Software Engineer III - Data Engineer - Java, Spark, Databricks INR 2000K-3000KAmazon Web Services | Apache Spark | Application Programming | Application Programming Interfaces | Artificial IntelligenceSenior-level Full TimeBengaluru, Karnataka, India17h ago
-
Software Engineer III - Python, PySpark, Databricks, Big Data INR 2000K-2700KAPI Design | AWS Bedrock | Airflow | Amazon Web Services | Apache IcebergSenior-level Full TimeHyderabad, Telangana, India17h ago
-
Senior Software Engineer - Data Platform INR 2516K-3380KApache Spark | C# | C++ | Data Pipelines | Distributed SystemsSenior-level Full TimeIndia, Karnataka, Bangalore; India, Telangana, Hyderabad17h ago
-
Mid-level Full TimeChennai, Tamil Nadu, India17h ago
-
Principal Software Engineer - Data Platform INR 2516K-3380KApache Spark | C# | C++ | Distributed Systems | HadoopSenior-level Full TimeIndia, Karnataka, Bangalore; India, Telangana, Hyderabad17h ago