Senior Big Data Engineer Pyspark Databricks - Vice President
Location(s): Pune, Maharashtra, India
INR 2000K-2700K (estimate) Senior-level Full Time
Tasks
- Analyze applications for vulnerabilities
- Analyze requirements and define system enhancements
- Build and maintain data engineering platform
- Conduct security testing and debugging
- Coordinate with architects and stakeholders
- Deliver work items across initiatives
- Ensure code quality and testing standards
- Evaluate complex processes
- Identify problems analyze information and implement solutions
- Install and support customer exposure systems
- Recommend programming solutions
- Test and debug programs
Perks/Benefits
- N/A
Skills/Tech-stack
Amazon ECS | Amazon S3 | Apache Airflow | Apache Kafka | Apache Spark | Bitbucket | Data Lakehouse | Databricks | Delta Lake | HDFS | Hadoop | Kubernetes | PyArrow | PySpark | SCM | SQL | Unix
Education
N/A
Roles
Related jobs
-
Data Engineer Platform and Tools – Google Cloud Platform (GCP) INR 1500K-2500KAirflow | BigQuery | CI/CD | Cloud Build | Cloud ComposerSenior-level Full TimeHyderabad, India3h ago
-
Principal Data Engineer Data Technology INR 3000K-4000KAPIs | AWS | Apache Spark | CI/CD | Cloud platformSenior-level Full TimePune, Maharashtra, India R13h ago
-
Senior Data Scientist - AI Engineering INR 3264K-5000KAWS | AWS Bedrock | Agentic AI | Anthropic Claude | Automated RegressionCareer growth | Company-sponsored certifications | Innovation time | Mentorship | SnacksSenior-level Full TimeHyderabad, TS, India13h ago
-
Advanced Engineer - Data Engineer INR 2475K-3465KAWS | Amazon Redshift | Apache Hadoop | Apache Spark | AzureAccess to cutting-edge technologies | Collaborative work environment | Professional growth and developmentSenior-level Full TimeBangalore - Karnataka, India - Kalyani …14h ago
-
Data Engineer INR 302K-480KAgile | Apache Airflow | Cloud Composer | Cloud Storage | Cloud platformEntry-level Full TimeIN-MH-Pune14h ago
-
Senior-level Full TimeIN-TN-Chennai14h ago
-
Senior Data Management Professional – Process Automation & Data Operations, Company Financials Data , Pune INR 2800K-4000KCI/CD | Cause analysis | Data Governance | Data Monitoring | Data ObservabilityPlatinum customer supportSenior-level Full TimePune15h ago
-
Java Big Data Developer - Experienced INR 1500K-3000KApache Hadoop | Apache Kafka | Apache Spark | Design Patterns | DockerSenior-level Full TimePune, IN R15h ago
-
CDP,Snowflake,SQL,Java, API, AWS - (6-9 Yrs) - CHN INR 2000K-3000KAPI Integration | AWS | Audience Management | Customer Data | Customer Data PlatformSenior-level Full TimeIndia15h ago
-
Data Engineer ((SSIS, SQL and Azure Data Factory) INR 1000K-1700KAzure Data | Azure Data Factory | Data Factory | Databricks | ETLEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India16h ago
-
API Integration | AWS | Anomaly Detection | Azure | Data LineageSenior-level Full TimeBengaluru, Karnataka, India16h ago
-
Data Engineer INR 1500K-2500KAmazon Web Services | Data Governance | Data Modeling | Data Quality | Data ResiliencyDiversity inclusion and respectMid-level Full TimeHyderabad, Telangana, India17h ago
-
Lead - Agentic AI Engineer INR 2500K-5000KAgent Development Kit | Anomaly Detection | CI/CD | Cloud Computing | Data PreprocessingSenior-level Full TimeChennai, Tamil Nadu, India17h ago
-
Mid-level Full TimePune, Maharashtra, India R17h ago
-
Senior Software Engineer, Data Engineering INR 2000K-3000K.Net Core | ASP.NET MVC | ASP.Net Core | Agile | Automated testingSenior-level Full TimePune, Maharashtra, India17h ago
-
Java Big Data Developer - Senior INR 1200K-3000KApache Hadoop | Apache Kafka | Apache Spark | Design Patterns | DockerSenior-level Full TimePune, IN R18h ago
-
Data Engineer (.NET Specialist) INR 2400K-3465K.Net Core | ASP.NET | Angular | App Service | Azure AppSenior-level Full TimePune, MH, India18h ago
-
Bitbucket | C# | Clock | DMA | DebuggingEntry-level Full TimeBengaluru, KA, India20h ago
-
Technical Solutions Engineer INR 500K-700KAPI Integration | Agentic AI | Automation Anywhere | Excel | Incident ManagementEntry-level Full TimeHyderabad, India21h ago
-
Data Engineer - Databricks & Microsoft FabricData Engineer - Databricks & Microsoft Fabric INR 1500K-2800KAgile | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsSenior-level Full TimeChennai, IN, 60003222h ago
-
Mid-level Full TimeBengaluru, Karnataka, India22h ago
-
Lead Data Engineer INR 1500K-2700KApache Kafka | Apache Spark | Automated testing | CI/CD | Data ModelingSenior-level Full TimeBengaluru, KA, India22h ago
-
ASR | AWS | Audio Processing | Cloud platform | ContainerizationFlexible working hours | Fully remote | Mentorship | Professional growthSenior-level Full TimeIndia R23h ago
-
GenAI LLM Python/Senior Associate Director, Software Engineering INR 2000K-4000KAWS | Agent systems | Azure | Docker | Function CallingFlexible working | Professional developmentMid-level Full TimePune, MH, IN, 4110061d ago
-
Software Engineer - Data Engineering INR 1500K-2541KAWS | AWS Glue | AWS Lambda | AWS Step Functions | AgileOnsite 5 days per week | Relocation assistance | Visa sponsorshipMid-level Full TimeChennai, Tamil Nadu, India1d ago