Data Engineer (Python, PySpark, Snowflake, Databricks) | Cloud Data Pipelines, Automation & Compliance
Pune - Hinjewadi (Ascendas), India
INR 3000K-4000K (estimate) Senior-level Full Time
Tasks
- Automate data ingestion workflows
- Automate pipeline health monitoring
- Design data schemas
- Develop PySpark data transformations
- Implement Data Security & Compliance
- Maintain operational documentation
- Manage Databricks data pipelines
- Monitor system health and alerts
- Optimize SQL queries performance
- Perform performance tuning resource consumption
- Run root cause analysis incidents
- Support CI/CD deployments
- Support Snowflake data warehousing
- Support data migration projects
- Support infrastructure automation upgrades
- Troubleshoot data ingestion errors
- Troubleshoot transformation issues
- Validate data quality
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Access Control | Azure | Azure DevOps | Bitbucket | CI/CD | CloudFormation | CloudWatch | Data Governance | Data Lineage | Data Modeling | Data Validation | Databricks | Encryption | GCP | Git | GitHub | Grafana | Jenkins | Prometheus | PySpark | Python | SQL | Schema Design | Snowflake | Terraform
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Senior Software Engineer, Server AI Foundations, Core INR 2000K-4500KAgentic Frameworks | Agents | Agile Development | CI/CD | Cloud platformSenior-level Full TimeBengaluru, Karnataka, India3h ago
-
Assistant Manager - Cloud & AI Architect INR 2000K-3500KAI Foundry | Access Management | Active Directory | Agent Builder | Agent OrchestrationC level presentations | Client advisory | Mentoring junior resources | Professional developmentSenior-level Full TimeBangalore, Karnataka, India4h ago
-
AWS Data Engineer INR 1500K-2000KAWS | AWS Glue | Amazon Athena | Amazon EMR | Amazon S3Hybrid workMid-level Full TimeIndia4h ago
-
Senior-level Full TimePune, Maharashtra, India4h ago
-
Azure Data Engineer - Assistant Manager INR 1500K-2000KAnalysis Services | Apache Spark | Azure Analysis | Azure Analysis Services | Azure CosmosMid-level Full TimeBangalore, Karnataka, India4h ago
-
SAP Gen AI Developer ACON US Inv INR 1317K-2000KAI Core | AI Launchpad | Business Technology Platform | DevOps | DockerMid-level Full TimeBangalore, Karnataka, India4h ago
-
Snowflake Data Engineer- Consultant INR 1500K-2700KAWS Athena | AWS Data | AWS Data Pipeline | AWS Glue | AWS LambdaCorporate social responsibility programs | Maternity leave | Networking opportunities | Paternity leave | Product and service discountsMid-level Full TimeBangalore, Karnataka, India7h ago
-
AI Engineer INR 1800K-3000KAPI Integration | Azure | Azure OpenAI | Chroma | DockerFast-learning culture | Flexible locationMid-level Full TimeNavi Mumbai, Maharashtra, India7h ago
-
Genetics Data Engineer INR 1500K-2500KAWS | Azure | BGEN | Bcftools | Biobank trusted research environmentsMid-level Full TimeBangalore, Karnataka, IN, 5600377h ago
-
Azure Data Engineer_Consultant INR 1500K-2000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksMid-level Full TimeHyderabad, HYDERABAD, India7h ago
-
Java Spark Engineer INR 2000K-3500KAWS | Apache Spark | Azure | CI/CD | Cloud platformAgile team culture | Career growth opportunitiesSenior-level Full TimeIndia - Bengaluru8h ago
-
AI Engineer - Tieto Tech Consulting (m/f/d) INR 2200K-4200KAI Builder | AI Search | AI Solution | AI solution testing | Agent OrchestrationHybrid work model | Open culture | Professional growth | Work-life balanceMid-level Full TimeBangalore, India8h ago
-
Lead Consultant INR 1500K-3500KAmazon Web Services | Artifactory | Docker | GitHub | JenkinsClient site travel flexibility | Hybrid work environment | Office work requirement | Shift work 10 30 AM to 8 30 PMSenior-level Full TimeBangalore, IN, 5600668h ago
-
AWS | Agile | Apache Airflow | Apache Beam | Apache Druid401k match | Career development support | Dental insurance | Education support | Flexible work optionsEntry-level Full TimePune, India9h ago
-
Senior Data Engineer – Microsoft Fabric INR 1500K-2800KAudit Logging | Azure Data | Azure Data Factory | Data Factory | Data LakehouseSenior-level Full TimeChennai, TN, India10h ago
-
Sr Software Engineer(Java/Python , Spark and AWS) INR 3000K-4600KAWS | Apache Spark | Automated testing | CI/CD | Cause analysisCross-functional team projects | Learning Campus | Training coursesSenior-level Full TimeMumbai, India10h ago
-
Senior-level Full Timetelengana, India11h ago
-
Data Engineering and Analytics INR 1500K-2500KAPIs | Alteryx | Azure Data | Azure Data Factory | Azure Data LakeEntry-level Full TimeNoida, UP, IN, 20130112h ago
-
AI Engineer INR 2000K-5000KAWS | Azure | CI/CD | Cloud platform | DockerRelocation to Mumbai | Work from OfficeSenior-level Full TimeMumbai - Worli, Mumbai - Worli, …14h ago
-
Creative AI Engineer INR 500K-1600KAI Observability | Anthropic Claude | Asynchronous processing | Azure OpenAI | CachingSenior-level Full TimeMumbai, Maharashtra, India14h ago
-
Engineer – Marketing Data & AI INR 2200K-3000KAgile | Cloud Native | JavaScript | Microservices | Node.jsFamily-friendly benefits | Flexible career path | Flexible work hours | Hybrid work environment | Learning opportunitiesMid-level Full TimeIN-REM-002|IN-GGN-001, India14h ago
-
Senior-level Full TimeHyderabad, Telangana, India14h ago
-
Senior-level Full TimeIND - Bengaluru, India14h ago
-
AI Engineer INR 2000K-4500KAI SDK | AWS | Accelerate | Autogen | AzureDisconnect week | Flexible working hours | Health insurance | Learning budget | MacBookSenior-level Full TimeIndia - Remote R14h ago
-
Banking Product Analytics VP INR 4000K-5199KAgentic Workflow | Cloud Computing | Data Governance | Data Pipelines | Data QualityExecutive-level Full TimeGurugram, DLF Downtown, India14h ago