Senior Data Engineer
Pune, Maharashtra, India
INR 2000K-2500K (estimate) Senior-level Full Time
Tasks
- Build batch and incremental processing
- Collaborate on data modeling
- Design data pipelines
- Develop ETL workflows
- Implement data quality validation
- Optimize Spark jobs performance
- Orchestrate Azure Data Factory pipelines
- Reconcile data between source and target systems
Perks/Benefits
- N/A
Skills/Tech-stack
Avro | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure SQL | Azure SQL Database | Azure Synapse | Azure Synapse Analytics | Data Factory | Data Lake Storage | Data Lake Storage Gen2 | Data Partitioning | Data Warehousing | ELT | ETL | ORC | Parquet | Performance Tuning | PySpark | SQL | SQL Database | Spark SQL | Synapse Analytics
Education
N/A
Roles
Related jobs
-
API Development | CI/CD | ETL | Git | OpenpyxlDistributed team | Work from homeMid-level Full TimeMaharashtra, Pune, India8h ago
-
Data Engineer (GCP) ID56375 INR 2400K-3380KAI Search | Apache Airflow | Apache Spark | CI/CD | Change Data CaptureEducation budget | Local connection | Remote work | Wellness budgetSenior-level Full TimePune City, India8h ago
-
Data Engineer (GCP) ID56375 INR 2400K-3380KApache Airflow | Apache Spark | BigQuery | CI/CD | Change Data CaptureBudget for education | Budget for wellness | Legal compliance in India | Local connection meetups | Remote workSenior-level Full TimeBangalore North, India8h ago
-
Data Engineer (GCP) ID56375 INR 2400K-3380KApache Airflow | Apache Spark | BigQuery | Bitemporal Modeling | CI/CDCompetitive compensation | Education budget | Local connection | Remote work | Wellness budgetSenior-level Full TimeMumbai, India8h ago
-
Data Engineer (MS) (Indian Citizen only) INR 3000K-4000KCI/CD | Data Quality | Data Validation | Databricks | Date normalizationCollaborative culture | Long-term project stability | Mentorship opportunities | Professional growth | Remote workSenior-level Full TimeMaharashtra, Pune, India8h ago
-
Mid-level Full TimeIN-AP-Hyderabad9h ago
-
Gen AI INR 2500K-4500KAWS | Agent systems | Airflow | Asynchronous programming | Attention MechanismsSenior-level Full TimeIN-KA-Bangalore9h ago
-
Data & AI Specialist INR 1500K-2500KAI Search | Azure AI | Azure AI Search | Azure Data | Azure Data LakeMid-level Full TimeIN-HR-Gurgaon9h ago
-
Senior-level Full TimeIN-AP-Hyderabad9h ago
-
Software Engineer - Data Engineer INR 2520K-3380KAWS | Azure | Data Governance | Data Lakes | Data ModelingSenior-level Full TimeBangalore - Karnataka, India - Kalyani …10h ago
-
Advanced Specialist, Data Governance INR 1800K-2500KApache Airflow | CI/CD | Cloud Composer | Cloud Storage | CollibraMid-level Full TimeChennai, Tamil Nadu, India10h ago
-
Advanced Specialist, Technology Data Analyst INR 1800K-3000KAccess Control | Bash | BigQuery | CI/CD | Capacity Planning24/7 on-call rotationSenior-level Full TimeChennai, Tamil Nadu, India10h ago
-
Sr. Data Engineer - AI ML INR 2475K-3800KAWS ECS | AWS Glue | AWS Lambda | AWS Neptune | AWS Step FunctionsComprehensive benefits package | Flexible work options | Hybrid work model | Life leave days | Professional development daysSenior-level Full TimePune, MH, India10h ago
-
Applied AI/ML Associate Senior - Causal ML INR 1400K-2000KA/B | A/B Testing | Apache Hive | Apache Spark | B testingMid-level Full TimeBengaluru, Karnataka, India12h ago
-
Data Engineer - Associate Director INR 1500K-2500KAgile | Apache Spark | Avro | Azure | Azure BlobCSR initiatives | Employee development programs | Networking opportunities | Parental leaveMid-level Full TimeBangalore, Karnataka, India12h ago
-
AI | API | Airflow | Azure | BitbucketEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, India13h ago
-
Applied AI/ML Senior Associate INR 2000K-2600KApache Hive | Apache Spark | Keras | Language Processing | Machine LearningSenior-level Full TimeBengaluru, Karnataka, India14h ago
-
Senior-level Full TimeBangalore, Karnataka, India14h ago
-
Mid-level Full TimeBangalore, Karnataka, India15h ago
-
Senior Engineer (AI Hub - GDC) INR 2500K-4500KAI Foundry | Amazon Web Services | Autogen | Azure AI | Azure AI FoundrySenior-level Full TimeHyderabad, Telangana, India15h ago
-
Associate Consultant INR 1500K-2000KAgile | Analysis Services | Azure Analysis | Azure Analysis Services | Azure DataMid-level Full TimeBangalore, Karnataka, India15h ago
-
Systems Integration Senior Specialist INR 2800K-4000KAirflow | Batch Processing | Change Data Capture | Clustering | DBTFlexible shift schedule | Hybrid work | Onsite work as neededSenior-level Full TimeBangalore, KA, IN15h ago
-
AI/ML Engineer INR 2500K-4500KAI Foundry | AI Search | AWS Bedrock | Agent Engine | Amazon QuickSightSenior-level Full Timetelengana, India16h ago
-
Vice President, AI / Machine Learning Software Engineer INR 2400K-6000KAPI Testing | Artifact Traceability | Automation | CI/CD | ContainerizationExecutive-level Full TimePune, MH, India17h ago
-
Vice President, AI / Machine Learning Software Engineer INR 2400K-6000KAPI Testing | Automation Testing | CI/CD | Containerization | GitHubExecutive-level Full TimePune, MH, India17h ago