Senior Data Engineer
Pune, Maharashtra, India
INR 1500K-2500K (estimate) Senior-level Full Time
Tasks
- Collaborate on data models conceptual logical and physical
- Design end-to-end data pipelines
- Develop data ingestion transformation and loading workflows
- Develop reusable data frameworks with logging and error handling
- Ensure data quality, validation, and reconciliation
- Implement batch and incremental processing
- Optimize Spark jobs for performance scalability and cost
Perks/Benefits
- N/A
Skills/Tech-stack
Avro | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure SQL | Azure Synapse | Azure Synapse Analytics | Data Factory | Data Lake Storage Gen2 | Data Lakes | Data Partitioning | Data Warehousing | ELT | ETL | ORC | Parquet | Performance Tuning | PySpark | SQL | Spark SQL | Synapse Analytics
Education
N/A
Roles
Related jobs
-
Entry-level InternshipHyderabad, India5h ago
-
Entry-level InternshipHyderabad, India5h ago
-
Assistant Manager INR 1000K-2000KBusiness Intelligence | Data Modeling | Data Quality | Logistic Regression | Machine LearningMid-level Full TimeIndia6h ago
-
DTICI_T8_Data_engineer_Manufacturing_Operations INR 1500K-2500KAgile | Apache Spark | Azure | Azure Blob | Azure Blob StorageSenior-level Full TimeBengaluru, Karnataka, India6h ago
-
AWS | Airflow | Apache Spark | Azure | Cause analysisSenior-level Full TimePune, Maharashtra, India6h ago
-
AWS Snowflake INR 1500K-2000KAmazon Web Services | DBT | Data Modeling | Data Pipelines | Data WarehousingMid-level Full TimeIN-TN-Chennai6h ago
-
Confluent Kafka Data Engineer INR 1500K-2500KApache Kafka | Apache Spark | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeIN-KA-Bangalore6h ago
-
GEN AI Developer INR 2000K-5000KAgile | Continuous integration | Data Modeling | Generative AI | Language ProcessingSenior-level Full TimeIN-KA-Bangalore6h ago
-
GCP Data Engineer INR 1500K-2500KAirflow | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeIN-MH-Mumbai6h ago
-
GCP Data Engineer INR 1500K-2500KADLS Gen2 | Airflow | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeIN-MH-Mumbai6h ago
-
Mid-level Full TimeIndia6h ago
-
Principal AI Engineer with Java INR 2475K-4800KAI Services | Agent Framework | Agentic AI | Alembic | AutogenEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India7h ago
-
Mid-level Full TimePune, Maharashtra, India7h ago
-
Senior-GDC INR 2400K-3500KAPIs | Azure | Azure Data | Azure Data Factory | Azure DatabricksCoaching junior engineers | Knowledge transferSenior-level Full TimeBangalore, Karnataka, India9h ago
-
Assistant Manager - Azure Data Engineer INR 1500K-2000KApache Spark | Azure | DBX Notebooks | Data Infrastructure | Data ModelingMid-level Full TimeBangalore, Karnataka, India9h ago
-
Security Services Data Modelling and Engineering - Associate INR 1500K-2400KAI enablement | Apache Spark | Data Architecture | Data Catalog | Data GovernanceMid-level Full TimeBengaluru, Karnataka, India9h ago
-
Associate - Java Developer - Prime Brokerage INR 1500K-2000KAgile | Crystal Reports | Data Warehousing | Database Triggers | Database functionsMid-level Full TimePune, India9h ago
-
BI Developer (Gen AI) – (BI and Analytics)-Analyst INR 2500K-4000KCI/CD | Control-M | Data Modeling | Database Design | DatabricksSenior-level Full TimeMumbai, Maharashtra, India10h ago
-
Associate Engineer INR 1200K-2000KAnalysis Services | Azure Analysis | Azure Analysis Services | Azure Blob | Azure Blob StorageMid-level Full TimeHyderabad, IN11h ago
-
Senior AI / ML Data Scientist I INR 3000K-4500KCI/CD | CNN | CatBoost | Component analysis | Cross-validationSenior-level Full TimeBangalore, India12h ago
-
Data Scientist & AI Developer INR 3000K-5000KA/B | A/B Testing | AWS SageMaker | Azure ML | B testingSenior-level Full TimeBangalore, KA, IN, 56007613h ago
-
Senior Data Engineer - BI Data Products & Databricks (Channel) INR 1971K-3000KAWS | Amazon Redshift | Data Modeling | Data Observability | Data QualitySenior-level Full TimeBangalore, KA, IN, 56007613h ago
-
Senior-level Full TimeChennai, TN, India14h ago
-
AI Data Engineer III INR 3000K-4000KAWS | Agile | Amazon Redshift | Apache Airflow | CI/CDComprehensive insurance | Education assistance program | Fitness benefits | Flexible working hours | Health checkupsSenior-level Full TimeBengaluru, Karnataka, India15h ago
-
Scala Data Engineer - VOIS INR 800K-800KApache Spark | Big Data | Cassandra | Cloud Composer | Cloud StorageMid-level Full TimePune, IN19h ago