Data Engineer 2
Pune, Maharashtra, India
INR 1500K-2500K (estimate) Senior-level Full Time
Tasks
- Analyze data systems data flow dependencies relationships
- Design physical data models and storage architectures
- Develop and maintain data and analytics platform
- Develop and operate distributed data storage and processing solutions
- Develop scalable data pipelines with ETL ELT
- Implement and automate data pipeline deployment
- Implement data governance metadata access and retention
- Ingest and transform data from multiple sources
- Monitor and troubleshoot data quality issues
- Support agile development using DevOps Scrum Kanban
- Test and troubleshoot data pipelines
Perks/Benefits
- N/A
Skills/Tech-stack
Agile Development | Cassandra | Cloud Computing | Data Catalog | Data Governance | Data Lineage | Data Modeling | Data Pipelines | Data Quality | DevOps | DynamoDB | ELT | ETL | HBase | Hadoop | Hive | Java | Kafka | Kanban | MapReduce | Metadata Management | MongoDB | Python | SQL | Scala | Scrum | Spark
Education
Roles
Related jobs
-
Data Engineer, YouTube Business Organization INR 1000K-2000KApache Flume | Apache Spark | Data Governance | Data Lakes | Data ModelingMid-level Full TimeBengaluru, Karnataka, India2h ago
-
Senior Software Engineer, Generative AI, Gaming INR 2500K-5000K3D mathematics | C++ | Computer Graphics | Computer Vision | Data ProcessingSenior-level Full TimeBengaluru, Karnataka, India2h ago
-
Senior Artificial Intelligence/Machine Learning Engineer INR 2500K-5000KAWS | Agile | Azure | Embedding Models | Hugging FaceCompany-paid certifications | Financial consultations | Internal events | Language courses | Legal consultationsSenior-level Full TimeIndia2h ago
-
Senior Software Engineer INR 1163K-3000KAutomated testing | Batch Processing | CI/CD | DAX | Data GovernanceFlexible work arrangement | Hybrid work modelSenior-level Full TimeIndia, Telangana, Hyderabad R4h ago
-
Senior / Lead Data Engineer - Azure Databricks INR 1500K-3000KAzure Databricks | Azure DevOps | CI/CD | Cloud Security | Conformed DimensionsSenior-level Full TimeHyderabad, TS, India5h ago
-
Apprentice - AI Engineer INR 300K-324KAWS | Anthropic SDK | Azure | Docker | EmbeddingsCareer development | Collaborative team | Exposure to global teams | Holiday allowance | Hybrid work environmentEntry-level Apprenticeship Full TimeWhitefield, Bangalore, India R6h ago
-
Solution Database Engineer INR 1500K-2600KAgile | Azure Data | Azure Data Factory | Azure DevOps | Common table expressionsSenior-level Full TimeBengaluru, KA, India R7h ago
-
Senior-level Full TimeNoida, Uttar Pradesh, India7h ago
-
Lead Associate - SQL Developer INR 800K-1500KAzure Data | Azure Data Factory | BI | Big Data | Data ArchitectureMid-level Full TimePune8h ago
-
Lead Associate - Data / AI INR 1500K-2500KAzure Data | Azure Data Factory | Big Data | Cause analysis | Data FactoryMid-level Full TimePune9h ago
-
Lead Associate - Data Ontology / AI INR 1500K-2800KData Engineering | Data Modeling | Generative AI | Graph Databases | Knowledge graphMid-level Full TimePune9h ago
-
Lead Software Engineer - Machine Learning INR 5000K-6000KCross-validation | Data Pipelines | Distributed Systems | Low Latency | Low-Latency SystemsSenior-level Full TimeHyderabad, India9h ago
-
Alerting | Automated testing | Batch Processing | Big Table | Data ArchitectureCollaborative culture | Flexible working approach | Health and wellbeing | Learning opportunities | Meaningful technical impactSenior-level Full TimeIndia R10h ago
-
AWS Bedrock | AWS Lambda | Amazon Redshift | CI/CD | Context OptimizationEmployee recognition incentives | Generous leave | Health insurance | Immigration Support Programs | Professional growth trainingMid-level Contract Full TimeIndia R11h ago
-
AWS | AWS Lambda | Access Control | Access History | Access ManagementAugust Free Fridays | Education support | Employee Well Being Resources | Flexible work options | Leadership development programsSenior-level Full TimeIndia11h ago
-
AWS | Agent Frameworks | Agentic AI | Azure | CI/CDSenior-level Full TimeIndia11h ago
-
Mid-level Full TimeIndia New Delhi (Noida)13h ago
-
Senior Cloud Engineer INR 1500K-4000KAPI Integration | ARM Templates | AWS Glue | AWS Lambda | Access ManagementSenior-level Full TimeIndia New Delhi (Noida)13h ago
-
Tech Consultant - AI & Machine Learning INR 2520K-4000KAzure | Azure Kubernetes | Azure Kubernetes Service | Azure Machine Learning | CI/CDSenior-level Full TimeNoida, UP, IN R13h ago
-
FBS Associate Analytics Engineer INR 1000K-2000KAWS | Apache Airflow | Azure | Cloud platform | DBTCareer development | Flexible work arrangements | Paid time off | Pension plan | Private health insuranceMid-level Full TimeHyderabad, Telangana, India R13h ago
-
API | AWS CloudFormation | AWS CloudTrail | AWS Glue | AWS Glue Data CatalogCareer development opportunities | Coaching and feedback | Flexible work approachSenior-level Full TimeHyderabad, TG, IN, 50008113h ago
-
EY - GDS Consulting - AI And DATA -AWS Data Engineer - Manager INR 2000K-2700KAPI Integration | AWS CloudTrail | AWS Glue | AWS Glue Data Catalog | AWS IAMCareer development opportunities | Coaching and feedback | Flexible work approach | Supportive and inclusive work cultureMid-level Full TimeHyderabad, TG, IN, 50008113h ago
-
APIs | Access Control | Amazon Neptune | CI/CD | Conceptual data modelingSenior-level Full TimeHyderabad, TG, IN, 50008113h ago
-
EY - GDS Consulting - AI And DATA -AI Data Platform Engineer - AI Data Platform Engineer - MS Fabric INR 2771K-5000KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageCareer development | Coaching | Flexible working hoursSenior-level Full TimeHyderabad, TG, IN, 50008113h ago
-
Senior Lead AI Engineer INR 2500K-4680KAPI Development | Artificial Intelligence | Auditability | Azure | Azure DevOpsSenior-level Full TimeMumbai Central Avenue, India13h ago