Data Engineer - Senior 4
Pune, Maharashtra, India
INR 1500K-2500K (estimate) Senior-level Full Time
Tasks
- Automate data preparation and integration tasks
- Build governed discoverable data assets for self service consumption
- Create physical data models and optimize database performance
- Design and automate data ingestion and transformation pipelines
- Design and develop distributed data storage and processing solutions
- Design and optimize scalable data pipelines with monitoring and alerts
- Implement data governance and metadata management
- Lead delivery of analytics initiatives using agile DevOps methods
- Maintain and operate data storage and processing platforms
- Monitor and troubleshoot data quality and data integrity
- Optimize testing and troubleshooting of data pipelines
Perks/Benefits
- N/A
Skills/Tech-stack
APIs | Agile | Amazon S3 | Apache Hadoop | Apache Kafka | Apache Spark | Cassandra | Cloud Computing | Data Governance | Data Integrity | Data Lineage | Data Modeling | Data Pipeline Monitoring | Data Quality | Data pipeline | Data pipeline orchestration | DevOps | Distributed Systems | DynamoDB | ELT | ETL | HBase | Hive | Java | Kanban | MapReduce | Metadata Management | MongoDB | NoSQL | Performance optimization | Pipeline Orchestration | Pipeline monitoring | Retrieval-Augmented Generation | SQL | Scala | Scrum | Semantic Search | Semantic models | Vector Databases
Education
N/A
Roles
Related jobs
-
Staff Software Engineer, GenAI Gaming INR 2000K-5000K3D mathematics | Computer Vision | Data Processing | Diffusion Transformers | Distributed SystemsSenior-level Full TimeBengaluru, Karnataka, India14h ago
-
Staff Software Engineer, AI/ML GenAI, Google Ads INR 2500K-5000KC++ | Computer Vision | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeBengaluru, Karnataka, India14h ago
-
Data Integration Specialist INR 1500K-2600KAPI Integration | AWS | Apache Kafka | Azure | Azure DataSenior-level Full TimeBengaluru, IN, 56010316h ago
-
Senior Cloud Engineer - AI-ML Platform INR 2500K-5000KAccess Control | Amazon Web Services | Apache Kafka | Azure DevOps | CloudFormationInclusion and belongingSenior-level Full TimeBangalore, Karnataka, IN, 56010019h ago
-
Software Engineer INR 2500K-4200KAI Large Language Models | AWS Glue | Access Management | Amazon Web Services | CloudFormationSenior-level Full TimeBangalore, Karnataka, IN, 56010019h ago
-
Data Quality Engineer INR 3000K-4000KAlerting | Apache Airflow | Apache Spark | Automated testing | Cause analysisChildcare services | Employee assistance program | Medical insurance | Paid time offSenior-level Full TimeBangalore, Karnataka, India19h ago
-
AI Assisted Development | Algorithms | Amazon S3 | Apache Iceberg | Cloud ComputingFlexible work schedule | Remote work optionsSenior-level Full TimeHyderabad, India R20h ago
-
Senior Consultant_Python, Java AI / ML Engineer INR 2500K-4500KAPI Gateway | AWS | AgentCore) | Amazon Bedrock | AngularSenior-level Full TimeHyderabad, IN, 500081 R20h ago
-
ML Engineer INR 2400K-3000KClassification | Clustering | Computer Vision | Deep learning | DevOpsAnnual leave | Digital learning platforms | Employee assistance program | Flexible working arrangements | Learning & development opportunitiesMid-level Full TimeBangalore, IN20h ago
-
AWS | Agile | Azure | CI/CD | Cloud platformFully remote | Professional growthSenior-level Full TimeIndia R20h ago
-
Lead Software Engineer - Machine Learning INR 5000K-6000KAPI Design | Data pipeline | Distributed Systems | MLOps | Machine LearningSenior-level Full TimeChennai, TN, India21h ago
-
Senior-level Full TimePune, Maharashtra, India21h ago
-
Data Engineer - Senior 6 INR 1500K-2500KAgile | Cassandra | Data Architecture | Data Catalog | Data GovernanceSenior-level Full TimePune, Maharashtra, India21h ago
-
Data Engineer 5 INR 1500K-2500KAgile | Apache Hive | Apache Spark | Cloud Computing | Continuous integrationEntry-level Full TimePune, Maharashtra, India21h ago
-
Entry-level Full TimePune, Maharashtra, India21h ago
-
Entry-level Full TimePune, Maharashtra, India21h ago
-
Entry-level Full TimePune, Maharashtra, India21h ago
-
Entry-level Full TimePune, Maharashtra, India21h ago
-
Entry-level Full TimePune, Maharashtra, India21h ago
-
Entry-level Full TimePune, Maharashtra, India21h ago
-
Data Engineer 12 INR 1500K-2500KAccumulo | Agile Development | Amazon DynamoDB | Apache Cassandra | Apache HiveEntry-level Full TimePune, Maharashtra, India21h ago
-
Data Engineer - Senior 3 INR 1500K-2500KAPI Development | Agile | Apache HBase | Apache Hive | Apache KafkaSenior-level Full TimePune, Maharashtra, India22h ago
-
Data Engineer - Senior 2 INR 1500K-2500KAgile | Apache Cassandra | Apache HBase | Apache Hive | Apache KafkaSenior-level Full TimePune, Maharashtra, India22h ago
-
Data Engineer - Senior 1 INR 1500K-2500KAccumulo | Agile | Apache Hive | Apache Kafka | Apache SparkSenior-level Full TimePune, Maharashtra, India23h ago
-
Senior-level Full TimeHyderabad, IND-TG, India1d ago