Data Engineer II
Tasks
- Collaborate on knowledge sharing
- Contribute to data modeling and architecture reviews
- Develop repeatable scalable data processing code
- Document data architecture data models and workflows
- Ensure privacy and security compliance
- Guide junior engineers with technical support and best practices
- Implement Data Quality and Data Governance
- Implement ETL and ELT processes
- Lead design and development of data pipelines
- Maintain data platform
- Optimize data pipelines for cost scalability and reliability
- Service data requests
Perks/Benefits
- N/A
Skills/Tech-stack
AWS EMR | AWS Glue | AWS Lambda | Amazon DynamoDB | Amazon RDS | Apache Airflow | Apache Hadoop | Apache Kafka | Apache Spark | CI/CD | DBT | Data Governance | Data Modeling | Data Privacy | Data Quality | Data pipeline | Database Architecture | Docker | ELT | ETL | Java | Kubernetes | Performance Tuning | Python | SQL | Schema Design | Snowflake | Test-Driven | Test-Driven Development
Education
N/A
Roles
Related jobs
-
Software Engineering, Android Embedded Software INR 1500K-2800KAndroid | Deployment | GPU Programming | Graphics Processing | Graphics Processing UnitMid-level Full TimeBengaluru, Karnataka, India2h ago
-
Data Engineer, Cloud Supply Chain Data Engineering INR 1500K-2200KBigQuery | Data Governance | Data Monitoring | Data Pipelines | Data QualityCollaborative team environment | Mentoring opportunitiesMid-level Full TimeBengaluru, Karnataka, India2h ago
-
Senior Staff Software Engineer, Geo INR 2500K-3465KAnomaly Detection | C++ | Continuous Learning | Data Governance | Data InfrastructureSenior-level Full TimeBengaluru, Karnataka, India2h ago
-
Application Engineer, General Software Development INR 1500K-3500KAI integration | Agentic integration | C++ | Cloud platform | Data exchangeMid-level Full TimeHyderabad, Telangana, India2h ago
-
Data Engineer INR 3000K-4000KData Ingestion | Data Pipelines | Data Quality | Data Transformation | Data ValidationSenior-level Full TimePune, Maharashtra, India3h ago
-
DE&A - AIML - Data Science - Machine Learning INR 2500K-5000KAI orchestration | AWS | Agentic AI | Azure | CI/CDSenior-level Full TimeIndia4h ago
-
Data Engineer I INR 1500K-2000KAWS | Apache Spark | Automated testing | Azure | Azure DataHybrid work | Inclusive work environment | Professional developmentMid-level Full TimeBangalore, Karnataka, IN5h ago
-
Data Engineer I INR 1500K-2000KApache Spark | Automated testing | Azure Data | Azure Data Factory | Azure DatabricksCareer development | Learning opportunitiesMid-level Full TimeBangalore, Karnataka, IN5h ago
-
Engineering-L2-Bengaluru-Associate-Software Engineering INR 1800K-3500KApache Spark | C++ | CI/CD | Continuous Delivery | Data CurationExposure to finance domain | Fast-paced environment | Global team collaborationMid-level Full TimeBengaluru, Karnataka, India6h ago
-
Cloud Data Engineer - AI/ML INR 4000K-5000KAmazon Web Services | Apache Spark | Batch Processing | Cassandra | Cloud platformSenior-level Full TimeBengaluru; Hyderabad6h ago
-
Cloud Data Engineer - AI/ML INR 4000K-5000KAmazon Web Services | Azure | Cassandra | Cloud platform | Dimensional ModelingSenior-level Full TimeBengaluru; Hyderabad6h ago
-
Data Analyst/ETL Engineer INR 1500K-2500KAWS Glue | BI tools | Data Flows | Data Transformations | ETLMid-level Full TimeChennai, India6h ago
-
Senior AI Engineer INR 2500K-5000KAWS | Azure | BM25 | CI/CD | ContainerizationFlexible work environment | Remote work options | Self-care supportSenior-level Full TimeHyderabad, India7h ago
-
Entry-level Full TimeHyderabad, Telangana, India7h ago
-
AI/ML Engineer INR 2500K-5000KFastAPI | Flask | Language Models | Language Processing | Large Language ModelsSenior-level Full TimeChennai, India7h ago
-
AI Agents | AWS Bedrock | Azure OpenAI | CI/CD | Claude CodeCareer growth | Continuous learning | Hybrid work | Remote work | Work-life balanceSenior-level Full TimeIndia7h ago
-
Senior Software Engineer II - Data Engineering and Platform INR 1500K-2000KAWS | Agile | Apache Airflow | Apache Kafka | Apache SparkMid-level Full TimeBangalore, India7h ago
-
AWS | Azure | Cloud platform | Data Analysis | Data ManagementAutonomy | Collaborative team environment | Continuous learning | Exposure to modern machine learning technologies | Flexible work scheduleMid-level Full TimeIndia R7h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Friendly work environmentMid-level Full TimeGurgaon, India8h ago
-
Bash | Data Pipelines | Data Processing | Docker | GCPAsynchronous culture | Competitive salary | Friendly work environment | Remote-friendlyMid-level Full TimeKolkata, India8h ago
-
Software Engineer II, Data Engineer INR 2520K-3880KAWS | Apache Airflow | Apache Spark | Azure | Cloud platformCareer growth | Learning & MentorshipSenior-level Full TimeBangalore, India8h ago
-
Senior Data Engineer - Supply Chain & Analytics Platforms INR 2800K-4200KAWS | Apache Airflow | Azure | CI/CD | Cloud StorageSenior-level Full TimeBengaluru, INDIA, India8h ago
-
AWS Glue | AWS IAM | AWS Lambda | Airflow | Amazon CloudWatchCollaborate with experienced engineering teams | Continuous learning and professional development | Remote work | Work on impactful business intelligence initiatives | Work on large scale cloud data transformation projectsMid-level Full TimeIndia10h ago
-
AI Foundry | AWS | Azure | Azure AI | Azure AI FoundryMid-level Full TimeBengaluru Millenia, India13h ago
-
ADLS Gen2 | AKS | Adaptive Query | Adaptive query execution | Apache SparkFlexibility programmes | Inclusive benefits | Mentorship | Mentorship programs | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India13h ago