Data Engineer 2
IND-CORP Bengaluru-TDIM - PTT, India
INR 2475K-3500K (estimate) Senior-level Full Time
Tasks
- Apply data modeling and data warehousing principles
- Build and modify CI CD pipelines for data processing
- Build reusable components and frameworks
- Collaborate with product managers analysts and stakeholders
- Design and implement ETL/ELT workflows
- Design database schemas and data integration patterns
- Develop automation solutions for scalability and efficiency
- Develop native data ingestion from APIs databases and file systems
- Implement data validation error handling and monitoring
- Incorporate AI and automation patterns into data engineering solutions
- Optimize data storage and retrieval for performance and cost
- Participate in SCRUM/agile development processes
- Translate business requirements into technical data engineering solutions
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Agile | Apache Airflow | Apache Spark | Azure | Azure Data | Azure Data Factory | Azure Functions | CI/CD | Cloud Data | Cloud Data Services | Data Factory | Data Modeling | Data Monitoring | Data Services | Data Validation | Data Warehousing | Database Schemas | Databricks | Decorators | Delta Lake | Design Patterns | ELT | ETL | Error Handling | GCP | Generators | Integration Services | Object-Oriented | Object-oriented programming | PySpark | Python | SQL | SQL Server | SQL Server Integration Services | SQL Server integration | SSIS | Server Integration Services
Roles
Related jobs
-
Senior-level Full TimePune City, India15h ago
-
Data Engineer INR 1500K-2500KApache Airflow | Apache Spark | Auto Loader | Azure Event | Azure Event HubSenior-level Full TimeIN-KA-Bangalore16h ago
-
Principal Architect AI Data Engineer INR 2000K-5000KAWS | Agent Orchestration | Azure | CI/CD | ContainersSenior-level Full TimeGurugram, Haryana, India17h ago
-
Architect AI Data Engineer INR 3000K-5000KAPI Integration | AWS | Agent Orchestration | Azure | Azure DatabricksSenior-level Full TimeNoida, Uttar Pradesh, India17h ago
-
Senior-level Full TimeGurugram, Haryana, India17h ago
-
Senior-level Full TimeNoida, Uttar Pradesh, India17h ago
-
Software Engineer III, AI/ML, Google Cloud INR 2500K-5000KAudio generation | Debugging | Distributed Computing | Documentation | GenAISenior-level Full TimeHyderabad, Telangana, India18h ago
-
Mid-level Full TimeBengaluru, Karnataka, India19h ago
-
Senior AWS Data Engineer INR 1500K-2500KAPI Gateway | AWS API | AWS API Gateway | AWS CloudFormation | AWS EMRSenior-level Full TimeIndia1d ago
-
Senior Analytics Engineer – Data Applications INR 2771K-4000KAirflow | Anomaly Detection | CI/CD | DBT | DashHybrid work modelSenior-level Full TimeBengaluru, INDIA, India1d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Entrepreneurial-minded team | Friendly team atmosphere | Hands-off management | Opportunity to impact millionsMid-level Full TimeHyderabad, India1d ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Opportunity for impact | Remote-friendly, distributed teamMid-level Full TimePune, India1d ago
-
Senior Software Engineer - Machine Learning (ML, GenAI, SQL) INR 2500K-4800KAWS | Apache Spark | Bedrock | CI/CD | CNNHybrid work flexibilitySenior-level Full TimeGurgaon - Cyber Park, India1d ago
-
Applied AI Engineer II INR 1500K-3000KAWS | Azure | CI/CD | CUDA | Data PipelinesAccidental insurance | Employee referral program | Flexible working hours | Hybrid work | Life insuranceMid-level Full TimeIndia - Remote R1d ago
-
Applied AI Engineer II INR 1500K-3000KAWS | Azure | CI/CD | Docker | GCPEmployee referral program | Hybrid and remote working | Life and accidental insurance | Maternity and parental leave | Medical coverageMid-level Full TimeIndia - Remote R1d ago
-
Forward Deployed Engineer INR 2040K-2800KAPI Integration | AWS | Apache Spark | Application development | AzureCustomer-facing role | Travel 20 percentSenior-level Full TimeRemote - India R1d ago
-
Senior-level Full TimeIndia1d ago
-
Machine Learning Engineer - IV (Fraud) INR 3000K-5000KAWS SageMaker | Agile | Computer Vision | Deep learning | Image dataSenior-level Full TimeBangalore1d ago
-
Agentic AI/ Data Scientist INR 3500K-5000KAWS | AWS SQS | AWS Step Functions | Agent systems | Agentic FrameworksSenior-level Full TimeIndia1d ago
-
Quantum Prod Support INR 2755K-3500KBatch monitoring | Cron | ITIL | Incident Management | JiraHybrid work | Rotational shiftsSenior-level Full TimeIndia - Bengaluru; India - Hyderabad; …1d ago
-
Senior-level Full TimeBengaluru, Karnataka, India1d ago
-
Lead Software Engineer - Big Data INR 2500K-3500KApache Hive | Apache Impala | Apache Kafka | Apache Pig | Apache SparkSenior-level Full TimeMumbai, Maharashtra, India1d ago
-
Database Engineer INR 500K-1500KCI/CD | DB2 | Data Warehousing | Database performance | Database performance tuningMid-level Full TimePune, MH, India1d ago
-
Senior AI Engineer I INR 3264K-5876KArtificial Intelligence | BigQuery | Cloud Composer | Cloud platform | Data ProcessingSenior-level Full TimeBengaluru, KA, India1d ago
-
Apache Airflow | Apache HBase | Apache Hive | Apache Impala | Apache KafkaSenior-level Full TimeBengaluru, Karnataka, India1d ago