Data Engineer II
Tasks
- Analyze and troubleshoot data issues
- Apply version control and code reviews
- Automate routine data tasks
- Collaborate with data engineers and analysts
- Comply with internal policies and external regulations
- Design ETL processes
- Design, implement, and maintain data pipelines
- Develop scalable data processing code
- Implement ETL processes
- Implement data pipelines
- Maintain enterprise data platforms
- Optimize data processing with SQL
- Perform data validation
- Test and validate data for accuracy and consistency
- Write SQL queries for data retrieval manipulation and analysis
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Automated testing | Code review | Data Modeling | Data Validation | Data pipeline | Database Design | Databricks | ETL | Microsoft SQL | Microsoft SQL Server | Relational databases | SQL | SQL Server | Version control
Roles
Related jobs
-
Mid-level Full TimeBangalore, India Office (BANGALORE)8h ago
-
AWS Glue | AWS Lambda | AWS Step Functions | Amazon EC2 | Amazon EMRSenior-level Full TimeNoida, India11h ago
-
Associate Engineer - Data engineer INR 1000K-1700KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksCollaborative work environment | Professional development | Training opportunitiesMid-level Full TimeBangalore - Karnataka, India - Kalyani …11h ago
-
Mid-level Full TimeBangalore, Karnataka, India15h ago
-
Applied AI/ML Senior Associate INR 2817K-4680KApache Hive | Apache Spark | Keras | Language Processing | Machine LearningSenior-level Full TimeBengaluru, Karnataka, India15h ago
-
Software Engineer, Data Science INR 1000K-2000KD3 | Data Governance | Data Modeling | Data Pipelines | ETLHealth and wellness programs | Time awayMid-level Full TimeBengaluru, KA, India R15h ago
-
Entry-level Full TimePune, Maharashtra, India15h ago
-
Data Engineer 3 INR 1500K-2500KApache Hive | Apache Kafka | Apache Spark | Continuous integration | Data CatalogMid-level Full TimePune, Maharashtra, India15h ago
-
Senior Consultant - Data Engineering-Data Analysis INR 2400K-3500KAWS Redshift | Confluence | ETL | Git | NumPySenior-level Full TimeNoida, Uttar Pradesh, India16h ago
-
D&T Lead - Data Engineer INR 1500K-2500KBatch Processing | CI/CD | Cloud Data | Cloud data warehousing | ConfluenceSenior-level Full TimePune, IN16h ago
-
Sr Software Engineer INR 1500K-2700KAgile | Cloud services | Code Reviews | Data Modeling | Data StorageSenior-level Full TimePune, India16h ago
-
Software Engineer INR 1500K-2200KAgile | Cloud services | Code Reviews | Data Modeling | Data StorageMid-level Full TimePune, India16h ago
-
Sr Software Engineer INR 1500K-2700KAgile | Cloud Computing | Code review | Data Modeling | Database DesignSenior-level Full TimePune, India16h ago
-
Mid-level Full TimePune, India16h ago
-
Associate Software Engineer INR 1300K-2000KAgile | Design Patterns | JavaScript | Python | REST APIMid-level Full TimePune, India16h ago
-
Software Engineer INR 1500K-2200KAgile | Cloud services | Data Modeling | Database Design | Design PatternsMid-level Full TimePune, India16h ago
-
Tech Lead Data Engineer INR 1500K-2600KAWS Data | AWS Glue | AWS data warehousing | Amazon Athena | Amazon EKSGreat Place to Work recognitionSenior-level Full TimePune, India16h ago
-
Senior-level Full TimePune, India16h ago
-
Data Engineer INR 1500K-2500KAWS Glue | Agile methodology | Amazon Athena | Amazon EMR | Amazon KinesisMid-level Full TimePune, India16h ago
-
Senior Software Engineer INR 1500K-3000KAgile | Cloud services | Code review | Data Modeling | DatabaseSenior-level Full TimePune, India16h ago
-
AI Engineer - FDE (Forward Deployed Engineer) INR 1860K-3900KAWS | Agent systems | Apache Spark | Apache Spark SQL | AzureSenior-level Full TimeRemote - India R17h ago
-
Senior-level Full TimeHyderabad R18h ago
-
Automation | Azure | Azure Data | Azure Data Explorer | Azure Log AnalyticsCross-functional collaboration | Professional growth | Remote workMid-level Full TimeIndia R19h ago
-
Senior Data Engineer, BizTech INR 3080K-4400KAmazon Redshift | Apache Flink | Apache Kafka | Apache Spark | Batch ProcessingSenior-level Full TimeBangalore, India20h ago
-
API Development | AWS EMR | Amazon EC2 | Amazon IAM | Amazon S3Flexible paid time off | Professional growth opportunities | Remote work from India | Stock grantsSenior-level Full TimeIndia R20h ago