Data Engineer II
Tasks
- Collaborate with business stakeholders
- Create and maintain documentation
- Design and develop data pipelines
- Implement data issue solutions
- Implement data monitoring systems
- Implement data quality frameworks
- Mentor junior team members
- Optimize Spark pipelines
- Translate requirements into technical solutions
- Troubleshoot complex data issues
Perks/Benefits
Skills/Tech-stack
Apache Spark | Data Modeling | Data Monitoring | Data Pipelines | Data Quality | Data health checks | Expectations | Health Checks | PySpark | TypeScript
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
AWS | Apache Spark | CI/CD | Git | HadoopMid-level Full TimeBengaluru, Karnataka, India4h ago
-
Associate Principal, SOX Analytics INR 1120K-1600KAPI Integration | Audit Methodology | Coso | Data Analysis | Data AutomationMid-level Full TimeIndia6h ago
-
AWS | Apache Spark | CI/CD | Git | HadoopExecutive-level Full TimeBengaluru, Karnataka, India7h ago
-
Senior-level Full TimeBengaluru, India13h ago
-
Senior-level Full TimeHyderabad, TG, IN13h ago
-
Senior Data Engineer-Data Analytics INR 2040K-2400KAgile | Amazon Redshift | CI/CD | Data Governance | Data ModelingSenior-level Full TimeIND KA Bangalore - Cherry Hills, …13h ago
-
Experienced Software Engineer - AI-ML (GenAI) INR 2940K-4500KCI/CD | Containerization | Data Modeling | Data Pipelines | Deep learningFlexible working hours | Relocation within IndiaSenior-level Full TimeIND - Bangalore, India13h ago
-
Experienced Software Engineer - AI-ML (GenAI) INR 2940K-4500KCI/CD | Containerization | Data Management | Data Modeling | Data PipelinesRelocation within IndiaSenior-level Full TimeIND - Bangalore, India13h ago
-
Senior Manager, Full Stack Engineer INR 2500K-3000K.NET | AWS | Agile | Application Security | AzureSenior-level Full TimeIND - Mumbai, India13h ago
-
Software Engineer, Principal (Java, React) INR 1800K-2040KCloud infrastructure | Databricks | Deployment | HTML/CSS | JavaWork from office Monday to FridaySenior-level Full TimeChennai, India19h ago
-
Mid-level Full TimeBengaluru, IN21h ago
-
Mid-level Full TimeNoida, Uttar Pradesh, India1d ago
-
PySpark Data Engineer INR 1500K-2000KApache Airflow | Apache Hadoop | Apache Hive | Apache Spark | HDFSSenior-level Full TimeJaipur, India1d ago
-
Senior-level Full TimeChennai City Corporation, India1d ago
-
Lead Consultant-Data Engineer INR 2040K-2400KAmazon Redshift | Amazon Web Services | Apache Hadoop | Apache Kafka | Apache SparkSenior-level Full TimeIndia-Bangalore1d ago
-
Principal Consultant-Data Engineer INR 2486K-3380KAmazon Redshift | Amazon Web Services | Apache Hadoop | Apache Kafka | Apache SparkSenior-level Full TimeIndia-Bangalore1d ago
-
Amazon AWS | Amazon Redshift | Apache Hadoop | Apache Kafka | Apache SparkSenior-level Full TimeIndia-Bangalore1d ago
-
Lead Consultant - Lead Data Ops (Human-in-the-loop) INR 2000K-2040KAmazon Redshift | Amazon Web Services | Apache Hadoop | Apache Kafka | Apache SparkContinuous learning opportunities | Mentored career growth | MentorshipSenior-level Full TimeIndia-Bangalore1d ago
-
Lead Consultant - Security/Network SME INR 2040K-2400KAmazon Redshift | Amazon Web Services | Apache Hadoop | Apache Kafka | Apache SparkSenior-level Full TimeIndia-Bangalore1d ago
-
Lead Consultant - IAC Engineer INR 2486K-3380KAmazon Redshift | Amazon Web Services | Apache Hadoop | Apache Kafka | Apache SparkContinuous learning opportunities | MentorshipSenior-level Full TimeIndia-Bangalore1d ago
-
Senior Analytics Engineer – Cloud & FinOps INR 2040K-3200KAmazon QuickSight | Amazon Redshift | Amazon Web Services | Cloud Cost Optimization | Cloud billingCross-functional collaboration | Hybrid work model | In office schedule 3 days per weekSenior-level Full TimeBangalore1d ago
-
Staff Engineer, Data Analytics Engineering ( 6+ years Full Stack Developer - React, JavaScript, and Python / Node.js, AWS, SQL ) INR 2520K-4725KAI/ML | API Gateway | AWS Lambda | Amazon ECS | Amazon EKSSenior-level Full TimeBengaluru, KA, India1d ago
-
Software Engineer III - Databricks, Cloud Data Engineer INR 2000K-2400KAWS EMR | Agile | Apache Spark | Application development | Big DataSenior-level Full TimeHyderabad, Telangana, India1d ago
-
Software Engineer II - Databricks, Cloud Data Engineer INR 1500K-2500KAWS EMR | Agile | Apache Spark | Big Data | CI/CDMid-level Full TimeHyderabad, Telangana, India1d ago
-
Linguistic Engineer INR 2400K-3000KASR | Data Analysis | Data Infrastructure | Data Pipelines | DialogMid-level Full TimeHyderabad, India1d ago