Data Engineer
Tasks
- Analyze debug and resolve data processing issues
- Build data pipelines for ingestion transformation and validation
- Collaborate with data architects to align on data architecture requirements
- Define data preparation integration and storage parameters
- Deploy and monitor pipelines using CI CD practices
- Design and maintain data models for analytics and reporting
- Develop data validation and quality assurance tests
- Ensure data availability integrity and lineage
- Evaluate and adopt new data tools technologies and frameworks
- Mentor team members on data engineering practices
- Monitor and report data pipeline performance and failures
- Optimize data pipeline performance and reliability
- Partner with product managers analysts and engineering teams on data requirements
Perks/Benefits
- Company reset week
- Dependent care support
- Employee resource groups
- Employee travel discounts
- Flexible remote work
- Hybrid work
- Life and disability coverage
- Medical dental vision and mental health coverage
- PTO and holidays
- Paid volunteer days
- Parental leave
- Recognition programs
- Retirement plans with company contributions
- Social events
- Tuition support
Skills/Tech-stack
Airflow | Apache Airflow | Apache Kafka | Apache Spark | CI/CD | Cloud SQL | Cloud platform | DBT | Data Governance | Data Lineage | Data Modeling | Data Quality | Data Security | Data Validation | Data orchestration | Data pipeline | Google BigQuery | Google Cloud | Google Cloud Platform | MySQL | Oracle | PostgreSQL | SQL | Snowflake
Education
Roles
Related jobs
-
Data Engineer (MS) (Remote) INR 2040K-3380KCI/CD | Data Transformation | Data Validation | Date normalization | ETLMentorship opportunities | Professional growth | Remote workSenior-level Full TimeMaharashtra, Pune, India R8h ago
-
Data Operations Engineer INR 2040K-3380KApache Airflow | Data Pipelines | Data Refresh | Data Warehousing | Data pipelineEmergency incident response support | On-call rotationSenior-level Full TimeBengaluru, INDIA, India R16h ago
-
Anomaly Detection | Data Modeling | Data Pipelines | Docker | JavaScript100 percent remote | Autonomous work environment | Career growth opportunities | Flexible work environment | International team cultureMid-level Full TimeIndia R17h ago
-
Machine Learning Engineer - 5 INR 2500K-4500KAWS | AWS SageMaker | Airflow | Argo Workflows | Azure Machine LearningSenior-level Full TimeBangalore, India R22h ago
-
Computer Scientist ( Java Backend ) INR 3000K-4725KApache Kafka | CI/CD | Distributed Systems | Docker | Event DrivenSenior-level Full TimeBangalore, India R22h ago
-
Business Technology Analyst INR 3000K-4000KAWS | AWS Athena | AWS Glue | Airflow | Amazon RedshiftHeadspace access | Hybrid work | Mental health days | Retirement savings | Tuition reimbursementSenior-level Full TimeIndia, Hyderabad, Telangana R22h ago
-
Software Engineer INR 1500K-2362KAWS | Apache Flink | Apache Spark | Linux | PythonHybrid work | Remote work | Work-life balanceMid-level Full TimeRemote (IND), India R22h ago
-
Sr. Engineer - Gen AI with 4+ years(Remote) INR 2500K-5000KAWS | Audio Processing | Azure | Computer Vision | Distributed ComputingExtendable contract | Remote workSenior-level Full TimeBengaluru, KA, India R1d ago
-
Software Development Engineer I INR 2139K-4500KCI/CD | Code review | Data Structures | Data Structures and Algorithms | ElasticsearchProfessional development | Remote workSenior-level Full TimeBengaluru, KA, India R1d ago
-
Senior DevOps Engineer INR 2000K-4000KAWS | AWS Lambda | Agile | Amazon CodeDeploy | Amazon LinuxGreat place to work | Remote workSenior-level Full TimeBengaluru, KA, India R1d ago
-
Senior DevOps Engineer INR 2000K-4000KAWS | AWS CodeDeploy | AWS Lambda | AWS SDK | AgileGreat place to work | PradeepIT Academy training | Remote workSenior-level Full TimeBengaluru, KA, India R1d ago
-
Senior DevOps Engineer INR 2000K-4000KAWS | AWS Lambda | Agile | Amazon Linux | AnsibleRemote work opportunitySenior-level Full TimeBengaluru, KA, India R1d ago
-
Senior DevOps Engineer INR 2000K-4000KAWS | AWS CodeDeploy | AWS Lambda | AWS SDK | AgileRemote workSenior-level Full TimeBengaluru, KA, India R1d ago
-
Senior DevOps Engineer INR 2000K-4000KAWS | AWS CodeDeploy | AWS Lambda | Agile | Amazon LinuxCareer acceleration | Remote work | Training and academy coursesSenior-level Full TimeBengaluru, KA, India R1d ago
-
Python Backend Engineer INR 2800K-4200KBackend Development | MySQL | Python | Web developmentContinuing education | Remote workSenior-level Full TimeBengaluru, KA, India R1d ago
-
Pyspark & Databricks certified Developer INR 1632K-2300KAWS | Apache Spark | Azure | Azure Databricks | Data IngestionRemote workSenior-level Full TimeMumbai, MH, India R1d ago
-
Principal Engineer (Big Data Engineer) INR 2800K-4500KAmazon Web Services | Apache HBase | Apache Spark | Cassandra | Cloud platformRemote work flexibilitySenior-level Full TimeBengaluru, KA, India R1d ago
-
Oracle + PySpark Data Engineer (Remote) INR 1500K-2500KData Modeling | Data Quality | Data Warehousing | Distributed Computing | ETLDocumentation support | Remote workMid-level Full TimeBengaluru, KA, India R1d ago
-
Lead Software Engineer (Python) INR 2000K-4000KAPI Gateway | AWS | AWS IAM | AWS Lambda | AiohttpRemote workSenior-level Full TimeBengaluru, KA, India R1d ago
-
Lead Software Engineer (Big Data and Azure) INR 2040K-3500KAgile | Apache Kafka | Apache Spark | Apache Storm | Azure BlobCareer growth | Great Place to Work certification | Remote work | Training coursesSenior-level Full TimeBengaluru, KA, India R1d ago
-
Senior-level Full TimeBengaluru, KA, India R1d ago
-
HVR Data Engineer|3-5 Years Exp|Remote INR 1500K-2000KAWS | Azure | Data Quality | ETL | HVRRemote work | Shift work supportMid-level Full TimeBengaluru, KA, India R1d ago
-
Devops Engineer INR 2000K-3900KAirflow | Angular | Apache Tomcat | Bootstrap | GitLabGreat Place to Work certification | Remote work | Training programsSenior-level Full TimeBengaluru, KA, India R1d ago
-
Dataops Engineer or database administration | Permanent Remote INR 1400K-2000KAWS | Amazon S3 | Ansible | Azure | CI/CDRemote workMid-level Full TimeBengaluru, KA, India R1d ago
-
Senior-level Full TimeBengaluru, KA, India R1d ago