Data Engineer
Tasks
- Apply BigQuery partitioning clustering optimization
- Automate monitoring of pipeline executions
- Build data integration pipelines in BigQuery
- Collaborate with cross-functional teams
- Conduct testing and validation of data models
- Design scalable cloud data pipelines
- Develop dbt data models
- Establish engineering best practices
- Implement CI/CD workflows
- Implement data quality checks
- Ingest structured and semi structured data
- Maintain technical documentation
- Mentor junior engineers
- Orchestrate data workflows with Airflow
- Perform peer code reviews
- Transform raw data into curated datasets
- Write Python and SQL for ingestion and transformation
Perks/Benefits
- N/A
Skills/Tech-stack
Agile | Apache Airflow | Apache Kafka | Ascend.io | CI/CD | Cloud Composer | Cloud Dataflow | Collibra | DBT | Data Governance | Data Quality | Data Warehousing | Databricks | ELT | ETL | Fivetran | Git | Google BigQuery | Kanban | Pub/Sub | Python | SQL | Scrum
Education
Roles
Data Engineer | Developer | ETL Developer | Engineer | Senior Data Engineer | Senior ETL Developer
Related jobs
-
Senior-level Full TimeIndia6h ago
-
SDE - III (Backend) INR 2800K-4200KAWS | Alerting | Azure | Bulkhead | CI/CDCollaborative culture | Leadership development | Learning and development programs | Multicultural team | Remote work optionSenior-level Full TimeIndia6h ago
-
AI Engineer INR 1500K-2500KAWS | Autogen | Azure | Crew AI | EmbeddingsAccidental insurance | Doctor Consultations | Employee assistance program | Free meals | Home office setup allowanceMid-level Full TimeBangalore8h ago
-
Mid-level Full TimeIndia8h ago
-
Alteryx | Azure | Business Intelligence | Dashboarding | Data ModelingFlexible remote work | Professional growthMid-level Full TimeIndia8h ago
-
AWS Glue | AWS Lambda | Amazon EMR | Amazon Kinesis | Amazon RedshiftCareer progression | Collaborative culture | Continuous learning | Innovation-focused culture | International organizationMid-level Full TimeIndia8h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Competitive salary | Flexible environment | Remote-friendly workMid-level Full TimeHyderabad, India9h ago
-
Bash | Data Ingestion | Data Processing | Docker | GCPAsynchronous culture | Friendly work environment | Hands-off managementMid-level Full TimePune, India10h ago
-
Senior Data Engineer INR 3000K-4000KAWS | Airflow | Apache Spark | Cloud platform | Data ModelingCommuter benefits | Dental insurance | Disability insurance | Financial wellness support | HealthcareSenior-level Full TimeBengaluru, India13h ago
-
Senior Machine Learning Engineer, Ad Tech Engineering INR 2000K-3380KA/B | A/B Testing | B testing | CI/CD | Computer VisionCommuter benefits | Dental insurance | Disability insurance | Financial wellness support | HealthcareSenior-level Full TimeBengaluru, India14h ago
-
Senior AI and Machine Learning Engineer INR 2500K-4500KCalculus | Convolutional Neural Networks | Data Mining | Data Visualization | Decision TreesCareer Development Programs | Flexible work arrangements | Health and wellbeing benefitsSenior-level Full TimeBengaluru, Karnātaka, India14h ago
-
Senior AI and Machine Learning Engineer INR 2500K-4500KConvolutional Neural Networks | Data Mining | Data Preprocessing | Decision Trees | Deep learningHealth and wellbeing | Professional developmentSenior-level Full TimeBengaluru, Karnātaka, India14h ago
-
Custom Software Engineer INR 2500K-3500KBusinessObjects Data Services | Data Governance | Data Lineage | Data Modeling | Data QualitySenior-level Full TimeKolkata, KDC1A, India14h ago
-
Custom Software Engineer INR 2500K-3500KBusinessObjects Data Services | Data Governance | Data Lineage | Data Modeling | Data QualitySenior-level Full TimeBengaluru, BDC11A, India14h ago
-
Custom Software Engineer INR 1300K-2000KCloud Computing | Data Modeling | Data Warehouse | Data Warehousing | ETLMid-level Full TimeBengaluru, BDC7A, India14h ago
-
Custom Software Engineer INR 2500K-3500KAutomation | Batch Data Processing | Batch data | BusinessObjects Data Services | Data GovernanceSenior-level Full TimePune, PDC2C, India14h ago
-
Custom Software Engineer INR 2500K-3500KAnomaly Detection | Batch Processing | BusinessObjects Data Services | Data Governance | Data LineageSenior-level Full TimeBengaluru, BDC11A, India14h ago
-
Mid-level Full TimeBangalore, KA, IN14h ago
-
Mid-level Full TimeBangalore, KA, IN14h ago
-
Mid-level Full TimeBangalore, KA, IN14h ago
-
Z2_Sr. Data Engineer|Data Science INR 3000K-3900KAzure | Azure Databricks | CI/CD | DAX | Data GovernanceSenior-level Full TimeBangalore, KA, IN14h ago
-
Senior Engineer - Databricks INR 2800K-4000KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageFlexible working hours | Paid parental leave | Paid training and development programs | Remote or mobile workingSenior-level Full TimeBangalore RMZ-ECO WORLD, India14h ago
-
Associate Engineer - AI services INR 1000K-1000KAPI product | API product development | AWS | Agile | AlgorithmsDiversity and inclusion | Hybrid working | Opportunities for growthMid-level Full TimeIND, Emerio, Chennai, India14h ago
-
Lead AI Engineer INR 2500K-4500KAngular | Argo CD | CI/CD | ChatGPT | ClaudeCareer growth | Healthcare benefits | Hybrid work | Learning platform | Paid time offSenior-level Full TimeIND-Pune-Equifax Analytics-PEC, India14h ago
-
Mid-level Full TimeBangalore, KA, IN14h ago