GCP Data Engineer Lead
Tasks
- Automate infrastructure using DevOps practices
- Build and maintain data lakes
- Build and maintain data warehouses
- Collaborate with stakeholders to define data solutions
- Conduct code reviews
- Design scalable data architectures
- Develop ETL/ELT pipelines
- Implement batch data processing
- Implement engineering best practices
- Implement real-time data processing
- Lead and mentor data engineers
- Maintain code quality and performance
- Optimize data pipelines
- Perform solution architecture and project estimation
- Support CI/CD implementation
Perks/Benefits
- Career growth
- Collaborative work environment
- Inclusive workplace
- Professional development and continuous learning
Skills/Tech-stack
Airflow | BigQuery | CI/CD | Cloud Composer | Cloud Functions | Cloud Storage | Cloud platform | Data Processing | Dataflow | DevOps | ELT | ETL | Git | Google Cloud | Google Cloud Platform | Infrastructure as Code | Looker | PubSub | Real Time | Real-time Data | Real-time Data Processing | SQL | Terraform | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
A/B | A/B Testing | B testing | Dashboards | Data AnalysisContinuous learning and career development | Employee well-being benefits | Flexible work schedule | Global team collaboration | Healthcare benefitsMid-level Full TimeIndia6h ago
-
Senior-level Full TimeGurugram, Haryana, India19h ago
-
Senior-level Full TimeIN-TN-Chennai19h ago
-
Senior-level Full TimeIN-AP-Hyderabad19h ago
-
SC Data Science Leader INR 2500K-4064KData Transformation | Data Visualization | Data cleaning | Demand forecasting | ERPSenior-level Full TimeMADURAI, TAMIL NADU, India20h ago
-
GCP, Digital Analytics, Bigquery/Senior Consultant Specialist INR 2500K-4000KAccess Management | BI Visualization | Batch Processing | BigQuery | Clickstream analyticsContinuous professional development | Flexible working | Inclusive work environmentSenior-level Full TimeHyderabad, Telangana, India R20h ago
-
Assistant Manager INR 1500K-2200KACID | Azure Cloud | Azure Data | Azure Data Factory | CI/CDWork from office 5 daysMid-level Full TimeBengaluru, Karnataka, India21h ago
-
Azure Data Engineer INR 1500K-2500KAzure Cloud | Azure Cloud Platform | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeHyderabad, Telangana, India22h ago
-
AI machine learning | Agile | CI/CD | Data Governance | Data LineageFlexible working | Inclusive diverse environment | Professional developmentMid-level Full TimeHyderabad, Telangana, India R22h ago
-
Data & Analytics Engineer - AM INR 1500K-2700KApache Spark | Data Modeling | Data Warehousing | Databricks | Delta LakeSenior-level Full TimeBangalore, Karnataka, India23h ago
-
Lead Software Engineer Java INR 2500K-4000KAPI Gateway | AWS Glue | AWS Lambda | AWS OpenSearch | AWS SageMakerSenior-level Full TimeBengaluru, Karnataka, India23h ago
-
Data and Analytics Engineer , Enablement INR 3000K-4000KApache Spark | Azure Data | Azure Data Platform | CI/CD | Data AnalysisDocumentation enablement content creation | Mentoring and onboarding supportSenior-level Full TimeMumbai, Maharashtra, India1d ago
-
Analyst - Data Engineering INR 700K-1100KData Analysis | Financial Data | Financial Data Analysis | Git | JiraCareer development | Employee benefits | Supportive work environmentMid-level Full TimeBangalore, Karnataka, India R1d ago
-
Data and Analytics Engineer , Enablement INR 3000K-4000KAgile | Apache Spark | Data Governance | Data Modeling | Data VisualizationSenior-level Full TimeMumbai, Maharashtra, India1d ago
-
Alteryx | Azure Data | Azure Data Services | Data Services | Data VisualizationMid-level Full TimeMumbai, Maharashtra, India1d ago
-
Mid-level Full TimeBangalore, Karnataka, India R1d ago
-
Lead - Advanced Analytics, Gurgaon INR 3080K-4400KA/B | A/B Testing | Apache Spark | B testing | Causal InferenceSenior-level Full TimeGurugram, India1d ago
-
GCP Data Engineering Bangalore INR 2800K-4000KApache Spark | Cloud platform | ETL | Google Cloud | Google Cloud PlatformSenior-level Full TimeBangalore, Karnataka, India1d ago
-
Senior-level Full TimeBengaluru, KA, India1d ago
-
Snowflake & DBT Expert INR 1500K-2500KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | CI/CDSenior-level Full TimeNoida, UTTAR PRADESH, India1d ago
-
Senior-level Full TimeBangalore1d ago
-
Lead - Data Scientist INR 4000K-5449KCalculus | Constraint Optimization | Cross-validation | Database Schema | Database Schema DesignSenior-level Full TimeBengaluru, India1d ago
-
Mid-level Full TimeIndia, Telangana, Hyderabad1d ago
-
GCP Data Engineer Lead INR 2000K-2500KApache Airflow | BigQuery | CI/CD | Cloud Composer | Cloud FunctionsSenior-level Full TimeHyderabad, //TS, India1d ago
-
Access Control | Apache Airflow | Auditability | Azure | Change Data CaptureCollaborative environment | Documentation and architecture diagram creation support | Flexible contract engagement | Fully remote | Knowledge sharing cultureSenior-level Contract Full TimeIndia R1d ago