GCP Data Engineer
Tasks
- Automate and monitor data workflows with Airflow or Cloud Composer
- Collaborate with data analysts BI developers and product owners
- Create modular data models with dbt
- Design and develop data integration pipelines
- Develop Python and SQL code for ingestion transformation validation and tuning
- Implement BigQuery partitioning clustering and query optimization
- Implement data quality checks and testing strategies
- Ingest structured and semi structured data into cloud data warehouse
- Maintain engineering best practices and reference implementations
- Perform peer code reviews and mentor junior engineers
- Transform raw data into curated datasets
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Apache Kafka | CI/CD | Cloud Composer | Cloud PubSub | Clustering | DBT | Data Governance | Data Modeling | Data Quality | ELT | ETL | Git | Google BigQuery | Google Cloud | Google Cloud PubSub | Kafka | Kanban | Partitioning | Python | Query Optimization | SQL | Scrum
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Lead Database Engineer INR 1500K-3000KAudit Logging | Azure Data | Azure Data Factory | Azure Database | Azure Database MigrationSenior-level Full TimePune City, India3h ago
-
Senior-level Full TimePune, Maharashtra, India5h ago
-
Data Ingestion Engineer (ADF+Dbt+Snowflake) INR 1500K-2000KAPI Integration | Azure Data | Azure Data Factory | DBT | Data FactoryMid-level Full TimePune, MH, India5h ago
-
Mid-level Full TimeBengaluru, Karnataka, India R6h ago
-
Senior-level Full TimePune, Maharashtra, India6h ago
-
Assistant Manager INR 1500K-2500KAirflow | BigQuery | Cloud Composer | Cloud Dataproc | Cloud StorageMid-level Full TimePune, Maharashtra, India6h ago
-
Mid-level Full TimeChennai, Tamil Nadu, India R6h ago
-
Applied AI/ML Engineer INR 2000K-3000KAgentic Systems | Bias Mitigation | Decision Trees | Evaluation Frameworks | Fallback mechanismsMid-level Full TimeBengaluru, Karnataka, India6h ago
-
Mid-level Full TimeNoida, Uttar Pradesh, India R6h ago
-
AWS Data Engineer INR 1500K-2500KAWS | AWS Glue | Amazon Athena | Amazon EMR | Amazon S3Hybrid workMid-level Full TimeBengaluru, Karnataka, India R7h ago
-
EAI Software Engineer INR 1800K-2500KAPI Gateway | APIs | Agile | ArgoCD | CI/CDOn site work 4 days per week | Relocation N/AMid-level Full TimeHyderabad, India7h ago
-
Software Engineer III-Java, Kafka/Streams INR 2000K-3000KAgile | Application Resiliency | CI/CD | Data Visualization | JavaSenior-level Full TimeMumbai, Maharashtra, India7h ago
-
Software Engineer II - AI & Agentic Automation INR 1200K-2500KAI Search | AWS | AWS CDK | AWS CloudFormation | AWS environmentsMid-level Full TimeBangalore, Karnataka, India7h ago
-
Software Engineer INR 1200K-2500KAlgorithms | Artifactory | Azure DevOps | Bitbucket | CI/CDEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India8h ago
-
IN|KDN KRC|Digital Audit|Assistant Manager – Tech - BLR INR 1200K-2000KAlteryx | Automation | Data Governance | Data Quality | Data SecurityMid-level Full TimeBangalore, Karnataka, India8h ago
-
Azure Lead Data Engineer INR 1500K-2500KAzure | Azure Data | Azure Data Factory | Azure Data Lake | Azure FunctionsSenior-level Full TimeNoida, Uttar Pradesh, India8h ago
-
Google Data Engineer INR 1500K-2500KAgile | BigQuery | CI/CD | Cloud Data | Cloud Data FusionAccidental life insurance | Certifications sponsored | Group insurance | Group life insurance | Health insuranceSenior-level Full TimeHyderabad, Telangana, India8h ago
-
Assistant Manager-Business Analytics INR 1300K-2200KAI Agents | API Integration | BigQuery | Cloud platform | Data LakeMid-level Full TimeAhmedabad, Gujarat, India8h ago
-
Mid-level Full TimeGurugram, Haryana, India9h ago
-
Lead Assistant Manager INR 1500K-2500KAWS Redshift | Advanced SQL | Airflow | Apache Spark | Azure DataSenior-level Full TimeGurugram, Haryana, India9h ago
-
Data Engineer II INR 1000K-1500KBigQuery | Browser Developer Tools | CSS | Consent Mode | Developer toolsMid-level Full TimeBangalore, Karnataka, IN9h ago
-
Airflow | Azure Data | Azure Data Factory | Azure DevOps | Azure FunctionsCareer development opportunities | Employee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India9h ago
-
Specialist, Business Analytics INR 650K-900KDBT | Domo | FinOps | Git | GitHubRelocation assistance within countryMid-level Full TimeMumbai, MH, IN9h ago
-
Senior / Lead Data Engineer - Azure Databricks INR 2000K-3000KAzure Databricks | Azure DevOps | CI/CD | Conformed Dimensions | Data LineageSenior-level Full TimeHyderabad, TS, India10h ago
-
Google Cloud Engineer INR 1500K-2500KBigQuery | Cloud Data | Cloud Data Fusion | Cloud SQL | Cloud StorageAccidental life insurance | Company-sponsored certifications | Global client projects | Group health insurance | Group life insuranceSenior-level Full TimeHyderabad, Telangana, India10h ago