Data Engineer with GCP
Tasks
- Analyze bottlenecks
- Automate data processing
- Build ETL/ELT pipelines
- Build pipeline monitoring and alerting
- Build reusable data engineering frameworks
- Create database schemas and data models
- Design data storage strategies
- Design scalable data architectures
- Develop high-performance data pipelines
- Ensure data consistency and traceability
- Establish data governance best practices
- Implement batch and streaming data ingestion
- Improve pipeline throughput and processing efficiency
- Optimize SQL queries
- Optimize database performance
- Support AI and analytics workloads
- Troubleshoot production data issues
- Validate data quality
Perks/Benefits
- N/A
Skills/Tech-stack
Batch Processing | BigQuery | Cloud Storage | Cloud platform | Data Governance | Data Modeling | Data Quality | Database optimization | Dataflow | Dataproc | ELT | ETL | Google Cloud | Google Cloud Platform | Indexing | Partitioning | PubSub | SQL | Streaming Data
Education
N/A
Roles
Related jobs
-
BigQuery | CI/CD | Cloud Functions | Cloud Run | Cloud StorageContinuous professional development | Flexible workingMid-level Full TimeHyderabad, Telangana, India R2d ago
-
Analytics Engineer INR 2800K-4200KCI/CD | DBT | Dashboards | Data Quality | DatabricksHealth insurance | Hybrid work model | Mental health support | Paid time off | Transport allowanceSenior-level Full TimeBangalore (Hybrid) R2d ago
-
API | Apache Hadoop | Apache Kafka | Apache Spark | Azure DataHybrid workSenior-level Full TimeBangalore, Karnataka, India R2d ago
-
API | Agile | Apache Hadoop | Apache Kafka | Apache SparkHybrid work | Technical research opportunities | Training supportSenior-level Full TimeBangalore, Karnataka, India R2d ago
-
Apache Airflow | Apache Hadoop | Apache Kafka | Apache Spark | Azure DataHybrid work | Training opportunitiesSenior-level Full TimeBangalore, Karnataka, India R2d ago
-
Senior Software Engineer II (Java Microservices) INR 3000K-4500KAWS | Agile | Apache Kafka | Apache Spark | AzureCareer development | Distributed collaboration | Learning opportunities | Work from Anywhere cultureSenior-level Full TimeIndia R2d ago
-
Senior-level Full TimePune, MH, IN R2d ago
-
AI Agents | AI Data | AI data governance | API Security | Cloud SecurityMid-level Full TimeBengaluru, Karnataka, India R2d ago
-
AWS | AWS Glue | Agile | Amazon S3 | CI/CDSenior-level Full TimeHyderabad, Telangana, India - Remote R2d ago
-
A/B | A/B Testing | AWS | Apache Spark | AzureFlexibility programmes | Hybrid work | Inclusive benefits | MentorshipSenior-level Full TimeBengaluru Millenia, India R2d ago
-
Senior AI and Machine Learning Engineer INR 3000K-4680KConvolutional Neural Networks | Data Mining | Data Modeling | Data Visualization | Decision TreesCareer Development Programs | Flexible work arrangement | Health and wellbeing benefitsSenior-level Full TimeBengaluru, Karnātaka, India R2d ago
-
Senior AI Engineer INR 2500K-5000KAPI Management | AWS | Agile | Application Programming | Application Programming InterfacesSenior-level Full TimeKolkata, West Bengal, India R2d ago
-
Developer, Java,Spark and GCP INR 2771K-4064KApache Hadoop | Apache Spark | Cloud platform | GCP | Google CloudHybrid work | Work-life flexibilitySenior-level Full TimeChennai, India R2d ago
-
Senior Salesforce Data Engineer INR 1800K-3500KAPEX Collections | Agile Scrum | Apex | BigQuery | Bulk APISenior-level Full TimeIN Bangalore Virtual, India R2d ago
-
Sr Engineer, Data Engineering INR 2040K-3900KAlloyDB | Apache Spark | Asset Inventory | Audit Logging | BigLakeHybrid work | In person collaboration time | Work from home flexibility | Work-life flexibilitySenior-level Full TimeBengaluru, India R2d ago
-
Process Data Engineer I - Pharmaceutical Product Development INR 1000K-1986KAPI Integration | AWS | Agile | CI/CD | DBTMid-level Full TimeHyderabad, India R2d ago
-
Senior AI and Machine Learning Engineer INR 3000K-4680KBest practices | Convolutional Neural Networks | Data Mining | Data Modeling | Data VisualizationCareer Development Programs | Flexible work-life balance | Health and wellbeing benefits | Hybrid work scheduleSenior-level Full TimeBengaluru, Karnātaka, India R2d ago
-
Senior Snowflake Engineer INR 2000K-4200KAPI Development | AWS | Apache Airflow | Automated testing | AzureCertification programs | Health insurance | Internal mobility | Language courses | MentorshipSenior-level Full TimeAll Cities, India R3d ago
-
Senior-level Full TimeBangalore, India Office (BANGALORE) R3d ago
-
Mid-level Full TimeBangalore, Karnataka, India R3d ago
-
Data Engineer Consultant Senior INR 3000K-4000KAgile | Alerting | Auditability | Automated testing | AzureBike to work | Career mentorship | Educational assistance | Employee assistance program | Employee discountSenior-level Full TimeBengaluru, KA, India R3d ago
-
Data Engineer Consultant Principal INR 3000K-4000KAccess Control | Agile | Audit and compliance | Auditability | Automated testingBike to work | Career progression mentorship | Educational assistance | Employee assistance programme | Employee discount schemeSenior-level Full TimeBengaluru, KA, India R3d ago
-
AWS | Agile | Apache Spark | Azure | CI/CDEducation and learning support | Generous time off | Professional growth | Remote work | Wellness and lifestyle resourcesSenior-level Full TimeIndia R3d ago
-
Senior Engineer- Fullstack INR 2500K-5140KAPIs | Access Control | Backend Services | Data Access Control | Data ModelingHybrid work model | In-office collaborationSenior-level Full TimeBangalore, Karnataka, India R3d ago
-
Group Data Engineer I INR 1500K-2600KAWS | AWS CloudFormation | Agile | Apache Airflow | Apache SparkSenior-level Full TimeBangalore, Karnataka, India R3d ago