Senior Data Engineer - GCP
Tasks
- Build data lakes
- Build data warehouses
- Create technical documentation
- Design data pipelines on GCP
- Develop batch data processing
- Develop real-time data processing
- Implement CI/CD for data pipelines
- Implement DevOps practices for data pipelines
- Improve data quality
- Maintain datasets for analytics and reporting
Perks/Benefits
- N/A
Skills/Tech-stack
API Integration | Agile | Airflow | Apache Spark | BigQuery | CI/CD | Cloud Composer | Cloud Dataflow | Cloud Dataproc | Cloud Functions | Cloud Run | Cloud Storage | Cloud platform | Data Modeling | Docker | ELT | ETL | GitHub Actions | Google Cloud | Google Cloud Platform | Infrastructure as Code | Jenkins | Kubernetes | NumPy | Pandas | Pub/Sub | PySpark | Python | REST | SQL | Scrum | Snowflake Schema | Star Schema | Terraform | “as-code”
Education
Bachelor of Engineering | Bachelor of Engineering in Computer Science | Bachelor of Science | Bachelor of Science in Computer Science | Bachelor of Science in Management Information Systems
Roles
Related jobs
-
Senior Cloud Engineer - AI-ML Platform INR 2500K-5000KAccess Control | Amazon Web Services | Apache Kafka | Azure DevOps | CloudFormationInclusion and belongingSenior-level Full TimeBangalore, Karnataka, IN, 56010016h ago
-
Data Quality Engineer INR 3000K-4000KAlerting | Apache Airflow | Apache Spark | Automated testing | Cause analysisChildcare services | Employee assistance program | Medical insurance | Paid time offSenior-level Full TimeBangalore, Karnataka, India16h ago
-
AI Assisted Development | Algorithms | Amazon S3 | Apache Iceberg | Cloud ComputingFlexible work schedule | Remote work optionsSenior-level Full TimeHyderabad, India R17h ago
-
Senior Consultant_Python, Java AI / ML Engineer INR 2500K-4500KAPI Gateway | AWS | AgentCore) | Amazon Bedrock | AngularSenior-level Full TimeHyderabad, IN, 500081 R17h ago
-
ML Engineer INR 2400K-3000KClassification | Clustering | Computer Vision | Deep learning | DevOpsAnnual leave | Digital learning platforms | Employee assistance program | Flexible working arrangements | Learning & development opportunitiesMid-level Full TimeBangalore, IN17h ago
-
AWS | Agile | Azure | CI/CD | Cloud platformFully remote | Professional growthSenior-level Full TimeIndia R17h ago
-
Lead Software Engineer - Machine Learning INR 5000K-6000KAPI Design | Data pipeline | Distributed Systems | MLOps | Machine LearningSenior-level Full TimeChennai, TN, India17h ago
-
Senior-level Full TimeHyderabad, IND-TG, India21h ago
-
ESI Digi Tech GV ATLAS 170502 INR 1900K-5000KAI Agents | API Integration | AWS | Azure | Azure OpenAISenior-level Full TimeHyderabad, IND-TG, India21h ago
-
Analytics Engineer INR 1500K-2500KAzure | Azure Blob | Azure Blob Storage | Azure Data | Azure Data FactoryMid-level Full TimeMumbai Central Avenue, India22h ago
-
Data Engineering INR 1500K-2500KAI Search | Access Control | Amazon Redshift | Anomaly Detection | Audit LoggingSenior-level Full TimeBangalore, IN22h ago
-
Senior Software Engineer- Python, Data Engineer INR 1753K-3380KAWS | Agile | Analytics engines | Azure | Azure DevOpsContinuing education program | Continuous learning | Family-friendly perks | Generous time off | Health care coverageSenior-level Full TimeIN - AHMEDABAD, India22h ago
-
Data Engineer INR 1500K-2100KAWS | Agile | Apache Airflow | CI/CD | Data GovernanceHybrid work environment | Work-life flexibilityMid-level Full TimeBengaluru, India R22h ago
-
Senior-level Full TimeBengaluru, Karnataka, India22h ago
-
MTS-1 Machine Learning Engineer INR 1500K-2500KAWS | Apache Flink | Apache Hadoop | Apache Spark | AzureMid-level Full TimeBangalore, India22h ago
-
MTS-2 Machine Learning Engineer INR 3600K-5400KAWS | Apache Flink | Apache Hadoop | Apache Spark | Big DataSenior-level Full TimeBangalore, India22h ago
-
Access Control | Agile Development | Data Ingestion | Data Transformation | Dataset ManagementHybrid work model | Production Release SupportSenior-level Full Time111443-IND-HYDERABAD-INTL HYD WF CENTRE BLK B8 …22h ago
-
EAI Software Engineer INR 1800K-2800KAPI Gateway | ArgoCD | CI/CD | Cloud Functions | Cloud RunOn-site work 4 days a week | Relocation support (if applicable)Mid-level Full TimeHyderabad, India1d ago
-
Forward Deployed Engineer, Data & AI INR 2000K-2800KCortex Code | Data Engineering | Databricks | ETL | GeminiMid-level Full TimeBangalore1d ago
-
Senior Python Data Engineer INR 3000K-4000KAWS | Apache Airflow | Automated testing | Azure | CI/CDCertification programs | Health insurance | Internal mobility | Internship opportunities | Language coursesSenior-level Full TimeAll Cities, India R1d ago
-
Senior-level ContractShaikpet, India1d ago
-
Senior-level Full TimeHyderabad, India1d ago
-
DevOps Engineer - Jenkins to Harness Migration INR 2000K-2700KAWS | Ansible | Cassandra | Chef | DockerMid-level Full TimeBangalore1d ago
-
Data Engineer II INR 2000K-3000KAWS | Amazon Kinesis | Amazon Redshift | Apache Airflow | Apache BeamCareer growth opportunities | Complimentary games | Family Leaves | Healthcare coverage | Mental well-being supportSenior-level Full TimeLocations: Hyderabad, Telangana, India1d ago
-
Advanced Engineer-AI/ML INR 2500K-4680KAI orchestration | API Integration | ASR | AWS | Action modelsEmployee discounts | Training opportunities | Tuition reimbursement | Wellness benefitsSenior-level Full TimeBangalore - Karnataka, India - Kalyani …1d ago