GCP Data Engineer- Senior Consultant
Tasks
- Build and develop data pipelines
- Design GCP data ecosystem
- Gather analyze model document requirements
- Implement partitioning, compression, indexing
- Ingest data from databases APIs streaming sources
- Model data from multiple sources
- Monitor system performance and analyze anomalies
- Optimize data storage architectures data lakes data warehouses
- Perform root cause analysis
- Train mentor junior data engineers
- Troubleshoot data processing storage infrastructure
- Tune queries optimize performance
Perks/Benefits
- Certificate training programs
- Charity donation opportunities
- Community webinars
- Flexible working hours
- Knowledge sharing sessions
- Learning platform access
- Mentor/Buddy program
- Online onboarding
- Remote work
- Udemy access
- Upskilling support
- Well being and health activities
Skills/Tech-stack
Airflow | BigQuery | Caching | Cloud Functions | Cloud Storage | Cloud platform | Compression | Confluence | DBT | Data Lakes | Data Modeling | Data Warehouses | Dataform | Distributed file systems | ELT | ETL | File systems | Git | Google Cloud | Google Cloud Platform | Indexing | Jira | NoSQL | Partitioning | Performance Tuning | Python | Query Optimization | SQL
Education
N/A
Roles
Related jobs
-
Staff Engineer, .Net Core (Optimizely CMS 12, and React) INR 1500K-2400K.NET | .Net Framework | ASP.Net Core | Agile | AuthenticationSenior-level Full TimeRemote, India R1d ago
-
Associate, DataX INR 900K-1000KCI/CD | Data Preprocessing | Embeddings | Experimentation | KubernetesComprehensive healthcare | Flexible time off | Hybrid work | Retirement plan | Tuition reimbursementMid-level Full TimeM11 - Commers III, 43, 44 … R1d ago
-
Senior Data Engineer with Azure (ADF/Fabric/Synapse), SQL, Data modeling, ETL/ELT, Python/PySpark INR 3000K-4000KAWS | Apache Airflow | Azure Data | Azure Data Factory | Azure SynapseAgile collaboration | Hybrid work schedule | MentorshipSenior-level Full TimeIND-Pune-Smartworks, India R1d ago
-
Staff Software Engineer - Enterprise AI INR 2500K-5000KAWS | Apache Spark | Azure | Babel | Fine TuningCareer development | Employee resource groups | Flexible work from home | Generous PTO | Paid volunteer timeSenior-level Full TimeIndia-Bangalore-Remote R1d ago
-
Principal Analytics Engineer (Power BI Development) INR 3000K-4000KAgile | CI/CD | Cloud Computing | DAX | Data GovernanceEmployee programs | Local events | Medical insurance | Modern office spaces | Provident fundSenior-level Full TimeIndia Remote R1d ago
-
Advanced Engineer: ML, LLM, NLP, RAG INR 2500K-3465KAWS | Audio Processing | Azure | CI/CD | Cloud platformEmployee discounts | Flexible work environment | Remote work options | Training opportunities | Tuition reimbursementSenior-level Full TimeIN Bangalore Sattva Knowledge Court Bdg … R1d ago
-
Data Engineer (MS) (Remote) INR 2040K-3380KCI/CD | Data Transformation | Data Validation | Date normalization | ETLMentorship opportunities | Professional growth | Remote workSenior-level Full TimeMaharashtra, Pune, India R1d ago
-
AI / LLM Integration Engineer (Remote) INR 1800K-2800KAPI Integration | Anthropic SDK | Async APIs | Benchmarking | Confidence scoring100 percent remote | Collaborative culture | Inclusive team culture | Professional growthMid-level Full TimeMaharashtra, Pune, India R1d ago
-
ML / LLM Engineer (Remote) INR 2500K-3000KAmazon Web Services | Azure | Classification | Feature Engineering | Language ModelsRemote workMid-level Full TimeMaharashtra, Pune, India R1d ago
-
Senior Analytics Engineer INR 3000K-4000KAirflow | Auditability | Compliance | DBT | Data GovernanceCasual leave | Employee referral bonuses | Employee resource groups | Group medical coverage | Life insuranceSenior-level Full TimeHyderabad R1d ago
-
Apache Spark | Data Modeling | Data Quality | Data Visualization | Data WarehousingAccessibility support | Career growth | Fully remote | Inclusive workplace | Work-life balanceSenior-level Full TimeIndia R1d ago
-
Data Operations Engineer INR 2040K-3380KApache Airflow | Data Pipelines | Data Refresh | Data Warehousing | Data pipelineEmergency incident response support | On-call rotationSenior-level Full TimeBengaluru, INDIA, India R2d ago
-
Anomaly Detection | Data Modeling | Data Pipelines | Docker | JavaScript100 percent remote | Autonomous work environment | Career growth opportunities | Flexible work environment | International team cultureMid-level Full TimeIndia R2d ago
-
Machine Learning Engineer - 5 INR 2500K-4500KAWS | AWS SageMaker | Airflow | Argo Workflows | Azure Machine LearningSenior-level Full TimeBangalore, India R2d ago
-
Computer Scientist ( Java Backend ) INR 3000K-4725KApache Kafka | CI/CD | Distributed Systems | Docker | Event DrivenSenior-level Full TimeBangalore, India R2d ago
-
Business Technology Analyst INR 3000K-4000KAWS | AWS Athena | AWS Glue | Airflow | Amazon RedshiftHeadspace access | Hybrid work | Mental health days | Retirement savings | Tuition reimbursementSenior-level Full TimeIndia, Hyderabad, Telangana R2d ago
-
Software Engineer INR 1500K-2362KAWS | Apache Flink | Apache Spark | Linux | PythonHybrid work | Remote work | Work-life balanceMid-level Full TimeRemote (IND), India R2d ago
-
Associate Software Engineer INR 950K-2000K.Net Core | ASP.NET | Agile | Amazon Web Services | AngularMid-level Full TimeRemote Bangalore-Baroda, India R2d ago
-
SASE Engineer/ Senior SASE Engineer INR 2542K-3200KAPI Integration | Azure | BGP | Bash | Cloud interconnect24x7 operational support | Boot camp onboarding | Competitive compensation | Flexible hours | Heavy technical trainingSenior-level Full TimeNoida, India, India (Hybrid) R2d ago
-
Machine Learning Engineer 5 INR 2500K-4500K3D Reconstruction | Adapters | CLIP | Computer Vision | ControlNetSenior-level Full TimeBangalore, India R2d ago
-
Junior GenAI Developer INR 500K-600KAWS | Embeddings | Git | Hybrid search | Language ModelsCertification programs | Health insurance | Internal mobility | Internship opportunities | Language coursesEntry-level Full TimeAll Cities, India R2d ago
-
Junior GenAI Developer INR 500K-600KAWS | Embeddings | Git | Hybrid search | Language ModelsHealth insurance | Language courses | Mentorship | Professional development | Relocation programEntry-level Full TimeAll Cities, India R2d ago
-
Tech Lead - Gen AI with 6+ Years(Remote) INR 2500K-5000KAWS | Chatbot | Computer Vision | Dialogue flow | Distributed ComputingRemote workSenior-level Full TimeBengaluru, KA, India R2d ago
-
Sr. Engineer - Gen AI with 4+ years(Remote) INR 2500K-5000KAWS | Audio Processing | Azure | Computer Vision | Distributed ComputingExtendable contract | Remote workSenior-level Full TimeBengaluru, KA, India R2d ago
-
Software Development Engineer I INR 2139K-4500KCI/CD | Code review | Data Structures | Data Structures and Algorithms | ElasticsearchProfessional development | Remote workSenior-level Full TimeBengaluru, KA, India R2d ago