GCP Data Engineer- Lead Consultant
Tasks
- Build data pipelines ingest data
- Design Data Lake and Data Warehouse architectures
- Design data ecosystem on GCP
- Gather analyze model document requirements
- Implement caching strategies
- Model data from multiple sources
- Monitor system performance identify anomalies
- Optimize storage partitioning compression indexing
- Perform root cause analysis
- Train and mentor Data Engineers
- Tune queries resolve bottlenecks
Perks/Benefits
- Buddy support
- Certificate training programs
- Charity donation opportunities
- Community webinars
- Flexible working hours
- Online onboarding
- Remote work option
- Unlimited Udemy access
- Upskilling support
- Well being and health support
Skills/Tech-stack
Apache Airflow | BigQuery | Caching | Cause analysis | Cloud Functions | Cloud Storage | Cloud platform | Compression | Confluence | DBT | Data Modeling | Data Partitioning | Dataform | ELT | ETL | Git | Google Cloud | Google Cloud Platform | Indexing | Jira | Monitoring | NoSQL | Python | Query Optimization | Root Cause Analysis | Root cause | SQL
Education
N/A
Roles
Related jobs
-
Automation and AI Solutions Lead INR 2500K-3500KAWS AgentCore | AWS Bedrock | Agent systems | Automation | CI/CDFlex My Way | Flexible vacation | Headspace app access | Hybrid work model | Mental health daysSenior-level Full TimeIndia, Hyderabad, Telangana R14h ago
-
Data Engineer INR 1500K-2525KAPI Integration | Apache Airflow | Azure Data | Azure Data Factory | Azure SynapseMid-level Full TimeIndia - Hybrid R23h ago
-
API performance | API reliability | API scalability | AWS Glue | AWS LambdaAI training | Community forums | Laptop provided | Medical insurance | MentorshipEntry-level Full TimeIndia R1d ago
-
AWS | Anthropic API | C++ | CI/CD | DockerFully remote | Healthcare coverage | No Internal Meetings Fridays | Paid sabbatical | Paid time offSenior-level Full TimeIndia R1d ago
-
Automation and AI Solutions Lead INR 2500K-3500KAWS Bedrock | Agent systems | Amazon AgentCore | Async Programming | CI/CDFlexible vacation | Headspace access | Hybrid work | Mental health days | Retirement savingsSenior-level Full TimeIndia, Bengaluru, Karnataka R1d ago
-
APIs | Agile | Analytics | Automation | Cost analysisComprehensive healthcare | Flexible time off | Retirement plan | Support for working parents | Tuition reimbursementMid-level Full TimeHA3-Gurugram - DLF Cyber City, India R1d ago
-
Senior Platform Engineer (AI Integration) INR 2800K-4000KAWS | Auto Scaling | Bash | CI/CD | Cloud loggingHealth insurance | Personal accident insurance | Term life insurance | Work on-call rotationSenior-level Full TimePune, Maharashtra, India (Hybrid) R2d ago
-
Principal Specialist- Data Science Customer Programs INR 2400K-4000KAWS | Apache Spark | Azure | Data Architecture | Data GovernanceHybrid workSenior-level Full TimeIN-KA-BENGALURU-NORTHGATE ~ Sy No 2/2 Venkatala … R2d ago
-
Principle – Knowledge Governance & GenAI Enablement. INR 2000K-3465KAgent Frameworks | Change Management | Data Governance | Data Lineage | Data ModelingFlexible work environment | Internal mobility | Volunteering opportunities | Well-being | Work-life balanceSenior-level Full TimeKA Remote, India R2d ago
-
Principal Software Engineer, Data Platform INR 3000K-4500KAPI Design | ClickHouse | Cost Optimization | DBT | Data ArchitectureSenior-level Full TimeIndia Bangalore Remote R3d ago
-
Resident Solutions Architect INR 3000K-3900KAWS | Apache Spark | Azure | Big Data | Big data architectureTravel for onsite engagementsSenior-level Full TimeRemote - India R3d ago
-
APIs | Access Control | Amazon S3 | Anomaly Detection | Apache SparkFully remote work flexibilitySenior-level Full TimeIndia R3d ago
-
AI Engineer INR 1340K-1680KAnomaly Detection | Automated testing | Data Contracts | Data Quality | Entity ResolutionMid-level Full TimeBangalore, India R4d ago
-
AI Engineer INR 2000K-4500KAI SDK | AWS | Accelerate | Autogen | AzureDisconnect week | Flexible working hours | Health insurance | Learning budget | MacBookSenior-level Full TimeIndia - Remote R4d ago
-
Principal Software Engineer, Data Platform INR 3100K-4590KAPI Design | ClickHouse | DBT | Data Architecture | Data CatalogsSenior-level Full TimeIndia Remote R4d ago
-
AWS | Anthropic | CI/CD | Chroma | DockerDirect collaboration | Flexible work environment | Fully remote | Growth opportunity | Work on cutting edge AI automation projectsSenior-level Full TimeIndia - Remote R4d ago
-
Copilot Studio / Agentic AI Engineer (Remote) INR 2000K-4800KAI Services | API Integration | Agent Orchestration | Agile | Autonomous workflowsFull-time employment | Remote workSenior-level Full TimeMaharashtra, Pune, India R5d ago
-
Junior GenAI Developer INR 360K-420KAWS | Agent workflows | Amazon Bedrock | Anthropic APIs | ChromaCertification programs | Health insurance | Internal mobility | Internship opportunities | Language coursesEntry-level Full TimeAll Cities, India R5d ago
-
Junior GenAI Developer INR 360K-420KAWS | Embeddings | Git | Hybrid search | LLMCertification programs | Health insurance | Language courses | Mentorship | Professional developmentEntry-level Full TimeAll Cities, India R5d ago
-
Cloud Database Engineer INR 1500K-2300KAlwaysOn Availability | AlwaysOn availability groups | Amazon Web Services | Automation | Availability GroupsFlexible schedule | Hybrid work model | Remote work flexibilityMid-level Full TimeIndia - Pune R5d ago
-
Computer Scientist II (Python) INR 1800K-2500KAWS | Asynchronous programming | Azure | CI/CD | CrewAIMid-level Full TimeNoida, India R5d ago
-
Data Engineering Developer - Assistant Manager INR 1500K-3000KAccessibility | Agile | Automated testing | Azure | CI/CDFlexible work/life support | Paid volunteer days | Work from OfficeMid-level Full TimeBangalore, India R5d ago
-
Senior Data Engineering Developer - Manager INR 3000K-4000KAgile | Automated testing | Azure | CI/CD | ContainerizationEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeBangalore, India R5d ago
-
Senior-level Full TimeIND - Remote - Bangalore Based … R5d ago
-
Lead Data Quality Governance and Strategy Engineer INR 1985K-3142KBusiness Intelligence | Data Governance | Data Modeling | Data Quality | Data StandardsHealth insurance | Hybrid work model | Life insurance | Paid time off | Pension/retirement benefitsSenior-level Full TimeHyderabad, India R6d ago