GCP Data Engineer _Senior Consultant
Bengaluru, KA, India
INR 1500K-2500K (estimate) Senior-level Full Time
Tasks
- Build data pipelines for batch processing
- Build data pipelines for streaming processing
- Collaborate with stakeholders using written and verbal communication
- Develop BigQuery pipelines
- Develop data ETL pipelines
- Develop data extraction cleanup code in Java
- Ensure pipeline performance scalability availability reliability security
- Handle JSON data
- Handle XML data
- Implement ETL pipelines in Google Cloud Platform
- Integrate PubSub for data ingestion
- Tune SQL queries
- Write Apache Airflow DAGs
- Write SQL queries
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Airflow | Batch Processing | BigQuery | Cloud Composer | Cloud platform | Data Engineering | Data Fusion | Data pipeline | ETL | Google Cloud | Google Cloud Platform | JSON | Java | PubSub | PubSub Lite | Python | SQL | SQL Tuning | Streaming | XML
Education
N/A
Related jobs
-
API Design | AWS | Azure | Cloud Architecture | Cloud platformContinuous learning | Inclusive collaborative culture | Performance bonuses | Professional development | Remote friendly work environment within IndiaSenior-level Full TimeIndia3h ago
-
Asynchronous processing | Backend architecture | CI/CD | Caching | Computer VisionCareer growth opportunities | Collaborative and inclusive culture | High ownership and autonomy | Opportunity to work on cutting-edge AISenior-level Full TimeIndia3h ago
-
Software Engineer – AI & Automation - Senior Manager INR 3000K-5000KAPI Development | Agent workflow | Cost Optimization | Guardrails | Hallucination mitigationEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeBangalore, India8h ago
-
Senior-level Full TimeIndia Office13h ago
-
Senior Software Engineer (Java Full Stack /AWS) INR 2775K-4200KAWS | AWS Security | Agile | CI/CD | Container OrchestrationFamily well-being benefits | Health benefits | Paid time offSenior-level Full TimeHyderabad, India17h ago
-
Data Engineer INR 2000K-3000K.NET | API Development | Data Ingestion | Data Modeling | Data TransformationSenior-level Full TimeBangalore North, India18h ago
-
Sr. Data Engineer INR 1500K-2400KAWS Glue | Amazon S3 | Apache Airflow | Apache Flink | Apache KafkaSenior-level Full TimeBangalore North, India18h ago
-
Bash | Data Pipelines | Distributed Systems | Docker | GCPAccess to cutting-edge technologies | Autonomy | Bonus opportunities | Collaborative culture | Distributed first work environmentSenior-level Full TimeIndia R18h ago
-
Specialist, Data Management & Quantitative Analysis II INR 1400K-2000KAmazon S3 | CI/CD | Dashboards | Data APIs | Data VisualizationFlexible benefits | Paid time off | Paid volunteer time | Training and demos | Wellbeing programsMid-level Full TimePune, MH, India18h ago
-
Senior Clinical Data Engineer INR 2000K-2500K21 CFR Part 11 | Audit trails | CDISC | CFR Part 11 | Dashboard DevelopmentSenior-level Full TimeBangalore, Karnataka, India19h ago
-
GenAI Engineer INR 2500K-4500KAWS Bedrock | Amazon Web Services | Azure OpenAI | ChromaDB | Efficient Fine TuningSenior-level Full TimeIN-TN-Chennai19h ago
-
Senior-level Full TimeIN-AP-Hyderabad19h ago
-
Senior Software Engineer INR 1500K-2500KData Ingestion | Data Lineage | Data Quality | Data Scalability | Data TransformationSenior-level Full TimeIN-KA-Bangalore19h ago
-
Senior-level Full TimeIN-MH-Pune19h ago
-
Senior Software Engineer INR 2500K-3380KAPI Development | AWS | Apache Airflow | Apache Hive | Apache SparkSenior-level Full TimeBengaluru, Karnataka, India19h ago
-
Lead Data Engineer #3194 INR 3000K-5000KAccess Control | Code Repository | Compute Optimization | Data Governance | Data LineageFlexible working hours | Global collaboration | Learning and development programs | Opportunity for advanced tools and technologies | Performance rewards and recognitionSenior-level Full TimeChennai, India19h ago
-
Lead AI/ML Engineer INR 3000K-5000KAzure | Data Normalization | Data Preprocessing | Data cleaning | Deep learningCar lease | Career advancement opportunities | Certification programs | Corporate NPS | Dental insuranceSenior-level Full TimeBangalore, Karnataka, India19h ago
-
Assistant Manager - Cloud & AI Architect INR 3000K-5000KAI Foundry | Agentic AI | Ansible | Artifact management | AzureSenior-level Full TimeBangalore, Karnataka, India19h ago
-
Assistant Manager - Cloud & AI Architect INR 3000K-5000KAI Foundry | Agent Builder | Ansible | Artifact management | AzureClient advisory | Executive presentations | Team mentoringSenior-level Full TimeBangalore, Karnataka, India19h ago
-
Assistant Manager - Cloud & AI Architect INR 3000K-5000KAI Foundry | Agent Orchestration | Ansible | Artifact management | AzureBusiness development | Client advisory | Client relationship management | Growth mindset | MentorshipSenior-level Full TimeBangalore, Karnataka, India19h ago
-
Assistant Manager - Cloud & AI Architect INR 3000K-5000KAI Foundry | Agentic AI | Ansible | Artifact management | AzureSenior-level Full TimeBangalore, Karnataka, India20h ago
-
Databricks Developer / Data Architect INR 1500K-2500KAWS | Apache Airflow | Apache Spark | Azure | Azure DataSenior-level Full TimePune, Maharashtra, India20h ago
-
Data Architect - Offshore INR 3000K-4000KAzure Data | Azure Data Lake | Azure Data Lake Storage | Azure SQL | Data ArchitectureSenior-level Full TimePune, Maharashtra, India20h ago
-
SQL,GCP/Consultant Specialist INR 500K-1500KAWS | Agile Scrum | Backup and Recovery | Cloud Computing | Cloud Platform (GCPMid-level Full TimePune, Maharashtra, India R20h ago
-
C# | C++ | Compilers | Consistency | Database InternalsEntry-level Full TimeBengaluru, Karnataka, India20h ago