GCP BigQuery Data Engineer
Tasks
- Automate data solution deployment
- Build and optimize BigQuery data warehouses
- Build data pipelines with Cloud Composer Dataflow and PubSub
- Design scalable data pipelines
- Develop ETL and ELT workflows
- Enforce data security and compliance in GCP
- Ensure data quality consistency security and governance
- Implement CI/CD processes
- Implement data modeling for reporting
- Ingest structured semi structured and streaming data
- Monitor troubleshoot and enhance data platform performance
- Optimize BigQuery query performance and cost
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Airflow | Batch Processing | BigQuery | CI/CD | Cloud Composer | Cloud Functions | Cloud Run | Cloud Storage | Cloud platform | Data Governance | Data Migration | Data Modeling | Data Quality | Data Security | Data Warehousing | Data integration | Dataflow | Dataproc | ELT | ETL | Git | Google Cloud | Google Cloud Platform | PubSub | Python | Query Optimization | Query Tuning | Real Time | Real-time Processing | SQL | SQL Query Optimization | SQL query | Shell Scripting | Snowflake Schema | Star Schema | Terraform | Time processing
Education
Roles
Related jobs
-
Senior-level Full TimeHyderabad, India5h ago
-
Senior Security Software Engineer ID80139 INR 2000K-4800KAWS | Anthropic | CI/CD | FastAPI | Infrastructure as CodeDedicated budget for education | Dedicated budget for wellness | Legal presence in India | Local connection | Periodic meet upsSenior-level Full TimeKolkata, India5h ago
-
Senior Security Software Engineer ID80139 INR 2000K-4800KAWS S3 | Anthropic API | CI/CD | Drift Detection | FastAPIGrowth education budget | Innovative projects | Local connection | Periodic meet ups | Remote workSenior-level Full TimeMumbai, India5h ago
-
Senior Security Software Engineer ID80139 INR 2000K-4800KAWS | Anthropic API | CI/CD | FastAPI | Infrastructure as CodeDedicated budgets for growth | Education budget | Global clients | Innovative projects | Local connectionSenior-level Full TimeChennai, India5h ago
-
Senior Security Software Engineer ID80139 INR 2000K-4800KAWS | Anthropic | CI/CD | Cloud Security | Drift DetectionGrowth education budget | Innovative projects | Local connection | Periodic meet ups | Remote workSenior-level Full TimeJaipur, India5h ago
-
Senior Security Software Engineer ID80139 INR 2000K-4800KAWS S3 | Anthropic API | CI/CD | Drift Detection | FastAPIEducation budget | Growth budget | Innovative projects | Local connection | MeetupsSenior-level Full TimeAhmedabad, India5h ago
-
Senior Security Software Engineer ID80139 INR 2000K-4800KAWS S3 | Anthropic API | CI/CD | Drift Detection | FastAPIEducation budget | Growth budget | Innovative projects | Periodic team meetups | Remote workSenior-level Full TimeNoida, India5h ago
-
Senior Security Software Engineer ID80139 INR 2000K-4800KAWS | AWS S3 | Anthropic API | CI/CD | Drift DetectionEducation budget | Growth budget | Local connection | Modern technology projects | Periodic meet upsSenior-level Full TimeJalalabad, India5h ago
-
Senior Security Software Engineer ID80139 INR 2000K-4800KAWS | Anthropic API | CI/CD | Drift Detection | FastAPIGrowth education budget | Innovative projects | Local legal compliance in India | Local team connection | Remote workSenior-level Full TimeIndore, India5h ago
-
Senior Security Software Engineer ID80139 INR 2000K-4800KAWS | Anthropic | CI/CD | FastAPI | Infrastructure as CodeBudgets for growth | Education budget | Innovative projects | Local connection | Remote workSenior-level Full TimeTrivandrum, India5h ago
-
Senior Security Software Engineer ID80139 INR 2000K-4800KAWS | AWS S3 | Anthropic API | CI/CD | Cloud SecurityLocal connection | Remote workSenior-level Full TimeNew Delhi, India5h ago
-
Senior Security Software Engineer ID80139 INR 2000K-4800KAWS | Anthropic API | CI/CD | Drift Detection | FastAPIBudget for growth | Education support | Innovative projects | Legal compliance India | Local connectionSenior-level Full TimeHyderabad, India5h ago
-
Senior Security Software Engineer ID80139 INR 2000K-4800KAWS | Anthropic API | CI/CD | Drift Detection | FastAPIDedicated budgets for growth | Education budget | Innovative projects | Local team connection | MeetupsSenior-level Full TimePune City, India5h ago
-
Senior Security Software Engineer ID80139 INR 2000K-4800KAWS | Anthropic API | CI/CD | Cloud Security | FastAPIEducation budget | Growth budget | Innovative projects | Local team connection | Remote workSenior-level Full TimeBangalore North, India5h ago
-
Senior Security Software Engineer ID80139 INR 2000K-4800KAWS | Anthropic API | CI/CD | Drift Detection | FastAPIBudgets for education | Budgets for wellness | Innovative projects | Local connection | Periodic meet upsSenior-level Full TimeCoimbatore South, India5h ago
-
Senior Security Software Engineer ID80139 INR 2000K-4800KAWS | Anthropic | CI/CD | Cloud Drift Detection | Drift DetectionDedicated budgets for growth | Education support | Innovative projects | Legal presence in India | Local connectionSenior-level Full TimeGurgaon Kty., India5h ago
-
Senior Security Software Engineer ID80139 JPY 8600K-12500KAWS | Anthropic | CI/CD | Cloud Security | Drift DetectionEducation budget | Growth budget | Innovative projects | Local connection | Periodic team meet upsSenior-level Full TimeKochi, India5h ago
-
Senior-level Full TimeBangalore, Karnataka5h ago
-
Data Engineer INR 2000K-2700KAWS Redshift | Agile | Azure DevOps | Azure Synapse | Azure Synapse AnalyticsHybrid workingMid-level Full TimeIndia R5h ago
-
Snowflake Developer INR 1500K-2200KAgile | Automated Deployment | CI/CD | Data Ingestion | Data LakeSenior-level Full TimeIN-HR-Gurgaon6h ago
-
Senior-level Full TimeIN-TN-Chennai6h ago
-
DE&A - AIML - Data Science - Machine Learning INR 2500K-5000KAI Agents | AWS | Azure | CI/CD | Cloud ComputingSenior-level Full TimeIndia6h ago
-
Practice Customer Engineer, Data Analytics INR 1500K-3000KApache Spark | Batch Processing | Big Data | C++ | Cloud platformSenior-level Full TimeBengaluru, Karnataka, India; Mumbai, Maharashtra, India7h ago
-
Staff Software Engineer, AI Garage INR 2500K-5000KAI Evaluation | Agentic AI | Artificial Intelligence | C plus plus | C#Senior-level Full TimeHyderabad, Telangana, India7h ago
-
Senior-level Full TimeBangalore, Karnataka, India8h ago