GCP Data Engineer
Tasks
- Build Spark based Lakehouse datasets
- Deliver KPI and business rule validation
- Design star schemas
- Develop Semantic Models in Microsoft Fabric
- Engineer dimensional models
- Ensure data product quality and performance
- Extract business logic from on prem SQL systems
- Implement CI CD templates for data products
- Implement data pipelines
- Modernize SQL Server workloads
- Refactor SSAS logic into semantic layers
- Refactor legacy ETL processes
- Test and monitor data products
- Version control data products
Perks/Benefits
- N/A
Skills/Tech-stack
ADLS Gen2 | Airflow | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | CI/CD | Data Factory | Data Lake Storage Gen2 | Databricks | Dimensional Modeling | Kimball methodology | Lakehouse | Microsoft Fabric | Microsoft Purview | Power BI | PySpark | Python | SQL | SQL Server | SSAS | Semantic Modeling | Spark | Star Schema
Education
N/A
Roles
Related jobs
-
Entry-level InternshipHyderabad, India2h ago
-
Entry-level InternshipHyderabad, India2h ago
-
DTICI_T8_Data_engineer_Manufacturing_Operations INR 1500K-2500KAgile | Apache Spark | Azure | Azure Blob | Azure Blob StorageSenior-level Full TimeBengaluru, Karnataka, India3h ago
-
AWS | Airflow | Apache Spark | Azure | Cause analysisSenior-level Full TimePune, Maharashtra, India3h ago
-
Confluent Kafka Data Engineer INR 1500K-2500KApache Kafka | Apache Spark | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeIN-KA-Bangalore3h ago
-
GEN AI Developer INR 2000K-5000KAgile | Continuous integration | Data Modeling | Generative AI | Language ProcessingSenior-level Full TimeIN-KA-Bangalore3h ago
-
AI Automation Expert INR 2000K-5000KAgentic AI | Azure OpenAI | Confluence | Copilot Studio | Enterprise IntegrationSenior-level Full TimeIN-KA-Bangalore3h ago
-
GCP Data Engineer INR 1500K-2500KAirflow | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeIN-MH-Mumbai3h ago
-
Principal AI Engineer with Java INR 2475K-4800KAI Services | Agent Framework | Agentic AI | Alembic | AutogenEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India4h ago
-
Senior Software Engineer, AI/ML Computer Vision, Google Cloud INR 3000K-5000KC++ | Computer Vision | Data Processing | Debugging | Image classificationSenior-level Full TimeBengaluru, Karnataka, India5h ago
-
Lead Assistant Manager INR 1500K-2800KAccess Control | Caching | Data Governance | Databricks | Databricks SQLSenior-level Full TimeBengaluru, Karnataka, India5h ago
-
Associate Director - Forward Deployed Engineer/AI Engineer INR 1500K-3000KAI Foundry | AWS Bedrock | Agent systems | App Service | Artificial IntelligenceMid-level Full TimeBangalore, Karnataka, India6h ago
-
Associate Director- AI Engineer - Solution Architect INR 1500K-3000KAI Act | Agent systems | App Service | Azure App | Azure App ServiceMid-level Full TimeBangalore, Karnataka, India6h ago
-
Assistant Manager - Azure Data Engineer INR 1500K-2000KApache Spark | Azure | DBX Notebooks | Data Infrastructure | Data ModelingMid-level Full TimeBangalore, Karnataka, India6h ago
-
Associate - Java Developer - Prime Brokerage INR 1500K-2000KAgile | Crystal Reports | Data Warehousing | Database Triggers | Database functionsMid-level Full TimePune, India7h ago
-
BI Developer (Gen AI) – (BI and Analytics)-Analyst INR 2500K-4000KCI/CD | Control-M | Data Modeling | Database Design | DatabricksSenior-level Full TimeMumbai, Maharashtra, India7h ago
-
Data Scientist- GenAi/Agentic Ai INR 2000K-5000KAI orchestration | AWS | CrewAI | Data Mining | Generative AIMentoring program | Team collaboration | Training and coachingEntry-level Full TimeIndia7h ago
-
Data Scientist - Gen Ai/ Agentic Ai INR 2000K-5000KAI orchestration | AWS | Agentic AI | Crew AI | Data MiningCoaching | Mentoring program | Training and developmentEntry-level Full TimeIndia7h ago
-
Software Engineer - (Java Full Stack,AWS) INR 1500K-2700KAPI Gateway | AWS | Angular | Bitbucket | CI/CDMedical benefits | Paid time off | Work-life balanceMid-level Full TimeHyderabad, India7h ago
-
Software Engineer I - Python GenAI INR 3000K-4000KAWS | Data analytics | GenAI | Object-Oriented | Object-oriented programmingEntry-level Full TimeHyderabad, Telangana, India7h ago
-
Associate Engineer INR 1200K-2000KAnalysis Services | Azure Analysis | Azure Analysis Services | Azure Blob | Azure Blob StorageMid-level Full TimeHyderabad, IN8h ago
-
Senior AI / ML Data Scientist I INR 3000K-4500KCI/CD | CNN | CatBoost | Component analysis | Cross-validationSenior-level Full TimeBangalore, India9h ago
-
Gen AI Developer- Python, FAST API INR 1200K-2500KAWS Bedrock | Anthropic | CI/CD | Django | FastAPIMid-level Full TimeHyderabad, Telangana, India9h ago
-
Senior AI Engineer INR 2475K-4000KAgile | Amazon Web Services | CI/CD | CSS | ConfluenceHome office setup reimbursement | Mental wellness support | Ongoing learning & development | Paid time off | Recharge daysSenior-level Full TimeChennai or Remote, India R10h ago
-
Data Scientist & AI Developer INR 3000K-5000KA/B | A/B Testing | AWS SageMaker | Azure ML | B testingSenior-level Full TimeBangalore, KA, IN, 56007610h ago