EY - GDS Consulting - AI and DATA - Snowflake architect + DBT - Manager
Trivandrum, KL, IN, 695581
INR 2000K-2000K (estimate) Senior-level Full Time
Tasks
- Automate file loading with Snowpipe
- Build metadata driven data pipelines
- Configure Snowflake security integrations
- Create Snowflake governance and lineage reports
- Create and manage Iceberg tables
- Create and manage Snowflake databases and schemas
- Create and manage Snowflake warehouses
- Create and manage dynamic tables
- Create and manage external tables
- Design data models with Erwin
- Develop UDFs UDTFs and procedures in Snowflake
- Generate reports using Snowflake tasks and streams
- Handle failure service integration for ServiceNow requests
- Implement data validation and reconciliation
- Implement dynamic masking policies
- Implement tag based masking policies
- Ingest data from AWS S3 and Azure Blob into Snowflake
- Integrate AWS services for data processing
- Integrate Azure services for data processing
- Integrate and schedule Snowflake ingestion pipelines
- Manage Snowflake RBAC and roles
- Manage Snowflake data sharing inbound and outbound
- Migrate SQL from legacy databases to Snowflake
- Optimize Snowflake performance
- Orchestrate workflows with Apache Airflow
- Transform semi structured data with Snowflake stored procedures
Perks/Benefits
- N/A
Skills/Tech-stack
AWS EC2 | AWS IAM | AWS RDS | AWS S3 | AWS SNS | AWS SQS | Apache Airflow | Azure Blob | Azure Blob Storage | Azure IAM | Blob Storage | Data Ingestion | Data Modeling | Data Processing | Data Reconciliation | Data Sharing | Data Validation | Data masking | Database Design | Dynamic Tables | Dynamic data | Dynamic data masking | ETL | Erwin | External tables | Iceberg tables | OAuth | Performance optimization | Profiling | RBAC | SAML | Semi-structured | Semi-structured Data | Semi-structured data processing | ServiceNow | Snowflake | Snowflake API | Snowflake Data Sharing | Snowflake Streams | Snowflake Tasks | Snowflake data | Snowflake stored procedures | Snowpipe | Stored Procedures | Structured Data Processing | Table Functions | Tag Based Masking | User Defined Functions | User Defined Table Functions
Related jobs
-
Senior Software Engineer INR 3200K-4225KAccess Control | Airflow | Artificial Intelligence | Astronomer | CI/CDSenior-level Full TimePune, India R-1d ago
-
Software Engineer (Python, AI/ML) ID47296 INR 2535K-4225KCI/CD | Data Modeling | Git | Microservices | PytestLocal legal compliance | Periodic team meetups | Remote workSenior-level Full TimeTrivandrum, India7h ago
-
Software Engineer (Python, AI/ML) ID47296 INR 2535K-4225KCI/CD | Clean Code | Data Modeling | Git | MicroservicesEducation support | Innovative projects | Legal compliance in India | Local team meetups | Professional development budgetSenior-level Full TimeChennai, India7h ago
-
Software Engineer (Python, AI/ML) ID47296 INR 2535K-4225KCI/CD | Cloud Native | Cloud native design | Data Modeling | Engineering PracticesEducation budget | Local compliance | Periodic team meetups | Personal growth budget | Remote workSenior-level Full TimeKochi, India7h ago
-
Lead Consultant-SSIS Developer! INR 2500K-3380KData Warehousing | Data integration | Design Patterns | Dimensional Modeling | ETLAI certifications | Mentorship | TrainingSenior-level Full TimeIndia-Bangalore8h ago
-
Lead Consultant - Site Reliability Engineers/L2 INR 2535K-4225KAWS | Angular | Azure | C# | Chaos EngineeringSenior-level Full TimeIndia-Bangalore8h ago
-
Pyspark Data Engineer INR 1200K-2000KAgile | Apache Spark | Data Governance | Data Lake | Data ModelingSenior-level Full TimeIN-KA-Bangalore9h ago
-
002AZM - Data Integration Engineer INR 2000K-2040KAWS | AWS Glue | Amazon Redshift | Amazon S3 | Apache AirflowContract work | Remote workSenior-level ContractTamil Nadu, Coimbatore, India9h ago
-
Gen AI - Consultant INR 2800K-4225KAPI Development | AWS SageMaker | AgentOps | Apache Airflow | Apache SparkAccess to AI research labs | Certifications | Cloud innovation platforms | Lead POCs | Work on next generation AI platformsSenior-level Full TimeBangalore, Karnataka, India10h ago
-
Azure Data Engineer - AM- MFT KGS CH INR 2000K-2000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksSenior-level Full TimeBangalore, Karnataka, India10h ago
-
Azure Data Engineer - Senior- MFT KGS CH INR 2000K-2000KAccess Control | Azure Data | Azure Data Factory | Azure Data Lake | Azure DatabricksSenior-level Full TimeBangalore, Karnataka, India10h ago
-
Azure Data Engineer - AM - MFT KGS CH INR 2000K-2000KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeBangalore, Karnataka, India10h ago
-
AWS Data Engineering - Consultant INR 1200K-1500KAWS CloudFormation | AWS Glue | AWS Lambda | AWS Step Functions | Amazon AthenaMid-level Full TimeBangalore, Karnataka, India10h ago
-
Assistant Manager - Azure Data Engineering INR 1500K-3000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsMid-level Full TimeBangalore, Karnataka, India10h ago
-
Assistant Manager - Azure Data Engineering INR 1500K-3000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsMid-level Full TimeBangalore, Karnataka, India10h ago
-
AWS Data Engineering - Consultant INR 1200K-1500KAWS CloudFormation | AWS Glue | AWS Lambda | AWS Step Functions | Amazon AthenaMid-level Full TimeBangalore, Karnataka, India10h ago
-
Senior Software Engineer, Google Cloud Storage INR 2500K-3500KBenchmarking | C++ | Connectors | Debugging | Distributed SystemsSenior-level Full TimeHyderabad, Telangana, India10h ago
-
Senior Manager-Business Analysis-Business Analyst INR 1800K-2800KCSI | Data Analysis | Data Processing | Deep learning | Distributed ComputingSenior-level Full TimeGurugram, Haryana, India12h ago
-
Senior BI Engineer #3033 INR 800K-1500KCalculated Fields | DBT | Dashboard performance | Dashboard performance tuning | Data LineageSenior-level Full TimeChennai, India12h ago
-
Mid-level Full TimeGurugram, Haryana, India13h ago
-
Senior Software Engineer, Data Science INR 3125K-3880KA/B | A/B Testing | B testing | Causal analysis | D3Senior-level Full TimeBengaluru, KA, India13h ago
-
Manager, Software Engineering, Data Science INR 2520K-3880KData Engineering | Data Manipulation | Data Modeling | Distributed Systems | ExperimentationSenior-level Full TimeBengaluru, KA, India13h ago
-
Staff Software Engineer, Data Science INR 2520K-3380KApache Spark | D3 | Data Governance | Data Modeling | Data VisualizationSenior-level Full TimeBengaluru, KA, India13h ago
-
Principal Staff Software Engineer, Systems Infrastructure INR 2100K-4500KAPI Design | Apache Hadoop | Apache Kafka | Apache Spark | Big DataHealth and wellness programs | Time away from workExecutive-level Full TimeBengaluru, KA, India15h ago
-
Principal Staff Software Engineer, AI Infrastructure INR 1800K-5800KApache Kafka | C++ | Compliance | Data Modeling | Distributed SystemsHealth and wellness programs | Hybrid work option | Time away from workExecutive-level Full TimeBengaluru, KA, India15h ago