Big Data Lead
Tasks
- Automate deployments with CI/CD and infrastructure-as-code
- Build data marts and reusable data products
- Design end to end ELT ETL pipelines
- Enforce security and governance
- Ensure data quality lineage and observability
- Implement Snowpipe tasks streams and external stages
- Implement cost monitoring and cost controls
- Ingest data from batch and streaming sources
- Model dimensional and data vault schemas
- Optimize Snowflake performance
Perks/Benefits
- N/A
Skills/Tech-stack
Azure Data | Azure Data Lake | Azure Data Lake Storage | CI/CD | Cloud Storage | Clustering | Clustering Pruning | Data Lake Storage | Data Lineage | Data Modeling | Data Quality | Data Quality Testing | Data Vault | Data masking | Dimensional Modeling | ELT | ETL | External stages | External tables | File Formats | Google Cloud | Google Cloud Storage | Incremental loading | Infrastructure as Code | Micro-partitioning | Monitoring Alerts | Quality testing | Query Tuning | RBAC | Resource monitors | Row Level Security | S3 | SQL | Snowflake | Snowpipe | Streams | Tasks | Time Travel | Virtual Warehouses | Zero copy | Zero-Copy Cloning | “as-code”
Education
N/A
Roles
Big Data Lead | Data Engineer | Data Lead | Engineer | Lead | Snowflake Data Engineer
Related jobs
-
Automation and AI Developer INR 3264K-4408KAWS Bedrock | Agent systems | Amazon AgentCore | Async Programming | Automated RegressionFlexible vacation | Headspace access | Hybrid work model | Mental health days | Paid volunteer days offMid-level Full TimeIndia, Hyderabad, Telangana R13h ago
-
Senior AI Engineer - LLM Evaluation INR 3740K-5876KAI Governance | AI Observability | AWS | Azure | BenchmarkingSenior-level Full TimeAPAC - India - Bengaluru - …13h ago
-
Lead Data Engineer/ Data Architect INR 2000K-2800KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeHyderabad, Telangana, India - Remote R13h ago
-
Mid-level Full TimeBangalore, KA, IN13h ago
-
Data Engineer INR 1500K-2500KData Analysis | Data Engineering | Data Management | Data Modeling | Data pipelineHybrid workingSenior-level Full TimeHyderabad Knowledge Park Tower 2, India13h ago
-
IN_Senior Manager_ AWS Bedrock Engineer_D&A_Advisory_Mumbai INR 1960K-4000KAPI Gateway | APIs | AWS Bedrock | AWS CloudFormation | AWS LambdaSenior-level Full TimeMumbai Shivaji Park, India13h ago
-
Senior AI Engineer - Remote INR 3375K-5000KAWS CloudFormation | Apache Tomcat | CI/CD | CircleCI | Data PipelinesDistributed team collaboration | Remote workSenior-level Full TimeHyderabad, TS, India R16h ago
-
Senior AI Engineer - Remote INR 3375K-5000KApache | Apache Tomcat | CI/CD | CircleCI | CloudFormationRemote workSenior-level Full TimeGurugram, HR, India R16h ago
-
Senior AI Engineer - Remote INR 3375K-5000KAWS DocumentDB | Apache Tomcat | CI/CD | CircleCI | CloudFormationFlexible distributed team | Remote workSenior-level Full TimeBengaluru, KA, India R16h ago
-
Senior AI Engineer - Remote INR 3375K-5000KApache Avro | Apache Tomcat | CI/CD | CircleCI | CloudFormationGrowth mentoring | Mission-driven work | Remote workSenior-level Full TimeNew Delhi, DL, India R16h ago
-
Apache Beam | Apache Flink | Apache Kafka | Apache Spark | Data ProcessingMid-level Full TimePune, Maharashtra, India R21h ago
-
Lead Consultant – SAP Master Data Governance (MDG) INR 1000K-2500KBRF+ | Change Request | Change Request Management | Data Cleansing | Data GovernanceSenior-level Full TimeBangalore, India22h ago
-
AI Engineer INR 3000K-5000KAPI Development | Agent Development | Agent Development Framework | Agent Development Kit | AnthropicMid-level Full TimePune, Maharashtra, India23h ago
-
Jr Data Engineer INR 360K-420KAWS Glue | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkEntry-level Full TimeBangalore North, India23h ago
-
Senior-level Full TimeBangalore, IN23h ago
-
Data Engineer INR 2520K-3380KAWS | Airflow | Azure | Azure Bicep | Azure DataEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India23h ago
-
Senior-level Full TimeIN-KA-Bangalore1d ago
-
Senior Consultant INR 2000K-2700KAzure Data | Azure Data Lake | Azure Databricks | Azure Machine Learning | Data LakeSenior-level Full TimeIN-KA-Bangalore1d ago
-
Apprentice-IT INR 360K-562KAPI | Data Architecture | Data Governance | Data Modeling | Data QualityEntry-level ApprenticeshipPune, Maharashtra, IND, 4110141d ago
-
Software Engineer – Data Platform INR 3000K-4000KAPIs | Alerting | Azure | Azure Data | Azure Data LakeFlexible working hours | Mobile working | Sabbatical | Training opportunitiesSenior-level Full TimeBengaluru, KA, India1d ago
-
Software Engineer – Data Platform INR 3000K-4000KAPIs | Alerting | Azure | Azure DevOps | CDCMobile flexible working models | Sabbaticals | Training opportunities | Work-life balanceSenior-level Full TimeBengaluru, KA, India1d ago
-
Software Engineer – Data Platform INR 3000K-4000KAPIs | Alerting | Audit Trail | Automated testing | AzureFlexible working | Mobile working | Sabbaticals | Training opportunities | Work-life balanceSenior-level Full TimeBengaluru, KA, India1d ago
-
Software Engineer – Data Platform INR 3000K-4000KAPIs | Alerting | Audit Trail | Azure | CDCFlexible working models | Mobile working | Sabbaticals | Training opportunities | Work-life balanceSenior-level Full TimeBengaluru, KA, India1d ago
-
Mid-level Full TimeBangalore, Karnataka, India1d ago
-
DE&A - AI Engineer INR 2000K-3300KAPI Keys | AWS | Agent systems | Agentic Workflows | Anthropic APIMid-level Full TimeBangalore, Karnataka, India1d ago