Big Data Lead
Tasks
- Automate deployments with CI/CD and infrastructure-as-code
- Build data marts and reusable data products
- Design end to end ELT ETL pipelines
- Enforce security and governance
- Ensure data quality lineage and observability
- Implement Snowpipe tasks streams and external stages
- Implement cost monitoring and cost controls
- Ingest data from batch and streaming sources
- Model dimensional and data vault schemas
- Optimize Snowflake performance
Perks/Benefits
- N/A
Skills/Tech-stack
Azure Data | Azure Data Lake | Azure Data Lake Storage | CI/CD | Cloud Storage | Clustering | Clustering Pruning | Data Lake Storage | Data Lineage | Data Modeling | Data Quality | Data Quality Testing | Data Vault | Data masking | Dimensional Modeling | ELT | ETL | External stages | External tables | File Formats | Google Cloud | Google Cloud Storage | Incremental loading | Infrastructure as Code | Micro-partitioning | Monitoring Alerts | Quality testing | Query Tuning | RBAC | Resource monitors | Row Level Security | S3 | SQL | Snowflake | Snowpipe | Streams | Tasks | Time Travel | Virtual Warehouses | Zero copy | Zero-Copy Cloning | “as-code”
Education
N/A
Roles
Big Data Lead | Data Engineer | Data Lead | Engineer | Lead | Snowflake Data Engineer
Related jobs
-
Senior AI Engineer - Remote INR 3375K-5000KAWS DocumentDB | Apache Tomcat | CI/CD | CircleCI | CloudFormationFlexible distributed team | Remote workSenior-level Full TimeBengaluru, KA, India R14h ago
-
Apache Beam | Apache Flink | Apache Kafka | Apache Spark | Data ProcessingMid-level Full TimePune, Maharashtra, India R20h ago
-
Lead Consultant – SAP Master Data Governance (MDG) INR 1000K-2500KBRF+ | Change Request | Change Request Management | Data Cleansing | Data GovernanceSenior-level Full TimeBangalore, India21h ago
-
AI Engineer INR 3000K-5000KAPI Development | Agent Development | Agent Development Framework | Agent Development Kit | AnthropicMid-level Full TimePune, Maharashtra, India21h ago
-
Jr Data Engineer INR 360K-420KAWS Glue | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkEntry-level Full TimeBangalore North, India21h ago
-
Senior-level Full TimeBangalore, IN21h ago
-
Senior-level Full TimeIN-KA-Bangalore22h ago
-
Senior Consultant INR 2000K-2700KAzure Data | Azure Data Lake | Azure Databricks | Azure Machine Learning | Data LakeSenior-level Full TimeIN-KA-Bangalore22h ago
-
Apprentice-IT INR 360K-562KAPI | Data Architecture | Data Governance | Data Modeling | Data QualityEntry-level ApprenticeshipPune, Maharashtra, IND, 41101422h ago
-
Mid-level Full TimeBangalore, Karnataka, India1d ago
-
DE&A - AI Engineer INR 2000K-3300KAPI Keys | AWS | Agent systems | Agentic Workflows | Anthropic APIMid-level Full TimeBangalore, Karnataka, India1d ago
-
Mid-level Full TimeBangalore, Karnataka, India1d ago
-
AI Data Engineer III INR 3000K-4000KAWS | Agile | Apache Airflow | CI/CD | DBTContinuous learning | Generous leave policies | Health insurance | Hybrid work policies | Wellness programsSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Senior Production Support Engineer - LoanIQ - Bangalore INR 3000K-5000KAPIs | Automation | Cause analysis | Incident Management | JavaSenior-level Full TimeIndia1d ago
-
Assistant Manager-KDNI INR 1500K-2000KAgile | Apache Spark | Azure | Azure Data | Azure Data FactoryMid-level Full TimeHyderabad, Telangana, India1d ago
-
Data Delivery lead/ Associate Director, Data and Analytics INR 650K-1100KAI Observability | AI frameworks | Agentic AI | Agentic AI Frameworks | AgileMid-level Full TimeHyderabad, Telangana, India R1d ago
-
Senior Consultant Specialist INR 3000K-5500KAWS | Apache Spark | Artificial Intelligence | Cloud platform | Data AnalysisSenior-level Full TimeBangalore, Karnataka, India R1d ago
-
Associate Director, Data and Analytics INR 2000K-3000KAIOps | AWS | Adversarial Attacks | Agentic Systems | Bias detectionMid-level Full TimeBangalore, Karnataka, India1d ago
-
Senior Data Systems Software Engineer INR 3264K-5572KAPI Integration | APIs | Agentic AI | C# | C++Senior-level Full TimeBENGALURU, KARNATAKA, India1d ago
-
Engineer - Embedded Automation QA INR 480K-1050KAPI Testing | Agile | Automation Framework | Azure DevOps | BACnetMid-level Full TimeHadapsar, Pune, Maharashtra, IND, 4110131d ago
-
Software Engineer I- Eng INR 300K-350KAWS | Agile | Automation | CI/CD | Cloud ComputingFlexible work arrangements | Health benefits | Mentorship | Paid time offEntry-level Full TimeNoida,UP,India R1d ago
-
Mid-level Full TimeHadapsar, Pune, Maharashtra, IND, 4110131d ago
-
AWS DMS | Amazon Bedrock | Amazon Kinesis | Amazon QuickSight | Amazon SageMakerFlexible shifts | Long-term career growth | Mentorship and community | No weekend work | Remote workSenior-level Contract Full TimeDelhi R1d ago
-
Senior Data & Analytics Engineer INR 3000K-4000KAWS | Apache Spark | Azure | CI/CD | Cloud platformSenior-level Full TimeBangalore, Karnataka, IN1d ago
-
Senior AVP Enterprise Digital - Lead Data Management INR 2000K-4000KAlerting | Apache Spark | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeNoida, Uttar Pradesh, India1d ago