Big Data Lead
Tasks
- Automate data pipelines
- Build transformations with DBT and load to Snowflake
- Deploy code using CI/CD tools
- Design data pipelines with Snowpipe
- Document data pipelines and processes
- Execute data quality checks and monitoring
- Implement ETL using DBT for Snowflake data vault loading
- Monitor and optimize Data Platform performance
- Troubleshoot data operations environment
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Glue | AWS Lambda | Amazon EMR | CD tools | CI/CD | CI/CD Tools | DBT | Data Governance | Data Modeling | Data Quality | Data pipeline | Database Design | DevOps | ETL | Fivetran | Performance Tuning | Python | Snowflake | Snowpipe
Education
N/A
Roles
Big Data Engineer | Data Engineer | Engineer | Senior Data Engineer
Related jobs
-
Mid-level Full TimeIN-TN-Chennai5h ago
-
Senior-level Full TimePune, Maharashtra, India5h ago
-
Staff Engineer, Data Analytics Engineering ( 6+ years Full Stack Developer - React, JavaScript, and Python / Node.js, AWS, SQL ) INR 2520K-4725KAI/ML | API Gateway | AWS Lambda | Amazon ECS | Amazon EKSSenior-level Full TimeBengaluru, KA, India6h ago
-
Software Engineer III, AI/ML, Google Cloud INR 2500K-4500KC++ | Computer Vision | Data Structures | Data Structures and Algorithms | Language ModelsSenior-level Full TimeBengaluru, Karnataka, India7h ago
-
Senior AI/ML Engineer II INR 2500K-4500KAzure | C++ | Deep learning | Generative AI | Hugging FaceCareer advancement programs | Dental insurance | Employee assistance program | Flexible work options | Health insuranceSenior-level Full TimeBangalore, Karnataka, India7h ago
-
Senior-level Full TimeIndia7h ago
-
Vice President, Data Management Engineer INR 1500K-4000KData Governance | Data Management | Data Privacy | Data Quality | Data SecurityExecutive-level Full TimePune, MH, India7h ago
-
Lead Software Engineer - Java , React and AI/ML INR 2000K-2200KAWS | Agile | Application Resiliency | CI/CD | CucumberSenior-level Full TimeBengaluru, Karnataka, India9h ago
-
Associate Process Manager INR 2200K-3000KAPI Design | AWS | Adapter-Tuning | Azure | C++Flexible shift timings | WFO/WFH FlexibilityMid-level Full TimeMumbai, Maharashtra, India10h ago
-
Data & GenAI Engineer INR 2400K-3000KAngular | Apache Spark | CI/CD | Data Lineage | Data ValidationMid-level Full TimeBengaluru, KA, IN10h ago
-
Senior AI Engineer- Consultant INR 2500K-4500KAgent Orchestration | Agentic AI | Agile | Azure | ClassificationCareer advancement opportunities | Collaborative work culture | Continuous learningSenior-level Full TimeBangalore, Karnataka, India10h ago
-
Agentic AI Developer (Python) INR 1800K-2500KAgentic Workflows | Docker | GenAI | GitHub APIs | GitLab APIsCollaborative team | Remote friendly N/A | Work-life balanceEntry-level Full TimePune, India11h ago
-
LEAD DATA ENGINEER - Supply Chain INR 2520K-3380KAgentic AI | Agile Scrum | DBT | Data Governance | Data ModelingCompetitive salary package | Comprehensive group insurance | Convenient location | Extensive training initiatives | Growth opportunitiesSenior-level Full TimeBangalore, KA, IN, 56007612h ago
-
SR. DATA ENGINEER - (AI & Analytics) INR 3100K-3880KAWS | Agile | CI/CD | Data Modeling | DatabricksSenior-level Full TimeBANGALORE, KA, IN, 56004812h ago
-
Dot Net Full Stack Developer INR 2000K-3000K.NET | AI Foundry | AI Services | API Management | AgileImmediate to 30 days notice period | Work from office all 5 daysSenior-level Full TimeIndia12h ago
-
AI Engineer INR 2500K-4500KAI Agents | Amazon Web Services | Azure | Cloud platform | Deep learningSenior-level Full TimeAnywhere in India R12h ago
-
Senior-level Full TimeIndia - Bengaluru13h ago
-
Mid-level Full TimeNavi Mumbai, Maharashtra, India15h ago
-
Senior Data Engineer INR 2500K-3380KAirflow | Apache Kafka | Apache Spark | Data Governance | Data ModelingGlobal team | Remote workSenior-level Full TimeIndia R17h ago
-
Senior Analytics Engineer – Product & Customer Analytics INR 2516K-3356KDBT | Data Documentation | Data Lineage | Data Modeling | Data QualityGlobal team collaboration | Remote-first work environmentSenior-level Full TimeIndia R17h ago
-
Staff Analytics Engineer – Customer Data Platform INR 2516K-3380KDBT | Data Architecture | Data Documentation | Data Modeling | Data TestingSenior-level Full TimeIndia R17h ago
-
Senior Data Engineer - Product Delivery INR 2040K-2400KAzure Blob | Azure Blob Storage | Azure Data | Azure Data Factory | Azure Data LakeCareer advancement | Dental insurance | Health insurance | Professional development | Retirement planSenior-level Full TimeIND Bangalore C 601, India18h ago
-
AI Search | Agile | Angular | Azure | Azure AIBest in class amenities and workspaces | Health and medical insurance | Learning and development | Rewards and recognitions | Well-beingEntry-level Full TimeIND-KA-Bengaluru, Bagmane Solarium City, India18h ago
-
Generative AI Quality Engineer - Senior Associate INR 2092K-2829KArtificial Intelligence | BDD | CI/CD | Gherkin | GitEmployee networks | Flexible work/life support | Hybrid work model | Paid volunteer days | Work from home optionSenior-level Full TimeHyderabad, India18h ago
-
AWS IAM | AWS Step Functions | Airflow | Alerting | Amazon Web ServicesBest in class amenities and workspaces | Comprehensive rewards | Health and medical insurance | Learning and development | Rewards and recognitionEntry-level Full TimeIND-KA-Bengaluru, Bagmane Solarium City, India18h ago