Big Data Lead
Tasks
- Automate data pipelines
- Deploy code using CI/CD
- Design data pipelines using Snowpipe
- Document data pipelines
- Execute ETL with dbt
- Implement Data Vault 2.0 in Snowflake
- Implement data quality checks and monitoring
- Monitor and optimize Data Platform performance
- Set metrics and alerts
- Transform and load data using DBT
- Troubleshoot data operations issues
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Glue | AWS Lambda | Amazon EMR | Amazon Web Services | CI/CD | DBT | Data Governance | Data Modeling | Data Quality | Data Vault | Data Vault 2.0 | Database Design | ETL | Fivetran | Python | Snowflake | Snowpipe | Web Services
Education
N/A
Roles
Big Data Lead | Data Engineer | Data Lead | Engineer | Lead | Senior Data Engineer
Related jobs
-
MLOps Engineer INR 2500K-4000KArtificial Intelligence | Embeddings | Language Models | Large Language Models | Machine LearningEntry-level Full TimeIN-AP-Hyderabad3h ago
-
Senior Software Engineer (AI) INR 2000K-4500KAPI Design | AWS | Agent Frameworks | Aurora | CI/CDFamily wellbeing benefits | Health benefits | Paid time off | Wellbeing benefits | Work-life balanceSenior-level Full TimeHyderabad, India4h ago
-
Lead- Data Analysis INR 2800K-4000KAlteryx | Automation | Correlation Analysis | Dashboards | Data ModelingEmployee discounts | Financial coaching | Health insurance | Hybrid work | Mental health supportSenior-level Full TimeBengaluru, Karnataka, India, India R4h ago
-
Senior-level Full TimeIndia4h ago
-
Senior-level Full TimeIndia4h ago
-
Senior-level Full TimeBengaluru, KA, India5h ago
-
Data Engineer INR 1800K-3000KAWS AppSync | Agentic Workflows | Amazon DynamoDB | Amazon S3 | FastAPIMid-level Full TimePune, Maharashtra, India5h ago
-
Gen AI Developer Associate INR 300K-420KData Preprocessing | Feature Engineering | Language Processing | Linear Algebra | Machine LearningEntry-level Full TimeIndia5h ago
-
Gen AI Developer Associate INR 300K-420KData Preprocessing | Feature Engineering | Language Processing | Linear Algebra | Machine LearningEntry-level Full TimeIndia5h ago
-
Gen AI Developer Associate INR 300K-420KData Preprocessing | Feature Engineering | Generative AI | Language Processing | Linear AlgebraEntry-level Full TimeIndia5h ago
-
Gen AI Developer Associate INR 300K-420KData Preprocessing | Feature Engineering | Generative AI | Language Processing | Linear AlgebraEntry-level Full TimeIndia5h ago
-
Gen AI Developer Associate INR 300K-420KData Preprocessing | Feature Engineering | Generative AI | Language Processing | Linear AlgebraEntry-level Full TimeIndia5h ago
-
Amaze - Cloud Data Engineer INR 2500K-4800KAWS AI | Azure AI | Azure Data | Azure Data Factory | Data FactorySenior-level Full TimeIndia5h ago
-
Amaze - Cloud Data Lead INR 2000K-4800KAWS | Azure | Data Quality | Data pipeline | Data pipeline orchestrationSenior-level Full TimeIndia5h ago
-
Senior-level Full TimeIndia6h ago
-
Digital & GenAI Architect - Consulting INR 2000K-4000KAgent Framework | Artificial Intelligence | Azure Agent | Azure Agent Framework | CI/CDSenior-level Full TimeIndia6h ago
-
Senior Digital & GenAI Architect - Consulting Partner INR 2000K-4500KAWS | Agent Framework | Azure Agent | Azure Agent Framework | Generative AISenior-level Full TimeIndia6h ago
-
Test Lead - Data Automation INR 1500K-2209KCCPA | Data Cleansing | Data Generation | Data Management | Data ObfuscationSenior-level Full TimeIndia6h ago
-
Gen AI Lead Developer INR 3000K-5000KAgent Orchestration | CI/CD | Data Governance | Distributed Systems | EmbeddingsSenior-level Full TimeIndia6h ago
-
Gen AI Developer Specialist INR 2000K-3300KA/B | A/B Testing | Agent systems | B testing | EvaluationSenior-level Full TimeIndia6h ago
-
Gen AI Developer Specialist INR 2000K-3300KA/B | A/B Testing | API Integration | B testing | ExperimentationSenior-level Full TimeIndia6h ago
-
Senior-level Full TimeIndia6h ago
-
Senior-level Full TimeIndia6h ago
-
Gen AI Developer Associate INR 300K-420KLanguage Processing | Linear Algebra | Machine Learning | Natural Language | Natural Language ProcessingEntry-level Full TimeIndia6h ago
-
Gen AI Developer Associate INR 300K-420KData Preprocessing | Feature Engineering | Generative AI | Language Processing | Linear AlgebraEntry-level Full TimeIndia6h ago