Big Data Engineer
Tasks
- Automate data pipelines
- Build transformations with DBT
- Deploy code using CI/CD
- Design and implement data pipelines
- Document pipelines and processes
- Execute ETL with dbt
- Implement Snowpipe ingestion
- Implement metrics and alerts
- Load data into Snowflake using Data Vault
- Monitor and optimize platform performance
- Run data quality checks and monitoring
- Troubleshoot data operations issues
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Glue | AWS Lambda | Amazon EMR | CI/CD | DBT | Data Governance | Data Modeling | Data Quality | Data Vault | Database Design | ETL | Fivetran | Python | Snowflake
Education
N/A
Roles
Big Data Engineer | Data Engineer | Engineer | Senior Data Engineer
Related jobs
-
Platform Engineer (AI) INR 1500K-2000KEmbeddings | Generative AI | Language Models | Large Language Models | Machine LearningMid-level Full TimeIN-TN-Chennai5h ago
-
MLOps Engineer INR 2500K-4000KArtificial Intelligence | Embeddings | Language Models | Large Language Models | Machine LearningEntry-level Full TimeIN-AP-Hyderabad5h ago
-
Senior Software Engineer (AI) INR 2000K-4500KAPI Design | AWS | Agent Frameworks | Aurora | CI/CDFamily wellbeing benefits | Health benefits | Paid time off | Wellbeing benefits | Work-life balanceSenior-level Full TimeHyderabad, India5h ago
-
Lead- Data Analysis INR 2800K-4000KAlteryx | Automation | Correlation Analysis | Dashboards | Data ModelingEmployee discounts | Financial coaching | Health insurance | Hybrid work | Mental health supportSenior-level Full TimeBengaluru, Karnataka, India, India R5h ago
-
Senior-level Full TimeIndia5h ago
-
Senior-level Full TimeIndia5h ago
-
Senior-level Full TimeBengaluru, KA, India6h ago
-
Data Engineer INR 1800K-3000KAWS AppSync | Agentic Workflows | Amazon DynamoDB | Amazon S3 | FastAPIMid-level Full TimePune, Maharashtra, India7h ago
-
Gen AI Developer Associate INR 300K-420KData Preprocessing | Feature Engineering | Language Processing | Linear Algebra | Machine LearningEntry-level Full TimeIndia7h ago
-
Gen AI Developer Associate INR 300K-420KData Preprocessing | Feature Engineering | Language Processing | Linear Algebra | Machine LearningEntry-level Full TimeIndia7h ago
-
Gen AI Developer Associate INR 300K-420KData Preprocessing | Feature Engineering | Generative AI | Language Processing | Linear AlgebraEntry-level Full TimeIndia7h ago
-
Gen AI Developer Associate INR 300K-420KData Preprocessing | Feature Engineering | Generative AI | Language Processing | Linear AlgebraEntry-level Full TimeIndia7h ago
-
Gen AI Developer Associate INR 300K-420KData Preprocessing | Feature Engineering | Generative AI | Language Processing | Linear AlgebraEntry-level Full TimeIndia7h ago
-
Amaze - Cloud Data Engineer INR 2500K-4800KAWS AI | Azure AI | Azure Data | Azure Data Factory | Data FactorySenior-level Full TimeIndia7h ago
-
Amaze - Cloud Data Lead INR 2000K-4800KAWS | Azure | Data Quality | Data pipeline | Data pipeline orchestrationSenior-level Full TimeIndia7h ago
-
Senior-level Full TimeIndia7h ago
-
Digital & GenAI Architect - Consulting INR 2000K-4000KAgent Framework | Artificial Intelligence | Azure Agent | Azure Agent Framework | CI/CDSenior-level Full TimeIndia7h ago
-
Senior Digital & GenAI Architect - Consulting Partner INR 2000K-4500KAWS | Agent Framework | Azure Agent | Azure Agent Framework | Generative AISenior-level Full TimeIndia7h ago
-
ML-Ops INR 2500K-4800KAsyncio | Benchmarking | CI/CD | CProfile | DjangoLeadership development | Training sessionsSenior-level Full TimeMumbai, Maharashtra, India7h ago
-
Test Lead - Data Automation INR 1500K-2209KCCPA | Data Cleansing | Data Generation | Data Management | Data ObfuscationSenior-level Full TimeIndia7h ago
-
Gen AI Lead Developer INR 3000K-5000KAgent Orchestration | CI/CD | Data Governance | Distributed Systems | EmbeddingsSenior-level Full TimeIndia7h ago
-
Gen AI Developer Specialist INR 2000K-3300KA/B | A/B Testing | Agent systems | B testing | EvaluationSenior-level Full TimeIndia7h ago
-
Gen AI Developer Specialist INR 2000K-3300KA/B | A/B Testing | API Integration | B testing | ExperimentationSenior-level Full TimeIndia7h ago
-
Senior-level Full TimeIndia7h ago
-
Senior-level Full TimeIndia7h ago