Lead Data Engineer
Tasks
- Automate data workflows
- Build ETL pipelines to ingest from MongoDB process in Snowflake load into MySQL
- Build batch or real time data pipelines in production
- Create data pipelines
- Design index and tune MySQL databases
- Develop ETL/ELT processes
- Ensure data accuracy integrity privacy security compliance
- Flatten and normalize JSON data from MongoDB
- Log and instrument pipelines and services
- Manage versioned data pipelines complexity
- Stage parse and transform semi structured data in Snowflake
- Train and mentor junior engineers
- Understand business requirements
- Write code and implement solutions
Perks/Benefits
- Career growth opportunities
- Flexible work location
- Generous time off
- Remote-first work environment
- Wellbeing initiatives
Skills/Tech-stack
ELT | ETL | JSON | MongoDB | MySQL | Python | Snowflake | Snowflake SQL
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
API Security | Application Security | Automation | Bash | CI/CDMid-level ContractHyderabad, India5h ago
-
AWS Data Engineer- Airflow INR 1500K-2400KAWS Glue | AWS Lambda | Amazon Redshift | Amazon S3 | Apache HadoopSenior-level Full TimeIN-AP-Hyderabad7h ago
-
Senior-level Full TimeIN-AP-Hyderabad7h ago
-
Software Engineer - AI/ML with Python INR 2500K-3500KAWS | Airflow | Amazon SageMaker | Apache Airflow | Apache SparkAccess to cutting-edge technologies | Collaborative work environment | In office 5 days per week | Professional development | Training and education opportunitiesSenior-level Full TimeBangalore - Karnataka, India - Kalyani …7h ago
-
MS Fabric / Azure Data Engineer ( 5- 7 yrs ) - Immediate Joiners INR 1500K-2500KAzure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | Data ArchitectureImmediate JoinersSenior-level Full TimeBengaluru, KA, India7h ago
-
Forward Deployed Engineer, Generative AI, Google Cloud INR 1500K-2500KAPIs | Agent systems | Cloud platform | Data Pipelines | Google CloudMid-level Full TimeMumbai, Maharashtra, India; Bengaluru, Karnataka, India8h ago
-
Forward Deployed Engineer, Generative AI, Google Cloud INR 1800K-2500KAPIs | Agent systems | Cloud platform | CrewAI | Data EngineeringMid-level Full TimeMumbai, Maharashtra, India; Gurgaon, Haryana, India8h ago
-
None Full TimeNoida, Uttar Pradesh, India8h ago
-
None Full TimeNoida, Uttar Pradesh, India8h ago
-
Snowflake COE Lead INR 1500K-2500KAPIs | Apache Airflow | Apache Spark | Azure Data | Azure Data FactorySenior-level Full TimeIndia9h ago
-
None Full TimeIndia9h ago
-
AI Software Engineer III - Platform INR 2000K-4000KAPI Gateway | APIs | AWS EC2 | AWS Lambda | Amazon APISenior-level Full TimeHyderabad, Telangana, India10h ago
-
Azure Data Engineer INR 1500K-2500KAzure Data | Azure Data Factory | Azure Data Lake | Azure Functions | Azure SynapseMid-level Full TimeIndia12h ago
-
Mid-level Full TimeBengaluru, Karnataka, India12h ago
-
Associate Process Manager INR 800K-1500KAWS | Apache Airflow | Apache Hadoop | Apache Spark | AzureMid-level Full TimePune, Maharashtra, India12h ago
-
Agile | Amazon Redshift | Batch Processing | BigQuery | CI PipelineCollaborative global work environment | Cross-functional collaboration | Flexible working arrangements | Fully remote friendly | Inclusive cultureSenior-level Full TimeIndia R13h ago
-
Data Engineer INR 1753K-2250KAPI | Agile | Azure Automation | Azure Data | Azure Data FactoryHybrid workSenior-level Full TimeChennai, Tamil Nadu, India14h ago
-
API | Batch Processing | Data Compliance | Data Governance | Data ModelingContinuous learning | Flexible work hours | Health and wellness support | Inclusive work culture | Paid time offSenior-level Full TimeIndia14h ago
-
AI Senior Software Engineer INR 2000K-4000KAI Search | AI gateway | AI gateway patterns | API Design | AWS BedrockSenior-level Full TimeBengaluru, India14h ago
-
Senior System Administrator II [Storage Engineer] INR 1000K-1890KAWS EBS | AWS S3 | Ansible | Ceph | DASMid-level Full TimeBengaluru15h ago
-
Sr.Research Engineer - Applied AI/ML INR 2000K-4170KAPI Design | Algorithms | Apache Spark | Conversational AI | Data AnalysisSenior-level Full TimeGurugram, India15h ago
-
Application Engineer (AI Automation) INR 2500K-4500KApex | Data Modeling | Java | JavaScript | MilvusCompany-sponsored team events | Flexible time off | Wellness resourcesSenior-level Full TimeBangalore, India17h ago
-
Machine Learning Engineer INR 1400K-2000KApache Spark | Azure | Classification | Cloud platform | ClusteringMid-level Full TimeBengaluru, Karnataka, India19h ago
-
Mid-level Full TimeBengaluru, Karnataka, India19h ago
-
Alpha Generation Applied AI Engineer, Vice President INR 2400K-6000KAgent Orchestration | Agile | Automated testing | CI/CD | ContainerizationComprehensive healthcare | Flexible time off | Hybrid work | Retirement plan | Support for working parentsExecutive-level Full TimeMU8-South (A) Wing, 7-10 Floor, Nesco … R19h ago