Data Engineer Lead - AI, ML, NER, OCR, NLP
Tasks
- Communicate architecture and design with stakeholders
- Define technical requirements for data onboarding
- Design and build production data pipelines
- Develop data models and ETL processes
- Ensure seamless integration with Data Lake
- Handle large-scale complex data projects
- Implement CI/CD pipelines
- Implement enterprise Data Lake and Data Mart/Warehouse
- Work independently and as part of a team
Perks/Benefits
- N/A
Skills/Tech-stack
AWS EC2 | AWS EMR | AWS Glue | AWS Lambda | AWS Redshift | AWS S3 | AWS Step Functions | Apache Airflow | CI/CD | Data Lake | Data Mart | Data Modeling | Data Warehouse | Data Warehousing | Data orchestration | Databricks | Dimensional Modeling | ETL Development | Oracle | PostgreSQL | Python | Redshift | Snowflake | Spark | Step Functions
Roles
Related jobs
-
Data Engineer ID56374 INR 1500K-2300KAzure Data | Azure Data Factory | Azure Key Vault | Azure SQL | CI/CDLocal connection | Periodic meet ups | Remote work | Structured secure work environment | Support for education and wellnessSenior-level Full TimeJalalabad, India6h ago
-
Data Engineer (GCP) ID56375 INR 2400K-3380KApache Airflow | Apache Spark | Cloud Composer | Cloud Dataproc | Cloud MonitoringBudgets for personal growth education and wellness | Legal Compliance Support | Local connection meetups | Remote workSenior-level Full TimeMumbai, India6h ago
-
Data Engineer (GCP) ID56375 INR 2400K-3380KApache Airflow | Apache Spark | Bitemporal data modeling | CI/CD | Change Data CaptureDedicated budgets for education | Dedicated budgets for wellness | Innovative projects | Local connection | Periodic meetupsSenior-level Full TimeChennai, India6h ago
-
Data Engineer (GCP) ID56375 INR 2400K-3380KApache Airflow | Apache Spark | BigQuery | Change Data Capture | ClickHouseBudget for education | Budget for wellness | Local compliance in India | Periodic team meetups | Personal growth supportSenior-level Full TimeGurgaon Kty., India6h ago
-
Data Engineer ID56374 INR 1500K-2300KAnomaly Detection | Azure Data | Azure Data Factory | Azure Key Vault | Azure SQLEducation budget | Innovative projects | Local connection | Periodic meet ups | Personal growth budgetSenior-level Full TimeCoimbatore South, India6h ago
-
Data Engineer (GCP) ID56375 INR 2400K-3380KApache Airflow | Apache Spark | BigQuery | Bitemporal data modeling | CI/CDEducation budget | Innovative projects | Local connection | Periodic meet ups | Personal growth budgetSenior-level Full TimeJalalabad, India6h ago
-
Data Engineer ID56374 INR 1500K-2300KAgentic AI | Azure Data | Azure Data Factory | Azure Key Vault | Azure SQLEducation budget | Growth budget | Local meetups | Remote work | Wellness budgetSenior-level Full TimeGurgaon Kty., India6h ago
-
Data Engineer (GCP) ID56375 INR 2400K-3380KApache Airflow | Apache Spark | BigQuery | CI/CD | Change Data CaptureEducation budget | Innovative projects | Local compliance | Local connection | Periodic meetupsSenior-level Full TimeAhmedabad, India6h ago
-
Data Engineer ID56374 INR 1500K-2300KAzure | Azure Data | Azure Data Factory | Azure Key Vault | Azure SQLEducation budget | Innovative projects | Local connection | Periodic meetups | Personal growth budgetSenior-level Full TimeChennai, India6h ago
-
Data Engineer (GCP) ID56375 INR 2400K-3380KApache Airflow | Apache Spark | CI/CD | Change Data Capture | Change Data Capture (CDC)Education budget | Local compliance in India | Periodic team meetups | Personal growth budget | Remote workSenior-level Full TimeNew Delhi, India6h ago
-
Data Engineer (GCP) ID56375 INR 2400K-3380KApache Airflow | Apache Spark | BigQuery | CI/CD | Change Data CaptureEducation budget | Local compliance support | Periodic team meetups | Personal growth budget | Remote workSenior-level Full TimeKochi, India6h ago
-
Data Engineer (GCP) ID56375 INR 2400K-3380KApache Airflow | Apache Spark | CI/CD | Change Data Capture | ClickHouseEducation budget | Innovative projects | Legal presence in India compliance | Local connection meetups | Personal growth budgetSenior-level Full TimeJaipur, India6h ago
-
Data Engineer ID56374 INR 1500K-2300KAzure Data | Azure Data Factory | Azure Key Vault | Azure SQL | CD pipelinesEducation budget | Innovative projects | Local connection periodic meetups | Personal growth budget | Remote workSenior-level Full TimeTrivandrum, India6h ago
-
Data Engineer (GCP) ID56375 INR 2400K-3380KApache Airflow | Apache Spark | BigQuery | CI/CD | Change Data CaptureEducation budget | Local connection meetups | Personal growth budget | Remote work | Structured secure work environmentSenior-level Full TimeIndore, India6h ago
-
Data Engineer (GCP) ID56375 INR 2400K-3380KApache Airflow | Apache Spark | Apache pandas | BigQuery | CI/CDInnovative projects | Legal compliance in India | Local connection meetups | Personal growth education and wellness budget | Remote workSenior-level Full TimeKolkata, India6h ago
-
Data Engineer ID56374 INR 1500K-2300KAzure Data | Azure Data Factory | Azure Key Vault | Azure SQL | CI/CDGrowth education budget | Local connection meetups | Remote work | Secure compliant work environment | Wellness budgetSenior-level Full TimeKolkata, India6h ago
-
Data Engineer ID56374 INR 1500K-2300KAzure | Azure Data | Azure Data Factory | Azure Key Vault | Azure SQLEducation budget | Innovative projects | Local connection meetups | Personal growth budget | Remote workSenior-level Full TimeAhmedabad, India6h ago
-
Data Engineer ID56374 INR 1500K-2300KAgentic AI | Azure Data | Azure Data Factory | Azure Key Vault | Azure SQLEducation budget | Innovative projects | Legal presence in India | Local connection | Periodic team meetupsSenior-level Full TimeJaipur, India6h ago
-
Data Engineer ID56374 INR 1500K-2300KAzure Data | Azure Data Factory | Azure Key Vault | Azure SQL | CI/CDEducation budget | Local connection meetups | Professional growth budget | Remote work | Wellness budgetSenior-level Full TimeKochi, India6h ago
-
Data Engineer (GCP) ID56375 INR 2400K-3380KApache Airflow | Apache Spark | CI/CD | Cloud Composer | Cloud MonitoringEducation budget | Local compliance support | Local meetups | Personal growth budget | Remote workSenior-level Full TimeTrivandrum, India6h ago
-
Data Engineer ID56374 INR 1500K-2300KAzure Data | Azure Data Factory | Azure Key Vault | Azure SQL | Bitemporal data modelingEducation budget | Legal Compliance Support | Local connection | Meetups | Professional growth budgetSenior-level Full TimeNew Delhi, India6h ago
-
Data Engineer ID56374 INR 1500K-2300KAzure Data | Azure Data Factory | Azure Key Vault | Azure SQL | Bitemporal data modelingEducation budget | Innovative projects | Local connection meetups | Personal growth budget | Remote workSenior-level Full TimeMumbai, India6h ago
-
Data Engineer ID56374 INR 1500K-2300KAzure Data | Azure Data Factory | Azure Key Vault | Azure SQL | CI/CDEducation budget | Innovation projects | Local connection meetups | Personal growth budget | Remote workSenior-level Full TimeHyderabad, India6h ago
-
Data Engineer ID56374 INR 1500K-2300KAnomaly Detection | Azure Data | Azure Data Factory | Azure Key Vault | Azure SQLEducation budget | Local connection | Meetups | Personal growth budget | Remote workSenior-level Full TimePune City, India6h ago
-
Data Engineer ID56374 INR 1500K-2300KAzure Data | Azure Data Factory | Azure Key Vault | Azure SQL | CI/CDEducation budget | Innovative projects | Local connection | Periodic meetups | Personal growth budgetSenior-level Full TimeBangalore North, India6h ago