Data Engineering Consultant
Primary location: Chennai, Tamil Nadu
INR 980K-2000K (estimate) Mid-level Full Time
Tasks
- Automate data validation tasks
- Build dimensional data models
- Collaborate with software engineers data scientists and stakeholders
- Design ETL/ELT pipelines
- Develop AI-powered solutions
- Develop data architectures
- Ensure data security privacy governance compliance
- Evaluate AI and machine learning trends
- Implement monitoring alerting logging
- Optimize database schemas
- Optimize storage and partitioning strategies
- Perform data analysis profiling cleansing validation
- Tune SQL queries and database performance
Perks/Benefits
Skills/Tech-stack
Airflow | Apache Kafka | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOps | CI/CD | Data Factory | DevOps | Dimensional Modeling | ELT | ETL | Git | GitHub Actions | Java | Jenkins | MongoDB | Python | SQL | Spark
Related jobs
-
AWS | Airflow | DBT | Fine Tuning | Language ModelsBonuses | Disability insurance | Life insurance | Paid parental leave | Paid time offSenior-level Full TimeRemote, India R7h ago
-
Mid-level Full TimeHadapsar, Pune, Maharashtra, IND, 4110138h ago
-
Efs Fcrm 169474 INR 1500K-2400KApache Spark | Azure DevOps | CI/CD | Data Partitioning | Data WarehousingMid-level Full TimeHyderabad, IND-TG, India9h ago
-
Senior Database Engineer - #3190 (Remote) INR 1500K-2700KAWS IAM | AWS KMS | AWS RDS | Amazon Aurora | BashOn-call rotation | Remote workSenior-level Full TimeChennai, India R12h ago
-
Software Engineer SRE (Site Reliability Engineer) INR 1600K-3000KAWS | Ansible | Apache Airflow | Apache Kafka | Apache SparkSenior-level Full TimeBangalore, India Office (BANGALORE) R12h ago
-
Mid-level Full TimeIN-TN-Chennai13h ago
-
Senior-level Full TimeIN-MH-Pune13h ago
-
Snr AI INR 2500K-5000KAI Search | Amazon SageMaker | Azure AI | Azure AI Search | Azure Machine LearningSenior-level Full TimeIN-HR-Gurgaon13h ago
-
Senior-level Full TimeBengaluru, Karnataka13h ago
-
GCP BigQuery,DevOps,Credit Card Domain/Associate Director, Data and Analytics Specialist INR 650K-900KApache Airflow | Apache Kafka | BigQuery | CI/CD | Cloud ComposerMid-level Full TimeHyderabad, Telangana, India R14h ago
-
Manager - Data Engineering INR 700K-1500KAWS Glue | AWS S3 | Amazon EMR | Amazon Redshift | Apache KafkaCareer growth | Flexible benefits | Health and wellbeing support | Training opportunitiesMid-level Full TimeBengaluru, KA, India14h ago
-
Azure Data Engineer INR 1500K-2000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Functions | Azure SynapseSenior-level Full TimePune, Maharashtra, India14h ago
-
Lead Software Engineer - Python Full Stack, AI/ML INR 4000K-5000KAWS | Agile | Angular | Application Resiliency | Automated testingSenior-level Full TimeMumbai, Maharashtra, India15h ago
-
Senior-level Full Timecoimbatore, India15h ago
-
Digital Marketing Analyst INR 2500K-3380KAWS | Azure | Cloud platform | Customer Analytics | Data GovernanceSenior-level Full TimeChennai, Tamil Nadu, India15h ago
-
Senior Staff Machine Learning Engineer (Java + LLM) INR 3000K-4401KAlgorithm Design | Code Tuning | Data Structures | Data Structures and Algorithms | Design PatternsFlexible work schedule | Health benefits | Paid time off | Remote work optionSenior-level Full TimeBangalore, Karnataka, India15h ago
-
Senior Staff Engineer, Data Migration Lead INR 3000K-4000KAccess Control | Audit Trail | Cutover planning | Data Governance | Data ManagementSenior-level Full TimeRemote, India R16h ago
-
Senior-level Full TimeMumbai, Maharashtra, India16h ago
-
Data Analyst Customer Success Engineer INR 2500K-4064KA/B | A/B Testing | AI workflows | API Integration | AmplitudeClient Customer Interactions | Health insurance | Learning aids | Meal vouchersSenior-level Full TimeHYDERABAD, Telangana, India17h ago
-
AI Platform Engineer INR 3700K-5500KAPI Design | Agent Orchestration | Agent systems | Artificial Intelligence | CI/CDSenior-level Full TimeMumbai, India17h ago
-
Senior-level Full TimeMumbai, India17h ago
-
Deputy Vice President - Data Scientist INR 3300K-4000KAmazon Web Services | Apache Spark | Data Visualization | Gradient boosting | HadoopAnnual health checkup | Dental benefits | Gender neutral policy | Group term life insurance | Inclusive cultureExecutive-level Full TimeGurugram, India18h ago
-
Software Engineer III - Python Developer + AWS + LLM / Gen AI INR 3500K-5000KAWS | Agile | Azure | CI/CD | Data PipelinesSenior-level Full TimeBengaluru, Karnataka, India18h ago
-
Data Engineer - II (Biometrics) INR 700K-1500KAWS | Amazon EC2 | Amazon S3 | Amazon SageMaker | Apache AirflowMid-level Full TimeBangalore18h ago
-
Software Engineering - Data, Lakehouse and AI Data Platform Engineer-Hyderabad-Associate INR 1500K-2500KApache Iceberg | Apache Spark | Avro | CI/CD | Cause analysisMid-level Full TimeHyderabad, Telangana, India18h ago