Data Engineer
Tasks
- Build analytics ready curated datasets
- Create CI CD workflows and monitoring processes
- Create modular reusable data models
- Design and develop scalable data pipelines
- Develop Python and SQL for ingestion and transformation
- Establish data quality checks
- Implement transformations with DBT
- Ingest structured and semi structured data
- Mentor junior engineers and conduct code reviews
- Optimize BigQuery performance
- Orchestrate workflows with Airflow or Cloud Composer
Perks/Benefits
Skills/Tech-stack
Agile | Apache Airflow | Apache Kafka | Ascend.io | CI/CD | Cloud Composer | Cloud Dataflow | Clustering | DBT | Data Governance | Data Quality | Data Validation | Data Warehousing | Databricks | ELT | ETL | Fivetran | Git | Google BigQuery | Google Cloud | Google Cloud Dataflow | Google Pubsub | Infrastructure automation | Kanban | Partitioning | Python | Query Optimization | SQL | Scrum
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
AI Engineer INR 2500K-5000KAPI-driven | API-driven Development | Agent Development | Agent Development Framework | BigQuerySenior-level Full TimePune, Maharashtra, India11h ago
-
Mid-level Full TimeHyderabad, IND-TG, India12h ago
-
Associate Data Engineer INR 1500K-2500KAgile | Apache NiFi | Azure DevOps | C plus plus | Database systemsMid-level Full TimePune, India14h ago
-
Senior-level Full TimeBANGALORE, Karnataka, Inde15h ago
-
Advanced Engineer-AI/ML INR 3264K-4800KAPI Integration | ASR | AUTOSAR | AWS | Audio ProcessingEmployee discounts | Recognition rewards program | Training opportunities | Tuition reimbursement | Wellness benefitsSenior-level Full TimeBangalore - Karnataka, India - Kalyani …15h ago
-
Senior Software Engineer - Data License Analytics, Pune INR 3000K-4720KAWS S3 | Agent to Agent | Agent to Agent A2A | Apache Airflow | Apache IcebergSenior-level Full TimePune15h ago
-
Spark, Scala, Hadoop & Quantexa/Senior Consultant Specialist INR 2000K-2800KApache Airflow | Apache Spark | CI/CD | DevOps | ElasticsearchFlexible working hours | On-call support | Shift workSenior-level Full TimeBangalore, Karnataka, India R16h ago
-
Mid-level Full TimeIN-KA-Bangalore16h ago
-
AI Lead and Automation Tester - Document Intelligence INR 2500K-5000KAI Workflow Orchestration | AI workflow | Automation Testing | Clinical Trial Compliance | Clinical trialSenior-level Full TimeIN-TN-Chennai16h ago
-
Senior Consultant INR 2000K-4500KAPI Testing | Adversarial Testing | Amazon SageMaker | Azure Machine Learning | Bias detectionSenior-level Full TimeIN-AP-Hyderabad16h ago
-
Assistant Director - Insights And Analytics INR 3000K-5199KCode reuse | Data Governance | Data Quality | Data Wrangling | Machine LearningExecutive-level Full TimeBangalore, Karnataka, India R16h ago
-
Senior-level Full TimeBangalore - Karnataka - India16h ago
-
Java Full Stack Engineer - Professional INR 1200K-3000KAngular | Apache Airflow | Apache Spark | Azure Kubernetes | Azure Kubernetes ServiceSenior-level Full TimeIndia17h ago
-
Senior-level Full Timebengaluru, India17h ago
-
Senior-level Full Timebengaluru, India17h ago
-
Lead Data Platform Engineer INR 2040K-3900KAPI Integration | AWS | AWS CloudWatch | AWS DataZone | AWS GlueEnhanced medical benefits | Family well-being benefits | Hybrid work | Paid time off | Wellbeing programsSenior-level Full TimeHyderabad, India17h ago
-
Anomaly Detection | Autoencoders | Bayesian optimization | Classification | ClusteringOnsite workEntry-level Full TimeHyderabad, India17h ago
-
AI Agent Development Kit | API Gateway | Agent Development Kit | Agentic AI | Audit LoggingSenior-level Full TimeMumbai, Maharashtra, India17h ago
-
AI/ML Infrastructure Software Engineer INR 3000K-5000KC++ | JAX | Keras | Machine Learning | Machine Learning FairnessSenior-level Full TimeBengaluru, Karnataka, India17h ago
-
Data Engineer INR 1300K-2000KAPI Integration | Data Modeling | Data Transformation | Data pipeline | Power BIMid-level Full TimeHyderabad, Telangana, India18h ago
-
Senior Software Engineer INR 3000K-4000KALB | API Gateway | AWS ECS | AWS Glue | AWS LambdaFamily well-being benefits | Health benefits | Hybrid work | Paid time offSenior-level Full TimeHyderabad, India18h ago
-
Senior QA Engineer (Data Platform Testing) INR 2500K-3000KAPI Gateway | API Testing | AWS Lambda | CI/CD | CloudWatchSenior-level Full TimeHyderabad, India18h ago
-
Consultant - Cloud Data Engineer INR 1500K-2500KApache Airflow | Apache Kafka | Apache Spark | Azure | Azure DataMid-level Full TimeGurgaon, Haryana, India18h ago
-
Generative AI Lead INR 3264K-5876KAI Governance | APIs | Cloud Architecture | Cloud infrastructure | Data LakeHybrid workSenior-level Full TimeHyderabad, India18h ago
-
Mid-level Full TimePune, Maharashtra, India18h ago