Data Engineer
Tasks
- Build efficient data extraction and transformation methodologies
- Deep dive into data domain to resolve complex data challenges
- Design and develop end to end data delivery for customer facing search engines
- Document processes and technical ways of working
- Engineer high performance distributed batch and real time data pipelines
- Improve data quality and boost delivery efficiency
- Orchestrate workflows using Apache Airflow DAGs and monitor pipelines
- Translate requirements into data points from structured and unstructured sources
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Airflow | Artifact Registry | BigQuery | CI/CD | Cloud Composer | Cloud Dataflow | Cloud SQL | Cloud SQL for PostgreSQL | Cloud Spanner | Cloud Storage | Cloud platform | Confluence | DBT | Data Architecture | Data Modeling | Data Transformation | Data pipeline | Data pipeline orchestration | Database Design | Eventarc | GCP Alerting | GCP Monitoring | GitLab | Google Cloud | Google Cloud Platform | IAM | Jenkins | Jira | Pipeline Orchestration | PostgreSQL | PubSub | Python | Reverse ETL | Secret Manager | ServiceNow | Terraform | Vertex AI
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Apache Beam | Apache Flink | Apache Kafka | Apache Spark | Data ProcessingMid-level Full TimePune, Maharashtra, India R7h ago
-
Jr Data Engineer INR 360K-420KAWS Glue | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkEntry-level Full TimeBangalore North, India9h ago
-
Senior-level Full TimeBangalore, IN9h ago
-
Senior-level Full TimeIN-KA-Bangalore9h ago
-
Senior Consultant INR 2000K-2700KAzure Data | Azure Data Lake | Azure Databricks | Azure Machine Learning | Data LakeSenior-level Full TimeIN-KA-Bangalore9h ago
-
Apprentice-IT INR 360K-562KAPI | Data Architecture | Data Governance | Data Modeling | Data QualityEntry-level ApprenticeshipPune, Maharashtra, IND, 41101410h ago
-
Monitoring-Operations Support-Analytics and Reporting INR 938K-1300KAWS | Excel | ITIL | Incident Management | Microsoft PowerPointFlexible hoursEntry-level Full TimeHyderabad, Telangana, India10h ago
-
Mid-level Full TimeBangalore, Karnataka, India11h ago
-
DE&A - AI Engineer INR 2000K-3300KAPI Keys | AWS | Agent systems | Agentic Workflows | Anthropic APIMid-level Full TimeBangalore, Karnataka, India11h ago
-
Mid-level Full TimeBangalore, Karnataka, India11h ago
-
AI Data Engineer III INR 3000K-4000KAWS | Agile | Apache Airflow | CI/CD | DBTContinuous learning | Generous leave policies | Health insurance | Hybrid work policies | Wellness programsSenior-level Full TimeBengaluru, Karnataka, India12h ago
-
Assistant Manager-KDNI INR 1500K-2000KAgile | Apache Spark | Azure | Azure Data | Azure Data FactoryMid-level Full TimeHyderabad, Telangana, India12h ago
-
Senior Consultant Specialist INR 3000K-5500KAWS | Apache Spark | Artificial Intelligence | Cloud platform | Data AnalysisSenior-level Full TimeBangalore, Karnataka, India R12h ago
-
Associate Director, Data and Analytics INR 2000K-3000KAIOps | AWS | Adversarial Attacks | Agentic Systems | Bias detectionMid-level Full TimeBangalore, Karnataka, India12h ago
-
Senior Data Systems Software Engineer INR 3264K-5572KAPI Integration | APIs | Agentic AI | C# | C++Senior-level Full TimeBENGALURU, KARNATAKA, India13h ago
-
Engineer - Embedded Automation QA INR 480K-1050KAPI Testing | Agile | Automation Framework | Azure DevOps | BACnetMid-level Full TimeHadapsar, Pune, Maharashtra, IND, 41101313h ago
-
Software Engineer I- Eng INR 300K-350KAWS | Agile | Automation | CI/CD | Cloud ComputingFlexible work arrangements | Health benefits | Mentorship | Paid time offEntry-level Full TimeNoida,UP,India R13h ago
-
Mid-level Full TimeHadapsar, Pune, Maharashtra, IND, 41101313h ago
-
Senior Data & Analytics Engineer INR 3000K-4000KAWS | Apache Spark | Azure | CI/CD | Cloud platformSenior-level Full TimeBangalore, Karnataka, IN14h ago
-
Senior AI Solutions Engineer INR 2500K-4500KAPI Integration | Agent Orchestration | Autonomous Agents | Data Pipelines | Database ConnectionsRelocation assistanceSenior-level Full TimeMumbai, MH, IN14h ago
-
Sr. Specialist , Data Engineering INR 2520K-3380KAgile | Airflow | BigQuery | CI/CD | Cloud FunctionsRelocation assistanceSenior-level Full TimeMumbai, MH, IN14h ago
-
Consultant - AI Engineer INR 2500K-5000KAutogen | CI/CD | Cloud infrastructure | Containerization | CrewAISenior-level Full TimeBangalore, Karnataka, India15h ago
-
Senior-level Full TimePune, Maharashtra, India15h ago
-
Lead-Affluent BIU & Analytics-AFFLUENT-Program & MIS INR 2500K-4400KA/B | A/B Testing | B testing | Clustering | Data GovernanceSenior-level Full TimeMumbai, Maharashtra, India15h ago
-
Lead Infrastructure Engineer - GenAI & CloudFormation INR 3000K-5000KAWS | Agentic AI | Automation | Bitbucket | ConfluenceSenior-level Full TimeHyderabad, Telangana, India16h ago