Senior Data Engineer
DGS India - Mumbai - Thane Ashar IT Park
INR 2000K-2500K (estimate) Senior-level Full Time
Tasks
- Build ETL and ELT pipelines and optimize workloads
- Build ingestion transformation and serving pipelines
- Create standardized data models for analytics and AI consumption
- Develop batch and real time data pipelines on GCP
- Develop reusable data products and transformation logic
- Enable AI ready data pipelines for ML and GenAI
- Follow DevOps practices and participate in code reviews testing and debugging
- Implement data governance monitoring logging lineage and observability
- Implement data quality validations schema management and metadata enrichment
- Implement event-driven and streaming data processing
- Integrate Vertex AI and BigQuery ML
- Modernize legacy data workflows to cloud architectures
- Monitor troubleshoot pipeline performance and failures
- Orchestrate and schedule enterprise data workflows
- Prepare features and data for AI use cases
- Support semantic models and reporting datasets
Perks/Benefits
- N/A
Skills/Tech-stack
Agile | Apache Beam | BigQuery | BigQuery ML | CI/CD | Cloud Composer | Cloud SQL | Cloud Storage | Cloud Workflows | Cloud platform | DBT | Data Catalog | Data Contracts | Data Lineage | Data Modeling | Data Quality | Dataproc | ELT | ETL | GCP Dataflow | Git | Google Cloud | Google Cloud Platform | Looker | Metadata Management | Metadata enrichment | PubSub | PySpark | Python | SQL | Schema management | Semantic Modeling | Vector Databases | Vertex AI
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Member of Technical Staff - AI/ML Engineer INR 2500K-4500KAnomaly Detection | BM25 | Computer Vision | Document Understanding | Entity ResolutionEquity | Professional developmentSenior-level Full TimeHyderabad, TS, IN10h ago
-
AI-Native Software Developer INR 2500K-4000K.NET | AI Evaluation | AI Orchestration Framework | AI guardrails | AI orchestrationMid-level Full TimeBangalore - Karnataka - India10h ago
-
Senior-level Full TimeMaharashtra, Pune, India11h ago
-
Mid-level Full TimeIN-AP-Hyderabad11h ago
-
Senior-level Full TimeIN-AP-Hyderabad11h ago
-
Senior-level Full TimeIN-AP-Hyderabad11h ago
-
Senior-level Full TimeIN-AP-Hyderabad11h ago
-
Senior-level Full TimeIN-TN-Chennai11h ago
-
Senior-level Full TimeIN-HR-Gurgaon11h ago
-
Mid-level Full TimeBangalore, Karnataka, India12h ago
-
AI Data Engineer III INR 3000K-4000KAgile | Amazon Web Services | Apache Airflow | CI/CD | DBTComprehensive insurance | Education assistance program | Fitness benefits | Flexible working hours | Health checkupsSenior-level Full TimeBengaluru, Karnataka, India12h ago
-
Staff Engineer_SAP Analytics Data Management INR 1500K-2700KABAP | ADSO | Analytics Cloud | CompositeProvider | Data ModelingOnsite 5 days per week | Production rollout support | UAT supportSenior-level Full TimeNoida, India12h ago
-
Staff Data Engineer INR 3000K-4132KAWS | Agile | Amazon Redshift | Amazon S3 | Apache AirflowEducation assistance | Fitness benefits | Flexible working hours | Health checkups | Health insuranceSenior-level Full TimeBengaluru, Karnataka, India12h ago
-
Mid-level Full TimeBangalore, Karnataka, India12h ago
-
Power BI Fabric Engineer INR 2000K-2700KAzure Data | Azure Data Factory | CI/CD | DAX | Data FactoryAnnual excellence awards | Bike to work | Career mentorship | Educational assistance | Employee assistance programmeMid-level Full TimeBengaluru, KA, India13h ago
-
Mid-level Full TimeBangalore, Karnataka, India13h ago
-
Mid-level Full TimeBangalore, Karnataka, India13h ago
-
Big Data Lead INR 1500K-2500KAWS S3 | Amazon ECS | Amazon IAM | Apache Airflow | CI/CDClient facing communication | Team collaborationSenior-level Full TimeIndia13h ago
-
Big Data Lead INR 1500K-2500KData Architecture | Data Governance | Data Management | Data Management Cloud | Data WarehouseSenior-level Full TimeIndia14h ago
-
Lead Software Engineer -Python or Java, big data INR 3000K-4500KAWS | AWS Lambda | Agile | Amazon EMR | Amazon Elastic Compute ServiceSenior-level Full TimeBengaluru, Karnataka, India14h ago
-
LAM-MTS-AWS+PySparks INR 1200K-2000KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon CloudWatchMid-level Full TimeNoida, Uttar Pradesh, India14h ago
-
Senior-level Full TimeBengaluru, KA, India14h ago
-
Senior-level Full TimeBengaluru, KA, India14h ago
-
Senior Engineer, Data Engineering INR 1500K-2500KAirflow | Azure | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeBengaluru, KA, India14h ago
-
Solution Integrator (Agentic AI Developer) INR 2475K-4580KAWS | Anthropic Claude | Azure | Chroma | CrewAIEntry-level Full TimeNoida,Uttar Pradesh,India14h ago