Senior Data Engineer
DGS India - Mumbai - Thane Ashar IT Park
INR 2000K-3000K (estimate) Senior-level Full Time
Tasks
- Add data quality validations schema management and metadata enrichment
- Apply data contracts and reusable transformation frameworks
- Build and optimize ETL and ELT pipelines
- Build ingestion transformation and serving pipelines
- Create reusable domain oriented data products
- Develop batch and real time data pipelines on GCP
- Ensure security governance and compliance adherence
- Implement data transformation logic and standardized data models
- Implement event-driven and streaming data processing
- Implement monitoring logging lineage and observability frameworks
- Implement semantic models and analytics friendly data structures
- Integrate with Vertex AI and BigQuery ML
- Maintain engineering documentation and operational runbooks
- Modernize legacy data workflows to cloud native architectures
- Monitor troubleshoot and optimize pipeline performance and reliability
- Orchestrate and schedule enterprise data workflows
- Participate in code reviews testing debugging and performance optimization
- Support feature engineering and data preparation for AI ML
- Support semantic search and AI ready data pipelines
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Apache Beam | BigQuery | BigQuery ML | CI/CD | Cloud Composer | Cloud SQL | Cloud Storage | Cloud Workflows | Cloud platform | DBT | Data Catalog | Data Contracts | Data Lineage | Data Quality | Dataflow | Dataproc | Git | Google Cloud | Google Cloud Platform | Looker | Metadata Management | Observability | Pub/Sub | PySpark | Python | SQL | Schema management | Semantic Modeling | Vector Database | Vertex AI | Workflows
Education
Bachelor of Engineering | Bachelor of Engineering in Computer Science | Bachelor of Engineering in Information Systems | Bachelor of Science | Bachelor of Science in Computer Science | Bachelor of Science in Information Systems
Roles
Related jobs
-
D&T Lead - Data Science INR 3000K-5000KAgentic AI | AlloyDB | Apache Airflow | Artificial Intelligence | CI/CDSenior-level Full TimePune, IN4h ago
-
Intermediate Backend Engineer - Analytics Instrumentation INR 2000K-3370KAt-Scale | Backend Development | ClickHouse | Cloud Native | Data QualityEquity compensation | Flexible paid time off | Growth and development fund | Parental leave | Remote workMid-level Full TimeRemote, India R4h ago
-
Dir, Machine Learning Engrg Mgmt INR 3242K-4200KAlgorithms | Code optimization | Design Patterns | Java | Machine LearningFlexible work options | In-office work options | Remote work optionsSenior-level Full TimeHyderabad, India4h ago
-
Senior Data Quality Engineer (ETL Testing) INR 2000K-3000KAWS Glue | AWS Lambda | AWS Step Functions | Agile | Amazon AthenaContract-to-hire | Remote workSenior-level Full TimeBangalore, India5h ago
-
API Design | AWS | Amazon SageMaker | Automated retraining | CI/CDAutonomy and ownership | Continuous learning | Fully remote | High-growth environment | Professional developmentSenior-level Full TimeIndia R5h ago
-
Python with ADB INR 1500K-2000KAPI Testing | Agile | Azure | Azure DevOps | CI/CDCareer growth programs | Flexible work hours | Generative AI Certifications Support | Remote work | Work-life balanceMid-level Full TimeHyderabad, IN11h ago
-
Senior Staff Engineer (AI Full-stack Developer) INR 2000K-5000KAWS | Access Controls | Agentic Workflows | Asynchronous programming | Audit LoggingSenior-level Full TimeMumbai, India1d ago
-
Senior Staff Engineer (AI Solution Design) INR 4000K-5500KAlerting | Artificial Intelligence | Data Architecture | Data Lakes | Data PipelinesSenior-level Full TimeMumbai, India1d ago
-
Senior-level Full TimeMumbai, MH, India1d ago
-
Mid-level Full TimeIndia - Remote R1d ago
-
Senior-level Full TimePune, India1d ago
-
AI Engineer INR 2000K-4500KAI Foundry | AI Services | API Development | Azure AI | Azure AI FoundryMid-level Full TimeBangalore, IN1d ago
-
Senior Data Engineer - Consulting INR 2500K-4000KAJAX | AWS ECS | Agile | Azure Data | Azure Data FactorySenior-level Full TimeHyderabad, Telangana1d ago
-
Data Engineer - Delivery INR 1500K-2000KAmazon Web Services | Azure Blob | Azure Blob Storage | Blob Storage | Data ManagementCollaborative team | Professional growth | Training completionMid-level Full TimeHyderabad, Telangana1d ago
-
Senior-level Full TimeBengaluru, KA, IN1d ago
-
Sr SDE (Java + AI) INR 3000K-5000KAI orchestration | AWS | Alerting | Automated testing | AzureDesign review leadership | MentorshipSenior-level Full TimePune City, India1d ago
-
AIOps | APIs | AWS | Anomaly Detection | AzureFlexible working hours | Fully remote | Remote collaborationMid-level Full TimeIndia R1d ago
-
Embedded Software Development Engineer (8-10 Years) INR 3200K-4110KAUTOSAR | Agile | Assembly | Automated testing | Automotive SPICESenior-level Full TimeBengaluru, India2d ago
-
Data Scientist - GenAi-AgenticAi INR 2500K-5000KAI orchestration | AWS | Agentic AI | Crew AI | Data MiningSenior-level Full TimeIndia2d ago
-
Senior-level Full TimeIndia - Bangalore2d ago
-
Staff Software Engineer - Data Platform INR 3000K-4000KAWS | Azure | Bazel | BigQuery | BuildkiteCell phone stipend | Free food | Holidays | In-office collaboration | Medical insuranceSenior-level Full TimeBengaluru, Karnataka, India, APAC2d ago
-
Senior-level Full TimeMumbai, MH, IN, 4000722d ago
-
Senior AI Engineer – Data Science & Generative AI INR 2000K-5000KAPI Development | AWS | Agentic AI | Asynchronous programming | AutogenSenior-level Full TimeBengaluru, KA, IN2d ago
-
Lead Engineer - Embedded Software INR 1716K-2400KBuild environment | C# | C++ | CAN | Cloud IntegrationEmployee assistance program | Flexible schedule | Health insurance | Leave policy | Professional development opportunitiesSenior-level Full TimeBuilding No: 12C, Floor 9,10,11, Building …2d ago
-
Lab and Center Data Engineer INR 938K-1408KAnsible | Bash | Enterprise Linux | Infrastructure as Code | KVMMid-level Full TimePune, Maharashtra, India2d ago