Senior Data Engineer
DGS India - Mumbai - Thane Ashar IT Park
INR 2000K-2500K (estimate) Senior-level Full Time
Tasks
- Build AI-ready data pipelines
- Build ETL and ELT pipelines
- Build ingestion transformation and serving pipelines
- Create reusable domain data products
- Develop and maintain batch data pipelines
- Develop and maintain real-time data pipelines
- Develop event driven streaming data processing solutions
- Ensure security governance and compliance
- Follow coding standards and architecture guidelines
- Implement data contracts
- Implement data transformation logic and standardized data models
- Implement monitoring logging lineage and observability
- Implement reusable data engineering components
- Integrate Vertex AI and BigQuery ML
- Integrate metadata and data catalog
- Integrate vector databases
- Maintain engineering documentation and runbooks
- Manage schemas and metadata enrichment
- Modernize legacy data workflows
- Monitor and troubleshoot pipeline performance and failures
- Optimize data processing workloads
- Orchestrate and schedule data workflows
- Perform code reviews, testing, and debugging
- Perform data quality validations
- Support feature engineering and data preparation workflows
- Support incident resolution and root cause analysis
- Support semantic models for analytics
- Support semantic search and AI assisted data interaction
- Support standardized metrics and reporting datasets
Perks/Benefits
- N/A
Skills/Tech-stack
Agile | Airflow | Apache Beam | BigQuery | BigQuery ML | CI/CD | Cloud Composer | Cloud SQL | Cloud Storage | Cloud platform | DBT | Data Catalog | Data Lineage | Dataflow | Dataproc | GenAI | Git | Google Cloud | Google Cloud Platform | Looker | Metadata Management | PubSub | PySpark | Python | SQL | Vector Databases | Vertex AI | Workflows
Roles
Related jobs
-
Lead - AI/ML Engineer (Generative AI Agent Systems) INR 3700K-5000KAI Agent Development Kit | AI tuning | Agent Development Kit | Agent Engine | Agentic WorkflowsSenior-level Contract Full TimePune, MH, India5h ago
-
Principal Engineer, Technical Architect INR 2000K-5000K.NET | API first | API-first design | Access Control | Agent OrchestrationSenior-level Full TimeRemote, India R5h ago
-
Principal Engineer, Technical Architect INR 2000K-5000K.NET | API Design | Access Control | Artificial Intelligence | Batch inferenceSenior-level Full TimeRemote, India R6h ago
-
Applied AI/ML Engineer INR 1800K-3000KAgent workflows | Agentic Systems | Auditability | Drift Detection | Error HandlingMid-level Full TimeBengaluru, Karnataka, India6h ago
-
Sr IT Analyst INR 1500K-2500KETL | Informatica IDMC | Informatica PowerCenter | Linux | Python24 7 shift model | On-call supportSenior-level Full TimeBengaluru, Karnataka, India8h ago
-
Senior-level Full Timebengaluru, India8h ago
-
Senior-level Full Timebengaluru, India8h ago
-
Senior-level Full Timebengaluru, India8h ago
-
Mid-level Full Timebengaluru, India8h ago
-
AI Intern INR 180K-240KAzure | Data Preprocessing | Debugging | FastAPI | FlaskMentorship | On site work experienceEntry-level Full Time InternshipBangalore, Karnataka, India9h ago
-
DTICI_Engineering_Data_Analysis_Engineer_T9 INR 2000K-2800KAI | Apache Spark | Centralized Logging | Data Analysis | Data WranglingSenior-level Full TimeBengaluru, Karnataka, India9h ago
-
Senior Data Engineer INR 3264K-5449KData Architecture | Data Catalog | Data Pipelines | Data Quality | Machine LearningFamily benefits | Flexible working options | Health benefits | Paid time offSenior-level Full TimeIndia10h ago
-
Associate Big Data Engineer INR 933K-2000KApache Airflow | Apache Hadoop | Apache Hive | Apache Spark | Data FlowBirthday off | Flexible working hoursMid-level Full TimeGurgaon10h ago
-
Sr. Data Engineer INR 1500K-2500KAWS Glue | AWS Lambda | Amazon S3 | Apache Spark | Data LakeMentorship opportunitiesSenior-level Full TimeBangalore, KA, IN,11h ago
-
Principal Engineer, Sitecore Architect (Optimizely) INR 4000K-6500KA/B | A/B Testing | A/B Testing Tools | ASP.NET MVC | ASP.Net CoreSenior-level Full TimeRemote, India R12h ago
-
Senior Software Engineer (Java Full Stack /AWS) INR 3242K-4200KAWS | AWS Security | Agile | Continuous Delivery | Continuous DeploymentEnhanced medical benefits | Family well-being benefits | Paid time off | Wellness programsSenior-level Full TimeHyderabad, India13h ago
-
Senior Software Engineer INR 3000K-4000KALB | API Gateway | AWS ECS | AWS Glue | AWS LambdaFamily well-being benefits | Health benefits | Hybrid work | Paid time off | Volunteering opportunitiesSenior-level Full TimeHyderabad, India13h ago
-
Senior Machine Learning Engineer, Data Insights INR 2520K-4200KAWS | Apache Airflow | Apache Spark | Azure | C++Financial wellness support | Flexible work schedule | Healthcare benefits | Mental health support | Time offSenior-level Full TimeBengaluru, India13h ago
-
Applied AI Engineer (India) INR 1500K-3000KAgentic Workflows | Automation | CRM | Compliance | Cost OptimizationFast hiring process | Remote workMid-level Full TimeIndia15h ago
-
Agentic AI Engineer INR 2137K-3550KAPIs | Agentic AI | Agile | Automation | Cloud ComputingFamily wellbeing benefits | Health and wellbeing benefits | Paid time offMid-level Full TimeHyderabad, India16h ago
-
Data Engineer INR 1500K-2541KAgile | Automation | BeautifulSoup | CSV | Data IngestionEnhanced medical benefits | Family wellbeing benefits | Paid time off | Wellbeing programs | Work-life balanceMid-level Full TimeHyderabad, India16h ago
-
Software Engineer - (Java Full Stack,AWS) INR 1500K-2400KAPI Gateway | AWS | AWS Lambda | Amazon EKS | Amazon S3Health benefits | Paid time off | Work-life balanceMid-level Full TimeHyderabad, India17h ago
-
Lead Data Platform Engineer INR 2800K-4064KAPI Integration | AWS DataZone | AWS Glue | AWS Lake Formation | AWS LambdaEnhanced medical benefits | Family wellbeing benefits | Hybrid Remote and In Office | Paid time off | Work-life balanceSenior-level Full TimeHyderabad, India17h ago
-
Airflow | Batch data | Batch data pipelines | DBT | DagsterCareer advancement opportunities | Continuous growth opportunities | Health and wellbeing benefits | Remote work flexibility | Supportive workplace cultureSenior-level Full TimeIndia17h ago
-
AI Model Routing | AI model | AI platforms | AWS | Audit LoggingCareer development | Collaborative culture | Generous time off | Mental health support | Remote-firstSenior-level Full TimeIndia17h ago