Associate Technical Architect
DGS India - Mumbai - Thane Ashar IT Park
INR 1500K-2500K (estimate) Mid-level Full Time
Tasks
- Apply data mesh data as a product
- Build AI ready feature engineering pipelines
- Build reusable data products
- Design scalable GCP data platforms
- Develop batch streaming event driven pipelines
- Develop semantic modeling for business metrics
- Enable metadata enrichment and data quality frameworks
- Ensure production readiness with testing validation
- Establish CI CD and data pipeline automation
- Implement ETL/ELT frameworks
- Implement RAG architectures and semantic search
- Implement data contracts and schema management
- Implement governance reliability and observability
- Integrate Vertex AI BigQuery ML and GenAI
- Integrate data catalog lineage and metadata management
- Lead day to day engineering delivery
- Mentor data engineering teams
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Apache Beam | BigQuery | BigQuery ML | CI/CD | Cloud Composer | Cloud SQL | Cloud Storage | Cloud Workflows | Cloud platform | DBT | Data Catalog | Data Governance | Data Lineage | Data Quality | Dataflow | Dataproc | ELT | ETL | GenAI | Google Cloud | Google Cloud Platform | Langchain | Metadata Management | Monitoring | Observability | PubSub | PySpark | Python | RAG | SQL | Semantic Search | Vector Databases | Vertex AI
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Data Engineer | Engineer | GCP Data Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
APIs | AWS | Algorithms | Azure | CI/CDSenior-level Full TimeKolkata DN 57, India4h ago
-
MDG Data Engineer (SAP Master Data Governance) INR 1524K-2500KAsset Management | Business Partner | Business Rules | Change Request | DRFMid-level Full TimeRMZ Ecoworld 32, India6h ago
-
Senior-level Full TimeHyderabad, IND-TG, India11h ago
-
Senior-level Full TimeHyderabad, IND-TG, India11h ago
-
Senior-level Full TimeHyderabad, IND-TG, India11h ago
-
Data Engineer INR 1500K-2500KAgile | BeautifulSoup | Browse AI | CSV | Data PipelinesHybrid work | Paid time offMid-level Full TimeHyderabad, India12h ago
-
Senior Automation Specialist INR 1500K-3000KAPI Integration | Access Controls | Alerting | Data Quality | MonitoringSenior-level Full TimeHyderabad, India13h ago
-
Software Engineer (ETL TESTER - DATA WAREHOUSING, DATA PROCESSING, SQL, UAT, SNOWFLAKE) INR 1000K-1500KAirflow | Azure Data | Azure Data Factory | Batch Processing | Control-MEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India14h ago
-
Mid-level Full TimeIN-AP-Hyderabad15h ago
-
Data Engineering Manager INR 1500K-2500KADLS | Access Management | Azure | Azure Data | Azure Data FactoryMid-level Full TimeBangalore, Karnataka, India16h ago
-
GCP Data Engineer - Associate Director INR 800K-2000KApache Airflow | Apache Kafka | Apache Spark | BigQuery | CI/CDMid-level Full TimeHyderabad, Telangana, India16h ago
-
Senior-level Full TimeHadapsar, Pune, Maharashtra, IND, 41101316h ago
-
AI Engineer INR 1500K-3000KAzure Databricks | Data Engineering | Data engineering pipelines | Embeddings | Engineering PipelinesMid-level Full TimeBengaluru, Karnataka, India16h ago
-
Senior Engineer Digital & AI Solutions INR 4000K-6000KAPI Development | Agent systems | CI/CD | Cloud Computing | ContainerizationFood allowance | Health insurance | Hybrid work | Internet allowance | Learning and development programsSenior-level Full TimeHyderabad, Telengana, India17h ago
-
Manager of Software Engineering-Java, Flink,Kafka INR 1500K-2200KAWS | Agile | Amazon EKS | Apache Flink | Apache KafkaMid-level Full TimeHyderabad, Telangana, India17h ago
-
Software Engineer II,Python, Spark INR 1500K-2200KAWS | AWS Glue | AWS Glue Catalog | AWS KMS | AWS Lake FormationMid-level Full TimeMumbai, Maharashtra, India18h ago
-
AI QA Engineer - Bangalore, IND INR 2000K-3000KAPI Development | Claude | Docker | Embeddings | Evaluation FrameworksMid-level Full TimeIndia18h ago
-
Lead Software Engineer - Java/Python, AWS,LLM INR 3500K-5000KA/B | A/B Testing | AWS Lambda | Agentic AI | AgileSenior-level Full TimeMumbai, Maharashtra, India18h ago
-
Staff Engineer, Data Analytics Engineering INR 2500K-3500KAPIs | AWS Glue | AWS Lambda | AWS S3 | Amazon BedrockSenior-level Full TimeBengaluru, KA, India18h ago
-
Lead Data Scientist INR 3000K-5000KCloud platform | Data Augmentation | Data Mining | Data Modeling | Generative AISenior-level Full TimeChennai, Tamil Nadu, India18h ago
-
Staff Data Scientist INR 2000K-4500KAlgorithms | Data Lakes | Data Structures | Deep learning | DockerSenior-level Full TimeBangalore, India Office (BANGALORE) R19h ago
-
Senior Associate - Data Science/Applied AI ML INR 1400K-2400KAnomaly Detection | Backtesting | Bias/fairness | CI/CD | ClassificationMid-level Full TimeMumbai, Maharashtra, India21h ago
-
Senior Associate - Data Science/Applied AI ML INR 1400K-2400KAnomaly Detection | Bias and fairness | CI/CD | Classification | ClusteringMid-level Full TimeMumbai, Maharashtra, India21h ago
-
Data Engineer (GCP) INR 1500K-2040KAPIs | Airflow | Authentication | Authorization | BigQueryAgile collaboration | Autonomy | Flexible environmentMid-level Full TimePune, Maharashtra, India21h ago
-
Senior-level Full Timetelengana, India21h ago