Data Engineer
INR 1500K-2500K (estimate) Senior-level Full Time
Tasks
- Apply data governance cataloging and access control
- Automate data pipeline operations and reduce manual effort
- Build MLOps pipelines for AI and machine learning
- Build cloud analytics platforms in GCP
- Design data transformations and modernization
- Design dimensional models for analytics
- Develop analytics data products with streaming and batch ingestion
- Evaluate GCP tools for ingestion integration and reporting
- Implement Data Mesh principles and data contracts
- Implement ELT ETL pipelines for extraction loading transformation validation
- Implement data lineage data quality and data observability
- Ingest data from source applications to GCP
- Integrate generative AI capabilities into data workflows
- Optimize BigQuery schemas and queries
Perks/Benefits
- N/A
Skills/Tech-stack
Access Control | Airflow | Apache Beam | Apache Kafka | Artifact Registry | Astronomer | Automl | BigQuery | BigQueryML | CI/CD | Cloud Composer | Cloud Functions | Cloud Run | Cloud SQL | Cloud platform | Clustering | Compute Engine | Cost Management | Data Catalog | Data Fusion | Data Governance | Data Lineage | Data Observability | Data Quality | Dataflow | Dataform | Dataplex | Dataproc | Dimensional Modeling | ELT | ETL | Feature Store | Gemini | Generative AI | Google Cloud | Google Cloud Platform | Java | LLM orchestration | LLMs | MLOps | Machine Learning | Partitioning | PubSub | Python | Query Optimization | RAG | Retrieval-Augmented Generation | SQL | Snowflake Schema | Star Schema | Tekton | TensorFlow | Terraform | Vector Search | Vertex AI
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Mid-level Full Timekerala, India3h ago
-
Lead Software Engineer - Java, Spring boot, AWS Cloud & AI/ML (REST APIs, System Design, SDLC) INR 3000K-5000KAPI Gateway | AWS Glue | AWS Lambda | AWS Step Functions | AgileSenior-level Full TimeBengaluru, Karnataka, India4h ago
-
Senior-level Full TimeIN-MH-Pune4h ago
-
Data Engineer INR 1500K-2500KAWS | AWS Glue | AWS Lake Formation | AWS Step Functions | Amazon AthenaSenior-level Full TimeIN-MH-Pune4h ago
-
Snowflake Developer INR 1500K-2500KApache Airflow | DBT | Data Sharing | Data Warehousing | Dynamic TablesSenior-level Full TimeIN-TN-Chennai4h ago
-
Associate Engineer - AI/ML INR 2500K-4000KDistributed Systems | Edge AI | GPU | LLM Agents | LangchainAccess to cutting edge technologies and tools | Collaborative work environment | Professional growth and development | Training and development opportunitiesMid-level Full TimeBangalore - Karnataka, India - Kalyani …4h ago
-
Technologist, Data Analytics Engineering INR 3000K-4500KAI orchestration | API Management | Artificial Intelligence | Automation | CI/CDSenior-level Full TimeBengaluru, KA, India5h ago
-
GenAI Specialist INR 2000K-5000KAI Studio | Agent systems | Agentic AI | Azure AI | Azure AI StudioLeadership development | Training and development programsSenior-level Full TimeBengaluru, India5h ago
-
AI Customer Engineer, Conglomerates, Google Cloud INR 3000K-5000KAI Agent Development Kit | Agent Development Kit | Agentic AI | As-a-Service | Audit LoggingSenior-level Full TimeGurugram, Haryana, India; Mumbai, Maharashtra, India6h ago
-
Mid-level Full TimeIndia7h ago
-
GenAI Engineer INR 1500K-3000KAmazon Web Services | Apache Spark | Azure | Chunking | Data StructuresMid-level Full TimeIndia7h ago
-
DE&A - Core - Cloud Data Engineering - Azure Data Engineering INR 3000K-4000KAWS | Agile methodology | Azure | Azure Data | Azure Data FactorySenior-level Full TimePune, Maharashtra, India8h ago
-
Anthropic SDK | Embeddings | Fine Tuning | Git | GitHub ActionsCollaborative values led team | Exposure to global teams and customers | Generous holiday allowance | Hybrid work environment | Individual career developmentEntry-level Apprenticeship Full TimeWhitefield, Bangalore, India9h ago
-
ML-Ops INR 3500K-5000KAsyncio | Benchmarking | CI/CD | CProfile | ConcurrencyLeadership development programs | Training sessionsSenior-level Full TimeMumbai, Maharashtra, India9h ago
-
Staff GenAI Engineer INR 2500K-5000KAWS | Agentic Systems | Azure | CI/CD | Distributed SystemsCollaborative team environment | Leadership development programs | Training sessionsSenior-level Full TimeMumbai, MH, India9h ago
-
Mid-level Full TimeMumbai, Maharashtra, India9h ago
-
Senior-level Full TimeMumbai, Maharashtra, India9h ago
-
Generative AI Engineer INR 1800K-3300KAI Studio | AWS SageMaker | Amazon Bedrock | Anthropic API | Azure AIGlobal consulting projects | Leadership trainingMid-level Full TimeMumbai, Maharashtra, India9h ago
-
Software Development Senior Associate INR 2000K-4500KAmazon Web Services | Artificial Intelligence | CI/CD | Data Analysis | DockerCareer growth opportunities | Certification support | Collaborative work environment | MentorshipSenior-level Full TimeChennai, TN, IN10h ago
-
Mid-level Full TimePune, India10h ago
-
Lead Data Engineer (OIC+Python) INR 2817K-4064KAPI Management | Apache Airflow | Cloud Composer | Cloud infrastructure | Cloud platformSenior-level Full TimeHyderabad, India10h ago
-
Data Scientist- GenAI Engineer INR 1800K-3000KA/B | A/B Testing | B testing | Causal Inference | ClusteringMid-level Full TimeNoida, Uttar Pradesh, India11h ago
-
Manager - Artificial Intelligence & Compliance Automation INR 2500K-5000KAPI Integration | Anomaly Detection | Artificial Intelligence | Automation | Azure AISenior-level Full TimeThane, Maharashtra, India11h ago
-
Senior Analyst - Data Science (Gen AI) INR 2940K-4400KCustomer Journey | Customer journey optimization | Decision Trees | Digital analytics | ExperimentationSenior-level Full TimeGurugram, HR, India11h ago
-
Gen AI - Engineering Lead INR 2000K-5000KAI orchestration | Agentic AI | Benchmarking | CrewAI | EmbeddingsSenior-level Full TimeIndia11h ago