Data Engineer
INR 1500K-2500K (estimate) Senior-level Full Time
Tasks
- Automate data pipeline operations
- Build and maintain analytical data models using dimensional modeling
- Build cloud analytics platforms on Google Cloud Platform
- Create streaming and batch ingestion pipelines
- Design data pipelines with data lineage and data observability
- Design data transformation and modernization on GCP
- Develop and validate ETL ELT data processing pipelines
- Implement Data Mesh principles and data contracts
- Implement MLOps pipelines and integrate generative AI into data workflows
- Implement data governance and access control with cataloging
- Ingest data from source systems to GCP
- Optimize BigQuery performance using partitioning and clustering
Perks/Benefits
- N/A
Skills/Tech-stack
AI Pipelines | Agile | Apache Airflow | Apache Beam | Apache Kafka | Artifact Registry | Automl | Batch Ingestion | BigQuery | BigQueryML | CI/CD | Cloud Composer | Cloud Functions | Cloud Pub/Sub | Cloud Run | Cloud SQL | Cloud platform | Compute Engine | DBT | Data Catalog | Data Fusion | Data Governance | Data Lineage | Data Observability | Data Quality | Dataflow | Dataform | Dataplex | Dataproc | Dimensional Modeling | ELT | ETL | Generative AI | Git | Google Cloud | Google Cloud Platform | Google Cloud Pub/Sub | Infrastructure as Code | Java | Jenkins | LLM orchestration | MLOps | Machine Learning | Pub/Sub | Python | RAG | Retrieval-Augmented Generation | SQL | Snowflake Schema | Star Schema | Streaming Ingestion | Tekton | TensorFlow | Terraform | Vertex AI | Vertex AI pipelines | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Gen AI INR 2000K-3500KAI Agent | AI Governance | AI agent evaluation | AWS CodePipeline | Agent OrchestrationMid-level Full TimeIN-AP-Hyderabad6h ago
-
Data Engineer INR 1500K-2000KApache Airflow | BigQuery | Cloud Composer | Cloud Dataproc | Cloud FunctionsMid-level Full TimeIndia-Telangana-Hyderabad6h ago
-
Data Scientist Associate INR 1400K-2400KAnalytics | Artificial Intelligence | Compliance | Data Analysis | Fraud DetectionMid-level Full TimeBengaluru, Karnataka, India6h ago
-
Mid-level Full TimeGurugram, Haryana, India7h ago
-
Advanced Specialist, Technology Data Analyst INR 2200K-4000KAccess Control | Bash | CI/CD | Cause analysis | Collibra24/7 on-call rotationSenior-level Full TimeChennai, Tamil Nadu, India7h ago
-
Forward Deployed Engineer, Generative AI, GECX, Google Cloud INR 2000K-3500KAPIs | Cloud infrastructure | Cloud platform | Debugging | Full StackAccess to advanced AI portfolio | Collaborative culture | Direct access to engineering and research teams | High travelMid-level Full TimeBengaluru, Karnataka, India7h ago
-
Gen AI - Consultant INR 2000K-4500KAWS SageMaker | Apache Airflow | Apache Spark | Azure Machine Learning | CI/CDSenior-level Full TimeBangalore, Karnataka, India8h ago
-
Azure Cloud Devops Module Lead INR 2200K-3500KAuthentication | Authorization | Azure Monitor | Incident Management | Log AnalyticsSenior-level Full TimeNoida, Uttar Pradesh, India8h ago
-
Alerting | Automated testing | Business Intelligence | CI/CD | Dashboard DevelopmentMid-level Full TimeBangalore, Karnataka, India8h ago
-
Senior Specialist, Business Data Architecture INR 1500K-2500KAzure Data | Azure Data Factory | CI/CD | Cloud Data | Cloud Data PlatformsSenior-level Full TimePune, MH, India8h ago
-
AI/ML Engineer Intern INR 96K-180KAutoencoders | Bayesian optimization | Clustering | Correlation Analysis | Data PreprocessingEntry-level Full Time InternshipHyderabad, India8h ago
-
Senior-level Full TimeGurugram, Haryana, India9h ago
-
AI Builder | AWS | Agile | Amazon Redshift | AzureMid-level Full TimeBangalore, Karnataka, India10h ago
-
Senior Data Engineer INR 3264K-5012KAWS | Agile | Airflow | Alerting | CSVFlexible work options | Life leave days | Professional development days | Vacation time | Volunteer daysSenior-level Full TimePune, MH, India10h ago
-
Senior Engineer (India Office) INR 1500K-2500KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeBangalore, Karnataka, India11h ago
-
Associate Distinguished Engineer (Agentic AI Architect) INR 2000K-3300KAgent SDK | AgentOps | Amazon Web Services | Autogen | AzureMid-level Full TimeIndia, India11h ago
-
Alerting | Automated testing | Business Intelligence | CI/CD | Dashboard governanceEntry-level Full TimeBangalore, Karnataka, India12h ago
-
DevOps Engineer INR 1600K-2525KAWS | Azure | Azure DevOps | Bash | CI/CDGlobal diverse environment | Hybrid work flexibility | Inclusive workplace | Sustainability focused teamMid-level Full TimePune, Maharashtra, India12h ago
-
Azure Data Engineer - Con - MFT KGS CH INR 1500K-2800KAgile | Azure Cloud | Azure Cloud Services | Azure Data | Azure Data FactorySenior-level Full TimeBangalore, Karnataka, India12h ago
-
Azure Data Engineer - Con - MFT KGS CH INR 1500K-2800KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksSenior-level Full TimeBangalore, Karnataka, India12h ago
-
Senior AI/ML Engineer I INR 2475K-4400KAgentic AI | Azure | BERT | Continuous integration | Decoder ArchitectureCareer advancement programs | Certification programs | Education reimbursement | Employee assistance program | Flexible work optionsSenior-level Full TimeHyderabad, Telangana, India13h ago
-
AI Developer II INR 1800K-3000KAI Agents | API-driven | API-driven integration | Automation | CrewAIMid-level Full TimeIndia | Pune13h ago
-
Germany (FS- D&A)-AM-BLR INR 1500K-2500KAlteryx | Anomaly Detection | Azure | Azure Cognitive | Azure Cognitive ServicesMid-level Full TimeBangalore, Karnataka, India13h ago
-
Senior-level Full Timecoimbatore, India14h ago
-
Asynchronous processing | Backend architecture | CI/CD | Caching | Computer VisionCareer growth opportunities | Collaborative and inclusive culture | High ownership and autonomy | Opportunity to work on cutting-edge AISenior-level Full TimeIndia14h ago