Data Platform Engineer
Tasks
- Build and maintain batch data pipelines
- Build and maintain real-time data pipelines
- Create internal APIs and microservices
- Deploy and manage GCP resources with Terraform
- Develop and monitor Airflow DAGs
- Develop event driven master data integrations
- Manage CI/CD pipelines
- Manage Docker containers
- Publish master data across the enterprise
- Transform raw data into clean models with dbt
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Artifact Registry | BigQuery | CI/CD | Cloud Composer | Cloud Pub/Sub | Cloud Run | Cloud SQL | Cloud SQL for PostgreSQL | Cloud Spanner | Cloud Storage | DBT | Dataflow | Docker | Eventarc | FastAPI | GCP | GitLab | Golang | Jenkins | Kafka | Pub/Sub | Python | React | SQL | Secret Manager | Terraform
Education
Roles
Data Platform | Data Platform Engineer | Engineer | Platform Engineer
Related jobs
-
Data Engineer, YouTube Business Organization INR 1000K-2000KApache Flume | Apache Spark | Data Governance | Data Lakes | Data ModelingMid-level Full TimeBengaluru, Karnataka, India2h ago
-
Senior Software Engineer, Generative AI, Gaming INR 2500K-5000K3D mathematics | C++ | Computer Graphics | Computer Vision | Data ProcessingSenior-level Full TimeBengaluru, Karnataka, India2h ago
-
Senior Artificial Intelligence/Machine Learning Engineer INR 2500K-5000KAWS | Agile | Azure | Embedding Models | Hugging FaceCompany-paid certifications | Financial consultations | Internal events | Language courses | Legal consultationsSenior-level Full TimeIndia2h ago
-
Data Engineer 2 INR 1500K-2500KAgile Development | Cassandra | Cloud Computing | Data Catalog | Data GovernanceSenior-level Full TimePune, Maharashtra, India3h ago
-
Senior Software Engineer INR 1163K-3000KAutomated testing | Batch Processing | CI/CD | DAX | Data GovernanceFlexible work arrangement | Hybrid work modelSenior-level Full TimeIndia, Telangana, Hyderabad R4h ago
-
Senior / Lead Data Engineer - Azure Databricks INR 1500K-3000KAzure Databricks | Azure DevOps | CI/CD | Cloud Security | Conformed DimensionsSenior-level Full TimeHyderabad, TS, India5h ago
-
Apprentice - AI Engineer INR 300K-324KAWS | Anthropic SDK | Azure | Docker | EmbeddingsCareer development | Collaborative team | Exposure to global teams | Holiday allowance | Hybrid work environmentEntry-level Apprenticeship Full TimeWhitefield, Bangalore, India R6h ago
-
Senior-level Full TimeNoida, Uttar Pradesh, India7h ago
-
AI Platform Engineer — Agentic SDLC INR 2000K-5000KAKS | Azure DevOps | Azure OpenAI | CI CD pipeline authoring | CI/CDSenior-level Full TimeBengaluru, KA, India7h ago
-
Lead Associate - Data Ontology / AI INR 1500K-2800KData Engineering | Data Modeling | Generative AI | Graph Databases | Knowledge graphMid-level Full TimePune9h ago
-
Alerting | Automated testing | Batch Processing | Big Table | Data ArchitectureCollaborative culture | Flexible working approach | Health and wellbeing | Learning opportunities | Meaningful technical impactSenior-level Full TimeIndia R10h ago
-
AWS Bedrock | AWS Lambda | Amazon Redshift | CI/CD | Context OptimizationEmployee recognition incentives | Generous leave | Health insurance | Immigration Support Programs | Professional growth trainingMid-level Contract Full TimeIndia R11h ago
-
AWS | AWS Lambda | Access Control | Access History | Access ManagementAugust Free Fridays | Education support | Employee Well Being Resources | Flexible work options | Leadership development programsSenior-level Full TimeIndia11h ago
-
AI Data | AI Data Lineage | AWS | Alation | Apache SparkEducation support | Flexible work environment | Hybrid work | Leadership development | Learning programsSenior-level Full TimeIndia11h ago
-
AWS | Agent Frameworks | Agentic AI | Azure | CI/CDSenior-level Full TimeIndia11h ago
-
Mid-level Full TimeIndia New Delhi (Noida)13h ago
-
Senior Cloud Engineer INR 1500K-4000KAPI Integration | ARM Templates | AWS Glue | AWS Lambda | Access ManagementSenior-level Full TimeIndia New Delhi (Noida)13h ago
-
Tech Consultant - AI & Machine Learning INR 2520K-4000KAzure | Azure Kubernetes | Azure Kubernetes Service | Azure Machine Learning | CI/CDSenior-level Full TimeNoida, UP, IN R13h ago
-
FBS Associate Analytics Engineer INR 1000K-2000KAWS | Apache Airflow | Azure | Cloud platform | DBTCareer development | Flexible work arrangements | Paid time off | Pension plan | Private health insuranceMid-level Full TimeHyderabad, Telangana, India R13h ago
-
API | AWS CloudFormation | AWS CloudTrail | AWS Glue | AWS Glue Data CatalogCareer development opportunities | Coaching and feedback | Flexible work approachSenior-level Full TimeHyderabad, TG, IN, 50008113h ago
-
EY - GDS Consulting - AI And DATA -AWS Data Engineer - Manager INR 2000K-2700KAPI Integration | AWS CloudTrail | AWS Glue | AWS Glue Data Catalog | AWS IAMCareer development opportunities | Coaching and feedback | Flexible work approach | Supportive and inclusive work cultureMid-level Full TimeHyderabad, TG, IN, 50008113h ago
-
APIs | Access Control | Amazon Neptune | CI/CD | Conceptual data modelingSenior-level Full TimeHyderabad, TG, IN, 50008113h ago
-
EY - GDS Consulting - AI And DATA -AI Data Platform Engineer - AI Data Platform Engineer - MS Fabric INR 2771K-5000KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageCareer development | Coaching | Flexible working hoursSenior-level Full TimeHyderabad, TG, IN, 50008113h ago
-
ABAC | API Gateway | AWS CloudFormation | AWS Glue | AWS LakeSenior-level Full TimeHyderabad, TG, IN, 50008113h ago
-
Senior Lead AI Engineer INR 2500K-4680KAPI Development | Artificial Intelligence | Auditability | Azure | Azure DevOpsSenior-level Full TimeMumbai Central Avenue, India13h ago