Data Platform engineer
Tasks
- Architect data lake and warehouse
- Build distributed streaming pipelines
- Containerize deployments with Docker
- Deploy and manage infrastructure with Terraform
- Design data pipelines for real time and batch
- Develop backend tooling internal APIs and microservices
- Ensure high availability of operational data store
- Implement DevOps and SRE practices
- Maintain data platform scalability and consistency
- Manage end to end data warehouse lifecycle
- Model transform and test data with dbt
- Optimize database performance schema design and security
- Orchestrate workflows with Apache Airflow DAGs
- Own CI/CD pipelines
Perks/Benefits
Skills/Tech-stack
Apache Airflow | Artifact Registry | BigQuery | CI/CD | Cloud Composer | Cloud Run | Cloud SQL | Cloud Spanner | Cloud Storage | Cloud platform | DBT | Dataflow | Docker | Eventarc | FastAPI | GCP Monitoring | GitLab | Golang | Google Cloud | Google Cloud Platform | IAM | Jenkins | Kafka | PostgreSQL | Prefect | Pub/Sub | Python | React | Secret Manager | Terraform | Vertex AI
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Senior-level Full TimeIN-AP-Hyderabad6h ago
-
Senior-level Full TimeIN-TN-Chennai6h ago
-
Senior Tech Lead INR 2000K-4800K.NET | AKS | ASP.Net Core | Application Insights | Asynchronous programmingSenior-level Full TimeIN-AP-Hyderabad6h ago
-
Mid-level Full TimeIndia-Bangalore7h ago
-
Validation/Verification (UVM, Coverage, Agentic), Staff Engineer INR 2000K-2372KAI Assisted Verification | Code Coverage | Coverage analysis | Debugging | Functional CoverageSenior-level Full TimeHyderabad, India7h ago
-
Senior Data Engineer (Python + Oracle db) INR 2829K-3500KApache Hive | CI/CD | Databricks | Microsoft Azure | Oracle DatabaseEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India7h ago
-
Assistant Director,Collections Analytics Lead INR 1800K-2205KAWS | Alteryx | Apache Spark | Azure | Cloud DataprocDiversity programsSenior-level Full TimeKolkata, West Bengal, India R7h ago
-
Software Engineer III, Spanner SQL, Data Types, Google Cloud INR 2000K-3000KAPI Design | C++ | Database Internals | Database Performance Optimization | Database performanceSenior-level Full TimeBengaluru, Karnataka, India8h ago
-
AI/ML Infrastructure Software Engineer INR 2500K-4800KC++ | Hyperparameter Optimization | JAX | Keras | ML ExplainabilitySenior-level Full TimeBengaluru, Karnataka, India8h ago
-
AI and Data Engineer, Google Cloud INR 1500K-2500KAccess Management | Apache Hive | Apache Pig | Apache Spark | Data ComplianceMid-level Full TimeBengaluru, Karnataka, India8h ago
-
Ai/Ml Testing-Ai, Ml, Deep Learning, Data Mining, Analytics INR 1000K-2100KAPI Testing | Accuracy testing | Data Validation | ETL | EmbeddingsMid-level Full TimeChennai, Tamil Nadu, India8h ago
-
AES - DE -JAVA - Generative AI Application Developers INR 2500K-4000KAWS | Agile | Azure | CI/CD | Data EngineeringSenior-level Full TimeBangalore, Karnataka, India9h ago
-
Senior AI Engineer INR 2475K-4500KADLS | AI Services | Active Directory | Anomaly Detection | Azure AISenior-level Full TimeIndia9h ago
-
Senior-level Full TimeChennai, Tamil Nadu, India9h ago
-
Azure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageExecutive-level Full TimeBangalore, Karnataka, India10h ago
-
Lead Assistant Manager INR 2125K-3500KAI Foundry | Access Control | Active Directory | Application Insights | Azure Active DirectorySenior-level Full TimeGurugram, Haryana, India10h ago
-
Kafka Site Reliability Engineer (SRE)/Associate Director, Software Engineering Specialist INR 1400K-2700KContainerization | Infrastructure as Code | Kafka | Kubernetes | LoggingFlexible working | Inclusive and diverse environment | Professional developmentMid-level Full TimePune, Maharashtra, India R10h ago
-
Lead AI Engineer INR 2500K-4000KAI Governance | AWS | Agent systems | Agentic AI | Backend EngineeringSenior-level Full TimeHyderabad, Telangana, India10h ago
-
Senior-level Full TimeIndia11h ago
-
QA Engineer - GenAI, VoiceAI, Telephony, and IVR testing INR 1500K-2500KAPI Testing | ASR | Automation frameworks | CCaaS | Call RoutingMid-level Full TimeNoida, Uttar Pradesh, India11h ago
-
Senior Analyst, Business Analytics INR 2520K-3380KApache Airflow | Apache Spark | Cloud platform | Data Analysis | Data CleansingRelocation assistanceSenior-level Full TimeMumbai, MH, IN12h ago
-
Sr Data Security Platform Engineer INR 1500K-3500KAPI | Azure | Azure Functions | Azure Logic | Azure Logic AppsSenior-level Full TimeIndia12h ago
-
Mid-level Full TimeBangalore, Karnataka, India13h ago
-
Azure DevOps | Bash | CI/CD | Docker | EBPFMentorshipMid-level Full TimeBangalore, Karnataka, India13h ago
-
Azure DevOps | Bash | Docker | GitOps | GrafanaLearning-focused culture | MentorshipMid-level Full TimeBangalore, Karnataka, India13h ago