Data Platform engineer
Tasks
- Architect data lake and warehouse
- Build distributed streaming pipelines
- Containerize deployments with Docker
- Deploy and manage infrastructure with Terraform
- Design data pipelines for real time and batch
- Develop backend tooling internal APIs and microservices
- Ensure high availability of operational data store
- Implement DevOps and SRE practices
- Maintain data platform scalability and consistency
- Manage end to end data warehouse lifecycle
- Model transform and test data with dbt
- Optimize database performance schema design and security
- Orchestrate workflows with Apache Airflow DAGs
- Own CI/CD pipelines
Perks/Benefits
Skills/Tech-stack
Apache Airflow | Artifact Registry | BigQuery | CI/CD | Cloud Composer | Cloud Run | Cloud SQL | Cloud Spanner | Cloud Storage | Cloud platform | DBT | Dataflow | Docker | Eventarc | FastAPI | GCP Monitoring | GitLab | Golang | Google Cloud | Google Cloud Platform | IAM | Jenkins | Kafka | PostgreSQL | Prefect | Pub/Sub | Python | React | Secret Manager | Terraform | Vertex AI
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Senior-level Full TimeIN-TN-Chennai16h ago
-
Senior Data Engineer INR 1500K-2500KAlerting | Apache Pinot | BigQuery | Cloud platform | Cost OptimizationSenior-level Full TimeBangalore, India17h ago
-
Senior Manager - C2 INR 3000K-5000KAI Observability | Docker | Embedding Models | Evaluation | Generative AISenior-level Full TimeGurugram, Haryana, India17h ago
-
Java Full Stack Engineer - Professional INR 1300K-2200KAmazon Web Services | Apache Kafka | AppDynamics | Automation | Cause analysisClient office work requirement | Hybrid work modelMid-level Full TimeIndia R17h ago
-
Executive-level Full TimeMumbai, Maharashtra, India18h ago
-
GenAI Engineer INR 1200K-2500KAWS | Artificial neural networks | Azure | Data Structures | DatabricksMid-level Full TimeIndia19h ago
-
Bootloader | C# | CAN | Configuration Management | DebuggingFlexi benefits | Health insurance | Hybrid working model | Internal job rotation | Life insuranceEntry-level Full TimeBangalore, IN20h ago
-
Assistant Manager INR 1200K-2000KAPI Integration | CI/CD | Data Engineering | Data Governance | Data QualityMid-level Full TimeGurugram, Haryana, India21h ago
-
Executive-level Full TimeBangalore, Karnataka, India22h ago
-
Senior Data Integration Engineer I INR 3264K-4401KAWS IAM | Airflow | Amazon VPC | Apache Flink | Apache SparkSenior-level Full TimeBengaluru23h ago
-
Senior Data Engineer I INR 2500K-3380KAgile | Apache Airflow | Apache Hadoop | Apache Hive | Apache KafkaInclusive culture | Professional development time | Supportive team environment | Work-life balanceSenior-level Full TimeGurugram, HR, India23h ago
-
Analytics Engineer INR 1500K-3000KDBT | Data Governance | Data Modeling | Git | MetaplaneCareer developmentMid-level Full TimeIndia23h ago
-
Data Engineer INR 1340K-1680KAWS | Azure | ClickHouse | DBT | Data ArchitectureDonation matching | Flexible PTO | Flexible schedule | Health insurance | Lunch stipendMid-level Full TimeBengaluru, Karnataka, India1d ago
-
Senior Analyst-Data Science INR 2500K-4400KA/B | A/B Testing | B testing | Causal Inference | Data PreparationSenior-level Full TimeGurugram, HR, India1d ago
-
IN_Associate_AI Engineer_GCC_Advisory_Hyderabad INR 2500K-4800KAPI Development | Anthropic API | Async Programming | Autogen | CI/CDFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeHyderabad - Salarpuria, India1d ago
-
Data Engineer (SQL + Python/Java) INR 700K-1500KAWS EMR | Agile Scrum | Amazon Web Services | Apache Spark | Continuous DeliveryHybrid work flexibility | Remote work supportMid-level Full TimeGurgaon - Cyber Park, India1d ago
-
IN_Sr Associate_ AWS Devops With MLOPs Developer_Application Technology_Advisory_ PAN INDIA (early joiners) INR 3000K-4000KAWS | AWS Lambda | Amazon CloudFormation | Amazon EKS | Amazon S3Flexibility programs | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India1d ago
-
Vice President - Principal Data Engineer INR 3584K-5500KAPI | AWS | Agile | Anomaly Detection | AzureComprehensive healthcare | Flexible time off | Hybrid work model | Retirement plan | Support for working parentsSenior-level Full TimeM11 - Commers III, 43, 44 … R1d ago
-
Mid-level Full TimeBangalore, KA, IN1d ago
-
EY - GDS Consulting - AIA - Gen AI - Senior INR 2000K-3300KAWS CloudFormation | Amazon Bedrock | Amazon Web Services | Apache Spark | AuthenticationCoaching | Continuous learning | Inclusive cultureSenior-level Full TimeChennai, TN, IN, 6000321d ago
-
Operations Sr. Assistant I INR 2500K-3500KAWS | Azure | Cloud Computing | Computer Vision | Data PipelinesSenior-level Full TimeIND - Ranjangaon - B200A, India1d ago
-
Artificial Intelligence Lead - Airbus India Innovation Centre INR 2500K-4800KAmazon SageMaker | Anomaly Detection | Computer Vision | Data Analysis | Language ModelsFlexible working arrangements | Inclusive work environmentSenior-level Full TimeBangalore (Airbus), India1d ago
-
Software Engineer IV INR 2000K-3000KApache Airflow | Apache Hudi | Apache Iceberg | Apache Spark | AvroMid-level Full TimeIndia - Bangalore-Navigator Bldg1d ago
-
Senior Data Platform Support Engineer -GCP Certified INR 3000K-3500KAirflow | Bash | BigQuery | CI/CD | Cloud ComposerHybrid work modelSenior-level Full TimePune, India R1d ago
-
Senior Software Engineer (Go / Java) INR 2000K-3000KAWS | Apache Airflow | Apache Hive | Apache Spark | AutoscalingContinued Career Development | Employee resource groups | Flexible WFH policy | Generous PTO | Paid volunteer timeSenior-level Full TimeIndia-Bangalore1d ago