Senior Software Engineer, Data Platform
Tasks
- Automate self-service workflows
- Build AI powered engineering agents
- Build data ingestion pipelines
- Build data transformation pipelines
- Design data platform components
- Develop data monitoring tooling
- Develop data quality measurement tooling
- Diagnose production issues
- Evolve existing integrations
- Implement batch and real-time processing
- Onboard new data sources
- Participate in on-call rotation
- Resolve incidents end-to-end
Perks/Benefits
Skills/Tech-stack
Apache Airflow | Apache Iceberg | Apache Kafka | Apache Pinot | Apache Spark | Batch Data Processing | Batch data | CDC | DBT | Data Monitoring | Data Processing | Data Quality | Data Transformation | Debezium | Delta Lake | Distributed Systems | Fault Tolerance | Flink | LLM | LLM Agents | Langchain | Python | Real Time | Real-time Data | Real-time Data Processing | SQL | Snowflake | Spark Structured Streaming | Structured Streaming | Workflow Orchestration
Education
Related jobs
-
Junior Software Engineer INR 480K-800KAzure Data | Azure Data Factory | Azure Data Lake | Azure Synapse | Azure Synapse AnalyticsClient facing communication experience | Night shift rotation | Remote workEntry-level Full TimeHyderabad/Remote, India R3h ago
-
Senior Principal Data Engineer INR 3715K-5876KAWS | Airflow | Amazon Athena | Amazon EMR | Amazon RedshiftHealth and wellbeing resources | Paid volunteer daysSenior-level Full TimeBengaluru - India - Bengaluru, 560071 … R17h ago
-
Machine Learning Engineer 4 INR 3584K-5400KAWS | BERT | Computer Vision | Deep learning | Distributed ComputingSenior-level Full TimeNoida, India R17h ago
-
Senior Data Engineer INR 3600K-4995KAmazon Redshift | Amazon Web Services | Apache Airflow | Batch Processing | DBTSenior-level Full TimeIndia R22h ago
-
Manager Data and Analytics INR 1400K-2000KAmazon Redshift | Azure | BigQuery | Business Intelligence | Cloud platformMid-level Full TimeBangalore, Karnataka, India R3d ago
-
Senior Machine Learning (ML) Ops Engineer INR 3715K-5449KAWS | Airflow | Amazon SageMaker | Azure | CI/CDEquity compensation | Fully remote | Global & diverse team | Innovation culture | Part-timeSenior-level Full TimeMumbai, Maharashtra, India R3d ago
-
Knowledge Graph, Graph DB, Python/Senior Consultant Specialist INR 3000K-4200KAgile | Amazon Neptune | Data Governance | Data Lineage | Data ModelingContinuous professional development | Flexible working | Inclusive work environmentSenior-level Full TimeHyderabad, Telangana, India R3d ago
-
GCP, Bigquery, Airflow/Consultant Specialist INR 1500K-2500KAgile | Apache Airflow | Apache Hadoop | Apache Kafka | Apache NiFiContinuous professional development | Flexible working | Inclusive work environment | Opportunity for growthSenior-level Full TimeHyderabad, Telangana, India R3d ago
-
Assistant Director,Data and Analytics INR 3000K-5199KAnomaly Detection | Azure | Cloud platform | Data Visualization | Fraud analyticsExecutive-level Full TimeBangalore, Karnataka, India R3d ago
-
AI Engineer - FDE (Forward Deployed Engineer) INR 2400K-3900KAWS | Agent systems | Apache Spark | Azure | Deep learningConference participation | Remote work | Travel as neededSenior-level Full TimeRemote - India R3d ago
-
API Development | Access Control | Artificial Intelligence | Automation | CI/CDCareer growth | Fully remote work | Paid time off | Professional developmentMid-level Full TimeIndia R3d ago
-
.NET | Application Architecture | C# | Concurrency | Data BindingDisability programs | Flexible working hours | Life insurance | Private medical care | Remote workSenior-level Full TimeIN-KA-BANGALORE-NEON BUILDING WEST TOWER, India R3d ago
-
Senior Data Platform Support Engineer -GCP Certified INR 2771K-4064KAirflow | Artifact Registry | Bash | BigQuery | CI/CDHybrid work model | On-call rotaSenior-level Full TimePune, India R3d ago
-
Staff Software Engineer - (Identity & Data Engineering Focus) INR 3000K-4000KAPI Gateway | AWS API | AWS API Gateway | AWS Cognito | AWS Cognito TriggersSenior-level Full TimeIndia - Pune - Hybrid R3d ago
-
Staff Software Engineer, Data (Employer of Record) INR 3715K-5449KAWS | AWS Glue | AWS Lambda | Acceptance criteria | AgileCollaborative team | Continuous learning | Remote work | Workplace recognitionSenior-level Full TimeIndia - Field R3d ago
-
Machine Learning Engineer INR 3200K-5000KAPI Development | Autogen | CI/CD | Caching | ClassificationMentorship opportunitiesMid-level Full TimeBangalore offsite, India R3d ago
-
Senior-level Full TimeIndia - Remote R3d ago
-
Machine Learning Engineer INR 4408K-4408KAWS Bedrock | Deep learning | Google ADK | Information Retrieval | LLM orchestrationRemote first quarterly surgesMid-level Full TimeRemote - India R4d ago
-
Specialist Cloud Database Engineer (SQL, DevOps, AWS) INR 2156K-2500KAlwaysOn Availability | AlwaysOn availability groups | Amazon Aurora | Amazon CloudFormation | Amazon RDSHybrid work model | Office collaboration days | Remote work flexibilitySenior-level Full TimeIndia - Pune R4d ago
-
Principal AI-ML Engineer INR 3264K-5876KAgentic AI | Amazon Web Services | Apache Airflow | Artificial Intelligence | AzureSenior-level Full TimeBengaluru East, Karnataka, India R4d ago
-
Senior Data Engineer INR 3740K-5876KApache Spark | Azure Data | Azure Data Services | CI/CD | ClickHouseFully remote | Health benefits | Paid time off | Wellbeing benefitsSenior-level Full TimeIndia R4d ago
-
AWS | Alteryx | Amazon Redshift | Azure Synapse | Azure Synapse AnalyticsContinuous learning opportunities | Fully remote work | Professional growthSenior-level Full TimeIndia R4d ago
-
Apache Kafka | Apache Spark | Batch Processing | BigQuery | Cloud DataFully remote work opportunity | International team collaboration | Regular training and professional development opportunitiesSenior-level Full TimeIndia R4d ago
-
Apache Hadoop | Apache Spark | Azure Blob | Azure Blob Storage | Azure DataMid-level Full TimeHyderabad, Telangana, India - Remote R4d ago
-
Sr Computer Scientist 2 INR 3470K-4680KAWS | Apache Kafka | Apache Spark | Apache Storm | ElasticsearchSenior-level Full TimeNoida, India R4d ago