Senior Software Engineer, Data Platform
Tasks
- Build pipeline infrastructure
- Build scalable data transformation pipelines
- Collaborate with engineering and analytics teams to deliver data solutions
- Create self-service capabilities
- Design scalable data ingestion pipelines
- Design storage and compute components
- Develop AI agents for monitoring troubleshooting and triage
- Develop monitoring and alerting automation
- Develop onboarding solutions for new data sources
- Diagnose and resolve production issues
- Drive post-incident improvements
- Evolve data platform capabilities
- Implement long term systemic improvements
- Manage data integrations
- Manage incident resolution
- Measure data quality
- Operate real time and batch data workflows
Perks/Benefits
- Career development
- Continuous learning
- Flexible, remote work culture
- Inclusive work environment
- Remote work
- Technical growth
Skills/Tech-stack
Apache Airflow | Apache Flink | Apache Hudi | Apache Iceberg | Apache Kafka | Apache Pinot | Apache Spark | Batch data | CDC | DBT | Data Quality | Debezium | Delta Lake | Distributed Systems | Fault Tolerance | LLM Agents | Python | Real Time | Real-time Data | SQL | Snowflake | Spark Structured Streaming | Structured Streaming | Workflow Orchestration
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Airflow | Batch data | Batch data pipelines | DBT | DagsterCareer advancement opportunities | Continuous growth opportunities | Health and wellbeing benefits | Remote work flexibility | Supportive workplace cultureSenior-level Full TimeIndia7h ago
-
AI Model Routing | AI model | AI platforms | AWS | Audit LoggingCareer development | Collaborative culture | Generous time off | Mental health support | Remote-firstSenior-level Full TimeIndia7h ago
-
AI Search | App Service | Azure AI | Azure AI Search | Azure AppContinuous learning | Professional growth opportunities | Remote workMid-level Full TimeIndia7h ago
-
Entry-level Full TimeBengaluru, Karnataka, India12h ago
-
Agent systems | Agentic AI | Autonomous Agents | C++ | Data analyticsHealth and wellness benefitsSenior-level Full TimeBengaluru, India17h ago
-
Embedded Memory Circuit Design Engineer INR 2500K-4460KAmplifier design | Bitcell Design | CMOS | Circuit simulation | Corner analysisHealth and wellness benefitsSenior-level Full TimeNoida, India17h ago
-
Algorithm Development | Analysis tools | C# | C++ | Constraint managementSenior-level Full TimeBengaluru, India17h ago
-
Algorithm Development | C# | C++ | CAD | Constraint managementSenior-level Full TimeBengaluru, India17h ago
-
Principal AI Engineer with Java INR 2500K-4580KAI Services | Agent Framework | Agent evaluation | Agentic AI | AlembicEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India18h ago
-
Senior-level Full TimeIN-TN-Chennai18h ago
-
Senior-level Full TimeIN-AP-Hyderabad19h ago
-
ETL Data Engineer INR 1500K-2500KAdvanced SQL | Amazon Kinesis | Apache Hudi | Apache Iceberg | Apache SparkMid-level Full TimeIN-TN-Chennai19h ago
-
Software Engineer II INR 1500K-2500KAWS Glue | AWS Lambda | Amazon Redshift | Amazon S3 | Amazon Web ServicesMid-level Full TimeHyderabad, Telangana, India19h ago
-
Batch Processing | CI/CD | Cloud Data | Cloud Data Engineering | Data ComplianceSenior-level Full TimePune, Maharashtra, India20h ago
-
AWS | Agentic Frameworks | Azure | Cloud Platforms | Data ExplorationMid-level Full TimeBengaluru, Karnataka, India20h ago
-
Senior System Administrator II [Storage Engineer] INR 1000K-1800KAWS EBS | AWS S3 | Ansible | Ceph | ClusteringMid-level Full TimeBengaluru20h ago
-
Senior Software Engineer, BigQuery INR 2000K-2500KBig Data | BigQuery | C++ | Cloud Computing | Data WarehouseSenior-level Full TimePune, Maharashtra, India20h ago
-
Software Engineer III, AI/ML, Google Cloud INR 2500K-5000KC++ | Computer Vision | Data Structures | Data Structures and Algorithms | LLMSenior-level Full TimeBengaluru, Karnataka, India20h ago
-
AKS | AWS | ArangoDB | Authentication | AzureFully remoteMid-level Full TimeIndia R20h ago
-
DE&A - Core - Cloud Data Engineering - Databricks INR 3000K-4000KAgile | Cloud Computing | Data Modeling | Data Pipelines | Data ValidationSenior-level Full TimeBangalore, Karnataka, India21h ago
-
Mid-level Full TimeIndia, Telangana, Hyderabad; India, Karnataka, Bangalore; …21h ago
-
Data Engineer (GCH) - Replacement INR 1500K-2500KAPIs | AWS | Bash | Best practices | Business ProcessMid-level Full TimeIndia21h ago
-
AWS | AWS Lambda | AWS Secrets | AWS Secrets Manager | AgileSenior-level Full TimeMumbai, Maharashtra, India22h ago
-
Platform Software Engineer INR 1600K-2500KAPIs | Agile | Apache Airflow | Apache Spark | Automated testingMid-level Full TimeChennai, Tamil Nadu, India22h ago
-
Applied AI/ML Associate Senior INR 1400K-2500KArtificial Intelligence | Data Analysis | Data Wrangling | Hive | KerasCoaching opportunities | Strategic project impactMid-level Full TimeBengaluru, Karnataka, India22h ago