Staff Software Development Engineer - Data Platforms
Tasks
- Architect data platform services
- Build data pipelines for AI Agents
- Build real-time data pipelines
- Collaborate cross-functionally
- Design data pipelines for AI model training
- Ensure data quality monitoring and alerting
- Govern data assets and audit data posture
- Improve data systems using engineering standards
- Ingest events from Apache Kafka
- Maintain monitoring alerting and operational procedures
- Maintain technical documentation and architecture diagrams
- Optimize ingestion storage and processing costs
- Own development lifecycle from ideation to deployment
- Provide data to stakeholders
- Provide technical mentorship to engineers
- Reduce time to insight
- Support business decisions with data insights
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS Glue | Amazon DynamoDB | Amazon EMR | Amazon Kinesis | Amazon Redshift | Amazon S3 | Apache Airflow | Apache Cassandra | Apache Flink | Apache Kafka | Apache Spark | Data Vault | Delta Lake | Dimensional Modeling | Go | Google BigQuery | Java | Kimball Method | MySQL | PostgreSQL | Python | SQL | Scala | Snowflake
Education
N/A
Related jobs
-
Senior PostgreSQL DBA / Database Platform Engineer INR 1500K-3440KAWS | Ansible | Automation | Azure | Azure MonitorSenior-level Full TimeChennai, IN3h ago
-
Senior-level Full TimeBengaluru, Karnataka, India6h ago
-
AI/ML Developer INR 1000K-1250KArtificial Intelligence | Batch Processing | Data Science | Distributed Computing | LLMMid-level Full TimeBangalore, KA, IN12h ago
-
Sr Developer, MLOPs INR 2229K-3500KAngular | CI/CD | Distributed Systems | Docker | FeastHybrid work schedule | In-person office days | Virtual workSenior-level Full TimeBengaluru, India12h ago
-
Associate Software Engineer- (Python) INR 800K-1200KAzure Data | Azure Data Factory | Azure Data Lake | Azure Databricks | Beautiful SoupInnovation | Integrity | Ownership | Remote work flexibility | Work-life balanceMid-level Full TimeBengaluru, Karnataka, India; Pune, Maharashtra, India17h ago
-
Software Engineer- (Python) INR 800K-1200KAlgorithms | Azure Data | Azure Data Factory | Azure Data Lake | Azure DatabricksLearning and teaching culture | Remote-friendly work | Work-life balance supportMid-level Full TimeBengaluru, Karnataka, India; Pune, Maharashtra, India17h ago
-
Senior-level Full TimeHyderabad, IND-TG, India18h ago
-
Applied AI ML Lead INR 2475K-3465KApache Hive | Apache Spark | Keras | Language Processing | Machine LearningSenior-level Full TimeBengaluru, Karnataka, India23h ago
-
Lead Backend Engineer (MongoDB / NoSQL) INR 1600K-4000KAWS | Agile | Azure | CI/CD | Distributed SystemsSenior-level Full TimeIN-TN-Chennai23h ago
-
Senior-level Full TimeIN-TN-Chennai23h ago
-
Senior-level Full TimeIN-TN-Chennai23h ago
-
Data Engineer - Analysis & Insights INR 2000K-2500KAgile | Alteryx | Ascend | AtScale | Cloud platformMid-level Full TimeHyderabad, India1d ago
-
AES - DE -JAVA - Generative AI Application Developers INR 2535K-4000KAWS | Agile | Azure | CI/CD | DockerSenior-level Full TimeBangalore, Karnataka, India1d ago
-
Mid-level Full TimePune, Maharashtra, India1d ago
-
Senior-level Full TimeBengaluru, KA, India1d ago
-
BIOS | Block layer | C# | C++ | Distributed SystemsSenior-level Full TimeBengaluru, KA, India1d ago
-
Software Developer Lead (AWS, Java/Python) INR 2695K-4000KAWS | AWS CloudFormation | Amazon S3 | Amazon SNS | Amazon SQSSenior-level Full TimeHyderabad, India1d ago
-
Mid-level Full TimeGurgaon, Haryana, India1d ago
-
Technical Lead, AI Initiatives - India INR 2500K-4500KA/B | A/B Testing | APIs | AWS | Agent evaluationHybrid work options | Remote work flexibilitySenior-level Full TimeIndia R1d ago
-
Lead AI Engineer #3008 INR 2500K-4500KAgent Orchestration | Azure | Deepgram | Fine Tuning | LLM ObservabilityFlexible working hours | Global exposure | Professional development | Rewards and recognition | Work-life balanceSenior-level Full TimeChennai, India1d ago
-
Analytics Solution- Associate INR 2040K-2755KAgile | Atlassian | Atoti | Change Data Capture | Continuous DeploymentSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Applied AI ML Associate Senior INR 1400K-2000KAgentic Frameworks | Amazon Web Services | Apache Airflow | Architectures | AzureMid-level Full TimeMumbai, Maharashtra, India1d ago
-
AI/ML Engineer (Associate) INR 900K-900KAWS SageMaker | Azure AI | C++ | Cloud platform | Computer VisionEntry-level Full Timecoimbatore, India1d ago
-
ROP - SE2/SSE - Azure Data INR 1500K-2400KApache Hadoop | Apache Kafka | Apache Spark | Azure | Azure ComputeOn-call rotationMid-level Full TimeBengaluru, KA, IN1d ago
-
A/B | A/B Testing | AWS | Apache Spark | AzureCompany laptop | Fully remote | Home office stipend | Learning and development budget | Paid Maternity LeaveSenior-level Full TimeIndia R1d ago