Senior Software Engineer II - Data Engineering and Platform
Tasks
- Architect scalable data solutions
- Build data warehousing and data architecture
- Collaborate cross functionally with product managers and data scientists
- Conduct code and architecture reviews
- Create and maintain infrastructure as code
- Deploy data platform
- Develop CI/CD pipelines
- Develop ETL pipelines
- Ensure data quality, accuracy, and consistency
- Evaluate and recommend emerging data engineering technologies
- Identify performance bottlenecks
- Implement data governance frameworks
- Implement security and compliance procedures
- Lead and mentor data engineering teams
- Lead data platform strategy
- Optimize data platform performance
- Oversee data storage and processing
- Write unit, integration, and end-to-end tests
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Agile | Apache Airflow | Apache Kafka | Apache Spark | CI/CD | Data Catalog | Data Governance | Data Quality | Data Visualization | Data Warehousing | Database Query | Database Query Optimization | Databricks | Distributed Graph Databases | Distributed Systems | ETL | End to End | End-to-End Testing | GitHub Actions | Graph Databases | Infrastructure as Code | Integration Testing | Jenkins | NoSQL | Pulumi | PySpark | Python | Query Optimization | Relational databases | Scala | Terraform | Unit Testing | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Data Engineer I INR 1500K-2000KAWS | Apache Spark | Automated testing | Azure | Azure DataHybrid work | Inclusive work environment | Professional developmentMid-level Full TimeBangalore, Karnataka, IN3h ago
-
Data Engineer I INR 1500K-2000KApache Spark | Automated testing | Azure Data | Azure Data Factory | Azure DatabricksCareer development | Learning opportunitiesMid-level Full TimeBangalore, Karnataka, IN3h ago
-
Data Analyst/ETL Engineer INR 1500K-2500KAWS Glue | BI tools | Data Flows | Data Transformations | ETLMid-level Full TimeChennai, India4h ago
-
Senior AI Engineer INR 2500K-5000KAWS | Azure | BM25 | CI/CD | ContainerizationFlexible work environment | Remote work options | Self-care supportSenior-level Full TimeHyderabad, India5h ago
-
AI/ML Engineer INR 2500K-5000KFastAPI | Flask | Language Models | Language Processing | Large Language ModelsSenior-level Full TimeChennai, India5h ago
-
AI Agents | AWS Bedrock | Azure OpenAI | CI/CD | Claude CodeCareer growth | Continuous learning | Hybrid work | Remote work | Work-life balanceSenior-level Full TimeIndia5h ago
-
AWS | Azure | Cloud platform | Data Analysis | Data ManagementAutonomy | Collaborative team environment | Continuous learning | Exposure to modern machine learning technologies | Flexible work scheduleMid-level Full TimeIndia R5h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Friendly work environmentMid-level Full TimeGurgaon, India6h ago
-
Bash | Data Pipelines | Data Processing | Docker | GCPAsynchronous culture | Competitive salary | Friendly work environment | Remote-friendlyMid-level Full TimeKolkata, India6h ago
-
Software Engineer II, Data Engineer INR 2520K-3880KAWS | Apache Airflow | Apache Spark | Azure | Cloud platformCareer growth | Learning & MentorshipSenior-level Full TimeBangalore, India6h ago
-
Senior Data Engineer - Supply Chain & Analytics Platforms INR 2800K-4200KAWS | Apache Airflow | Azure | CI/CD | Cloud StorageSenior-level Full TimeBengaluru, INDIA, India6h ago
-
AWS Glue | AWS IAM | AWS Lambda | Airflow | Amazon CloudWatchCollaborate with experienced engineering teams | Continuous learning and professional development | Remote work | Work on impactful business intelligence initiatives | Work on large scale cloud data transformation projectsMid-level Full TimeIndia7h ago
-
AI Foundry | AWS | Azure | Azure AI | Azure AI FoundryMid-level Full TimeBengaluru Millenia, India11h ago
-
ADLS Gen2 | AKS | Adaptive Query | Adaptive query execution | Apache SparkFlexibility programmes | Inclusive benefits | Mentorship | Mentorship programs | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India11h ago
-
IN_Sr Associate_ GenAI and Agentic AI_GCC_ Advisory_ Noida INR 2500K-5000KAPI Development | Agent safety | Async Programming | Autogen | CI/CDSenior-level Full TimeNoida, India11h ago
-
IN_Associate_GenAI and Agentic AI_GCC_Advisory_Bangalore INR 2000K-4500KAI/ML | AI/ML Pipelines | Agent systems | Apache Spark | AutogenEntry-level Full TimeBengaluru Millenia, India11h ago
-
Principal Engineer - Data USD 14KAzure Data | Azure Data Factory | Azure Databricks | Azure DevOps | CI/CDCertificate reimbursement | Health benefits | Medical insurance | Professional development | Shift allowanceSenior-level Full TimeGurugram, HR, IN11h ago
-
Azure Data | Azure Data Factory | Azure Databricks | Azure DevOps | CI/CDCertificate reimbursement | Health benefits | Medical insurance | Professional development | Shift allowanceSenior-level Full TimeGurugram, HR, IN11h ago
-
Subcontractor INR 1500K-2500KAWS Cloud | AWS Cloud Services | Access Controls | Cloud services | Data ModelingSenior-level ContractINDIA - PUNE - BIRLASOFT OFFICE …11h ago
-
AI and Machine Learning Engineer INR 2500K-4580KCalculus | Convolutional Neural Networks | Debugging | Decision Trees | Deep learningCareer Development Programs | Flexible work arrangement | Health & wellbeing benefitsSenior-level Full TimeBengaluru, Karnātaka, India11h ago
-
AI and Machine Learning Engineer INR 2500K-4200KAWS | Azure | CI/CD | Data Analysis | Deep learningHealth benefits | Hybrid work flexibility | Professional development programsMid-level Full TimeBengaluru, Karnātaka, India11h ago
-
AI and Machine Learning Engineer INR 2500K-4580KCalculus | Convolutional Neural Networks | Decision Trees | Deep learning | Generative ModelsHealth and wellbeing benefits | Inclusion and diversity | Professional development programsSenior-level Full TimeBengaluru, Karnātaka, India11h ago
-
AWS | Azure Monitor | Bash | Cloud platform | CloudWatch24/7 shift schedule | SLA based support environmentMid-level Full TimeBangalore, KA, IN11h ago
-
Technical Lead INR 1500K-3000KAWS | Algorithms | Continuous Delivery | Continuous integration | Data StructuresSenior-level Full TimeDGS India - Bengaluru - Manyata …11h ago
-
Sr Engineer Data INR 2000K-4200KAWS | AWS Lambda | Agile | CI/CD | Data GovernanceFlexible work environment | Inclusive workplace | Internal mobility | Volunteering support | Well-beingSenior-level Full TimeKA Bangalore, India11h ago