Senior Software Engineer II - Data Engineering and Platform
Tasks
- Architect scalable data solutions
- Build data warehousing and data architecture
- Collaborate cross functionally with product managers and data scientists
- Conduct code and architecture reviews
- Create and maintain infrastructure as code
- Deploy data platform
- Develop CI/CD pipelines
- Develop ETL pipelines
- Ensure data quality, accuracy, and consistency
- Evaluate and recommend emerging data engineering technologies
- Identify performance bottlenecks
- Implement data governance frameworks
- Implement security and compliance procedures
- Lead and mentor data engineering teams
- Lead data platform strategy
- Optimize data platform performance
- Oversee data storage and processing
- Write unit, integration, and end-to-end tests
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Agile | Apache Airflow | Apache Kafka | Apache Spark | CI/CD | Data Catalog | Data Governance | Data Quality | Data Visualization | Data Warehousing | Database Query | Database Query Optimization | Databricks | Distributed Graph Databases | Distributed Systems | ETL | End to End | End-to-End Testing | GitHub Actions | Graph Databases | Infrastructure as Code | Integration Testing | Jenkins | NoSQL | Pulumi | PySpark | Python | Query Optimization | Relational databases | Scala | Terraform | Unit Testing | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Data Engineer, YouTube Business Organization INR 1000K-2000KApache Flume | Apache Spark | Data Governance | Data Lakes | Data ModelingMid-level Full TimeBengaluru, Karnataka, India1h ago
-
Data Engineer 2 INR 1500K-2500KAgile Development | Cassandra | Cloud Computing | Data Catalog | Data GovernanceSenior-level Full TimePune, Maharashtra, India2h ago
-
Senior / Lead Data Engineer - Azure Databricks INR 1500K-3000KAzure Databricks | Azure DevOps | CI/CD | Cloud Security | Conformed DimensionsSenior-level Full TimeHyderabad, TS, India4h ago
-
Apprentice - AI Engineer INR 300K-324KAWS | Anthropic SDK | Azure | Docker | EmbeddingsCareer development | Collaborative team | Exposure to global teams | Holiday allowance | Hybrid work environmentEntry-level Apprenticeship Full TimeWhitefield, Bangalore, India R5h ago
-
Solution Database Engineer INR 1500K-2600KAgile | Azure Data | Azure Data Factory | Azure DevOps | Common table expressionsSenior-level Full TimeBengaluru, KA, India R6h ago
-
Senior-level Full TimeNoida, Uttar Pradesh, India6h ago
-
AI Platform Engineer — Agentic SDLC INR 2000K-5000KAKS | Azure DevOps | Azure OpenAI | CI CD pipeline authoring | CI/CDSenior-level Full TimeBengaluru, KA, India6h ago
-
Lead Associate - SQL Developer INR 800K-1500KAzure Data | Azure Data Factory | BI | Big Data | Data ArchitectureMid-level Full TimePune8h ago
-
Lead Associate - Data Ontology / AI INR 1500K-2800KData Engineering | Data Modeling | Generative AI | Graph Databases | Knowledge graphMid-level Full TimePune8h ago
-
Alerting | Automated testing | Batch Processing | Big Table | Data ArchitectureCollaborative culture | Flexible working approach | Health and wellbeing | Learning opportunities | Meaningful technical impactSenior-level Full TimeIndia R10h ago
-
AWS Bedrock | AWS Lambda | Amazon Redshift | CI/CD | Context OptimizationEmployee recognition incentives | Generous leave | Health insurance | Immigration Support Programs | Professional growth trainingMid-level Contract Full TimeIndia R10h ago
-
AWS | AWS Lambda | Access Control | Access History | Access ManagementAugust Free Fridays | Education support | Employee Well Being Resources | Flexible work options | Leadership development programsSenior-level Full TimeIndia10h ago
-
AWS | Agent Frameworks | Agentic AI | Azure | CI/CDSenior-level Full TimeIndia11h ago
-
Mid-level Full TimeIndia New Delhi (Noida)12h ago
-
Senior Cloud Engineer INR 1500K-4000KAPI Integration | ARM Templates | AWS Glue | AWS Lambda | Access ManagementSenior-level Full TimeIndia New Delhi (Noida)12h ago
-
Tech Consultant - AI & Machine Learning INR 2520K-4000KAzure | Azure Kubernetes | Azure Kubernetes Service | Azure Machine Learning | CI/CDSenior-level Full TimeNoida, UP, IN R12h ago
-
FBS Associate Analytics Engineer INR 1000K-2000KAWS | Apache Airflow | Azure | Cloud platform | DBTCareer development | Flexible work arrangements | Paid time off | Pension plan | Private health insuranceMid-level Full TimeHyderabad, Telangana, India R12h ago
-
API | AWS CloudFormation | AWS CloudTrail | AWS Glue | AWS Glue Data CatalogCareer development opportunities | Coaching and feedback | Flexible work approachSenior-level Full TimeHyderabad, TG, IN, 50008112h ago
-
EY - GDS Consulting - AI And DATA -AWS Data Engineer - Manager INR 2000K-2700KAPI Integration | AWS CloudTrail | AWS Glue | AWS Glue Data Catalog | AWS IAMCareer development opportunities | Coaching and feedback | Flexible work approach | Supportive and inclusive work cultureMid-level Full TimeHyderabad, TG, IN, 50008112h ago
-
APIs | Access Control | Amazon Neptune | CI/CD | Conceptual data modelingSenior-level Full TimeHyderabad, TG, IN, 50008112h ago
-
EY - GDS Consulting - AI And DATA -AI Data Platform Engineer - AI Data Platform Engineer - MS Fabric INR 2771K-5000KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageCareer development | Coaching | Flexible working hoursSenior-level Full TimeHyderabad, TG, IN, 50008112h ago
-
Senior Lead AI Engineer INR 2500K-4680KAPI Development | Artificial Intelligence | Auditability | Azure | Azure DevOpsSenior-level Full TimeMumbai Central Avenue, India12h ago
-
Data Engineer INR 1500K-2100KAgile | BigQuery | Data Delivery | Data Modeling | Data PipelinesGlobal team collaboration | Open communication | Travel opportunitiesMid-level Full TimeTvh Pune, India12h ago
-
Data Engineer INR 1500K-2500KCloud Data | Cloud Data Platforms | Data Pipelines | Data Processing | Data QualitySenior-level Full TimeBengaluru, BDC6F, India12h ago
-
Data Engineer INR 1500K-2500KAWS Machine Learning | Amazon Web Services | Data analytics | ETL | Machine LearningSenior-level Full TimeGurugram, DDC1A, India12h ago