Senior Software Engineer II - Data Engineering and Platform
Tasks
- Architect scalable data solutions
- Build ETL pipelines
- Conduct architecture reviews
- Conduct code reviews
- Deliver data to downstream systems
- Design data architecture
- Develop CI/CD pipelines
- Develop data warehousing
- Diagnose performance bottlenecks
- Enhance scalability reliability
- Ensure data security and compliance
- Evaluate new data engineering tools
- Implement data catalog
- Implement data governance and quality
- Lead data platform strategy
- Lead engineering mentorship
- Manage data systems
- Mentor data engineering teams
- Optimize platform performance
- Write end-to-end tests
- Write integration tests
- Write unit tests
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Agile | Apache Airflow | Apache Kafka | Apache Spark | CI/CD | Data Governance | Data Quality | Data Security | Data Visualization | End to End | End-to-End Testing | GitHub Actions | Infrastructure as Code | Integration Testing | Jenkins | NoSQL Databases | Pulumi | PySpark | Python | Relational databases | SQL | Scala | Terraform | Unit Testing | “as-code”
Education
Related jobs
-
Senior-level Full TimeBangalore, Karnataka, IN, 5601007h ago
-
Agile | Analysis Services | Azure Analysis | Azure Analysis Services | Azure DataHybrid work flexibility | Virtual work optionMid-level Full TimeGurgaon - Cyber Park, India14h ago
-
Quantitative Data Engineer INR 2400K-3500KAirflow | Dagster | Django | FastAPI | MultiprocessingDirect mentorship | Free meals | Free parking | Recreational gamesMid-level Full TimeBengaluru, Karnataka, India14h ago
-
Senior Machine Learning Founding Engineer INR 3000K-4000KAWS | ArcGIS | Data Pipelines | Docker | GeopandasFlexible long distance work | Free drinks | Free snacks | Remote workSenior-level Full TimeBangalore, India20h ago
-
Mid-level Full TimeHyderabad, IND-TG, India21h ago
-
Mid-level Full TimeHyderabad, IND-TG, India21h ago
-
Engineer - Digital & AI Solutions INR 346K-346KAWS | Azure | Big Data | Cloud platform | Computer VisionHybrid working | Inclusive culture | Learning and development programmesEntry-level Full TimeHyderabad, Telangana, India22h ago
-
AWS Glue | Amazon Redshift | Amazon S3 | Amazon Web Services | Apache AirflowCareer growth opportunities | Collaborative learning driven team culture | Flexible work environment | High ownership and autonomy | Remote-friendly work environmentSenior-level Full TimeIndia22h ago
-
Data & Analytics Engineer INR 1500K-2040KAutomated testing | CI/CD | CTE | Clustering | Common table expressionsChildcare reimbursement | Company-Paid Holidays | Flexible work schedule | Gratuity | Group term life insuranceMid-level Full TimeBengaluru23h ago
-
Senior Data Engineer INR 2516K-3356KAWS | Athena | CI/CD | DBT | DatabricksBonus opportunities | Employee well-being programs | Paid Holidays | Paid time off | Work-life balance programsSenior-level Full TimeRemote - India R23h ago
-
Incident Engineer INR 2156K-3500KAWS | Alerting | Application Programming | Application Programming Interfaces | Cause analysisSenior-level Full TimeGurugram1d ago
-
Senior-level Full TimePune City, India1d ago
-
Senior-level Full TimePune, Maharashtra, India1d ago
-
Data Engineer - Python AWS Databricks INR 1200K-2000KAWS | Agentic AI | Amazon Web Services | Cost Optimization | Data ArchitectureSenior-level Full TimeIN-MH-Pune1d ago
-
Senior Data Engineer INR 2000K-2400KAWS Glue | Amazon Redshift | Amazon S3 | Apache Airflow | Apache SparkSenior-level Full TimeHyderabad, Hyderabad, IN1d ago
-
Practice Customer Engineer, Data Analytics INR 1200K-2000KApache Spark | Batch Processing | C++ | Cloud platform | DNSSenior-level Full TimeBengaluru, Karnataka, India; Mumbai, Maharashtra, India1d ago
-
Practice Customer Engineer, Data Analytics INR 1200K-2000KApache Spark | C++ | DMZ | DNS | Data LakeEqual opportunity work environment | Travel as requiredSenior-level Full TimeMumbai, Maharashtra, India; Bengaluru, Karnataka, India1d ago
-
Data Engineer - SDE 1 INR 2000K-2755KAWS | Amazon EKS | Amazon MSK | Amazon S3 | Apache AirflowAccess to latest gadgets and tools | Birthday leave | Car Leasing | Comprehensive health insurance | Device leasingEntry-level Full TimeBengaluru1d ago
-
Senior-level Full Timebengaluru, India1d ago
-
Senior AI Engineer / GenAI INR 2000K-3000KAutomatic Speech Recognition | Bias Mitigation | Data Processing | Entity recognition | Fine TuningMid-level Full TimeHyderabad, Telangana, India1d ago
-
Consultant - Python Developer with Gen AI INR 1500K-2000KAI Search | Agile | Azure OpenAI | CSS | DjangoMid-level Full TimeBangalore, Karnataka, India1d ago
-
Assistant Manager- AI Engineer with Cloude INR 2000K-3000KAWS | Autogen | Azure | Claude | Cloud platformLeadership opportunity | MentorshipMid-level Full TimeBangalore, Karnataka, India1d ago
-
AWS Data Engineer- Assistant Manager INR 1200K-2000KAWS Data | AWS Data Pipeline | AWS Glue | AWS Kinesis | AWS Lake FormationSenior-level Full TimeBangalore, Karnataka, India1d ago
-
GCP & Databricks Manager INR 1500K-2000KApache Spark | BigQuery | Bitbucket | Cloud Composer | Cloud DataflowMid-level Full TimeBangalore, Karnataka, India1d ago
-
Senior-level Full TimeHyderabad1d ago