Lead Software Engineer
Tasks
- Build cloud features for asset management
- Debug and resolve complex issues
- Design architecture and modules
- Design scalable big data pipelines
- Develop data lake solutions
- Develop scalable microservices platform
- Guide and mentor engineers
- Implement secure big data clusters
- Integrate Trino with lakehouse storage
- Integrate distributed SQL analytics using Trino
- Lead performance benchmarking testing
- Maintain engineering best practices and lifecycle
- Optimize Trino query performance
- Own delivery design development operations support
- Support machine learning model engineering and deployment
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Algorithms | Apache Spark | Big Data | CI/CD | Cassandra | Data Lakes | Data Streaming | Data Structures | Distributed SQL | Docker | Docker Swarm | Flink | Hadoop | Hive | Iceberg | Java | Jenkins | Kafka | Kafka Streams | Kappa Architecture | Kubernetes | Lambda Architecture | Machine Learning | Microservices | NoSQL | Object-Oriented | Object-oriented design | Oracle | Parquet | Performance Benchmarking | Presto SQL | Profiling | RDBMS | Redis | Rule engines | SQL | Secure infrastructure | Spring Boot | Testing | Trino
Related jobs
-
CI/CD | DBT | Data Analysis | Data Modeling | Data NormalizationCharity contribution match | Corporate Volunteering Hours | Dental insurance | Employee discounts | Medical insuranceMid-level Full TimeBengaluru, KA, IN4h ago
-
Senior Data Engineer INR 2000K-3000KAI integrations | API Integration | Automation workflows | Azure Data | Azure Data FactoryClient-facing work | Fast-paced environment | Independent ownershipSenior-level Full TimeBangalore North, India6h ago
-
Data Science INR 2000K-3300KAgentic AI | Apache Airflow | CrewAI | Data Architecture | Data PipelinesSenior-level Full TimeIN-MH-Pune6h ago
-
Data Engineer with Airflow INR 1500K-2400KAmazon Web Services | Apache Airflow | Data Visualization | Data Warehousing | DockerSenior-level Full TimeIN-AP-Hyderabad6h ago
-
Data Engineer- Airflow INR 1500K-2500KAmazon Web Services | Apache Airflow | Data Visualization | Data Warehousing | DockerSenior-level Full TimeIN-AP-Hyderabad6h ago
-
Data Engineer- Airflow INR 1500K-2500KAmazon Web Services | Apache Airflow | Data Visualization | Data Warehousing | DockerSenior-level Full TimeIN-AP-Hyderabad6h ago
-
Data Engineer INR 1400K-1800KAnomaly Detection | Apache Spark | Azure DevOps | Azure DevOps Pipelines | CDCHybrid work modelSenior-level Full TimeMumbai, Maharashtra, India7h ago
-
Gen AI Engineer INR 2500K-4800KAWS Textract | Generative AI | Langchain | Language Models | Large Language ModelsSenior-level Full TimeBengaluru, Karnataka, India7h ago
-
Software Engineer Manager II, Embedded Systems/Firmware, Silicon INR 2800K-4500KC++ | Compiler optimization | Embedded operating systems | Graphics Processing | Graphics Processing UnitsSenior-level Full TimeBengaluru, Karnataka, India8h ago
-
DevOps Engineer INR 1500K-2500KAgile | Amazon Web Services | BI dashboarding | CI/CD | Cloud platformInternational collaboration | Occasional travel to EuropeMid-level Full TimePune, MH, India8h ago
-
AI Engineer – Retail/CPG Domain INR 1500K-2500KAWS | Azure | Cloud platform | Data Governance | Data ModelingMid-level Full TimeGurugram, Haryana, India8h ago
-
REF82383U - Data science (ML Algorithms, unsupervised techniques, Databricks, Python, PySpark, Azure,AB testing ) 3- 6 yrs exp INR 1500K-2040KA/B | A/B Testing | B testing | Databricks | Machine LearningSenior-level Full TimeBangalore, KA, India8h ago
-
Specialist - Data Engineering-Data Engineering INR 180K-200KAWS | Apache Kafka | Apache Spark | Data Modeling | Data QualityEntry-level Full TimeMumbai, Maharashtra, India8h ago
-
Senior-level Full TimeGurugram, Haryana, India9h ago
-
API Development | AWS | Azure | Cloud platform | Google CloudCharity contribution match | Corporate Volunteering Hours | Dental insurance | Discounts on tickets and travel | Medical insuranceMid-level Full TimeBengaluru, KA, IN11h ago
-
Associate 2 - Engineer (AI Hub - GDC) INR 1800K-2500KCNN | Decision Tree | Deep learning | Huggingface | LSTMMentoring | Work reviewMid-level Full TimeHyderabad, Telangana, India11h ago
-
Executive-level Full TimeHyderabad, Telangana, India11h ago
-
Sr. Staff Engineer (Python,Pyspark,AWS) INR 2800K-4000KAI Agents | API Gateway | AWS | Apache Spark | BedrockEmployee volunteering | Family wellbeing benefits | Health insurance | Paid time off | Wellbeing programsSenior-level Full TimeHyderabad, India12h ago
-
Senior-level Full TimeIndia - Bengaluru; India - Hyderabad12h ago
-
GCP Data Engineer INR 2000K-3000KApache Airflow | Apache Spark | BigQuery | Cloud Composer | Cloud DataflowSenior-level Full TimeIndia - Bengaluru; India - Hyderabad12h ago
-
AWS | Agentic AI | Apache Spark | Databricks | Generative AICollaborative global engineering culture | Continuous learning | Flexible work environment | Opportunity to work on cutting edge GenAI | Remote-friendly work environmentSenior-level Full TimeIndia13h ago
-
Senior Data Engineer INR 3000K-4200KAWS | Access Management | Amazon Neptune | Apache Airflow | Apache KafkaCareer advancement | Hybrid work options | Professional development programs | Remote work options | Training programsSenior-level Full TimeBengaluru13h ago
-
Data Engineer INR 1500K-2000KAWS Glue | Access Control | Amazon EMR | Amazon Snowflake | Apache AirflowMid-level Full TimeIndia13h ago
-
API | Agile | Apache Airflow | Bitbucket | CI/CDEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, India13h ago
-
Data Analytics & Data Engineering Vice President INR 2000K-5800KAccess Control | Agile | Alteryx | Cloud Computing | ConfluenceExecutive-level Full TimeIndia14h ago