Senior Software Engineer - Data (License Team)
Tasks
- Apply machine learning techniques
- Architect data storage models
- Build ETL/ELT workflows
- Build realtime streaming pipelines
- Deploy and operate services on AWS ECS Fargate
- Design data pipelines
- Develop data driven microservices
- Document architecture with Mermaid diagrams
- Enable Databricks and PySpark workflows
- Implement data search capabilities
- Implement observability monitoring alerting
- Implement web scraping pipelines
- Optimize SQL queries performance
- Orchestrate workflows
- Write automated testing and documentation
Perks/Benefits
Skills/Tech-stack
AWS ECS | AWS Fargate | Airflow | CI/CD | DBT | Dagster | Databricks | Flink | Fuzzy Matching | GitOps | HBase | Java | Jenkins | Kafka | Kubernetes | Mermaid | MySQL | NoSQL | Playwright | PostgreSQL | PySpark | Python | React | React JSX | SQL | Scala | Scikit-learn | Semantic Retrieval | Similarity Search | Spark | Spring Batch | Terraform | Vector similarity | Vector similarity search
Education
N/A
Related jobs
-
Associate Process Manager INR 1800K-2800KAgentic AI | Agile methodologies | Causal Inference | Cypher | Experimental DesignMid-level Full TimeMumbai, Maharashtra, India3h ago
-
Partner Engineer, Generative AI INR 2500K-3000KAI infrastructure | AWS | Azure | C plus plus | Cloud platformSenior-level Full TimeBangalore, India | Mumbai, India3h ago
-
Principal Consultant - Data & AI INR 2500K-3200KAI Services | Agile | Apache Kafka | Apache Spark | Artificial IntelligenceSenior-level Full TimeHyderabad, TS, IN; Bengaluru, KA, IN; …3h ago
-
IT Support Specialist 1 (Regional) INR 2000K-2000KAgile | Apache Spark | Azure Data | Azure Data Factory | Azure DevOpsSenior-level Full TimeBengaluru, KA, IN6h ago
-
Executive-level Full TimeIndia6h ago
-
Senior Database Engineer (3+ years, Aurora, Dynamo, Redis) INR 1244K-2200KAmazon Aurora | Amazon Aurora MySQL | Amazon Aurora PostgreSQL | Amazon Web Services | Aurora MySQL24x7 support rotation | Hybrid workSenior-level Full TimeBengaluru, INDIA, India7h ago
-
AI Senior Engineer INR 2520K-4500KAgent Orchestration | Amazon Web Services | Autogen | Azure | Cloud platformSenior-level Full TimePune, MH, IN7h ago
-
Senior-level Full TimePune, Maharashtra, India8h ago
-
Sr. Systems Engineer (3 - 6 years, Kafka, IBM MQ, DevOps, Cloud, Gen AI, Automation) INR 2535K-4000KApache Kafka | KSQLDB | Kafka | Kafka Connect | Kafka StreamsHybrid workSenior-level Full TimeBengaluru, INDIA, India9h ago
-
Mid-level Full TimeBangalore, India; Hyderbad, India9h ago
-
Software Engineer (6months to 2 Years of experience - JAVA/Python Backend, CICD, APIs, GEN AI, Microservices, Cloud) INR 1430K-2000KAgile | Apache Kafka | Automated testing | C++ | CI/CDContinued learning opportunities | MentorshipEntry-level Full TimeBengaluru, INDIA, India10h ago
-
Senior AI Engineer INR 2100K-3380KAuditability | Azure | CI/CD | Cloud Computing | Cloud platformCareer development | Collaborative workspaces | Flexible working arrangements | Learning platform accessSenior-level Full TimeMumbai, MH, India10h ago
-
Teamcenter AI Development Engineer INR 2500K-4225KActive Workspace | BMIDE | ITK | Machine Learning | Manufacturing ProcessSenior-level Full TimePune, MH, India10h ago
-
Lead - Data Platform Engineering INR 2156K-2400KAlerting | Bash | CPU performance | Capacity Planning | Concurrency ControlSenior-level Full TimeChennai, India11h ago
-
Data Engineer INR 1500K-1800KAWS | Amazon Kinesis | Apache Airflow | Apache Beam | Apache FlinkGlobal induction program | Talent development programs | Time off for digital disconnect days | Time off for volunteering | Wellbeing programsMid-level Full TimeBengaluru, KA, India12h ago
-
Convolutional Neural Networks | Deep learning | Generative AI | Google Gemini | LLM PromptsFlexibility programs | Inclusive benefits | Mentorship | Wellbeing supportMid-level Full TimeKolkata DN 57, India14h ago
-
API | Amazon Web Services | Apache Airflow | Apache Hadoop | Azure DataFlexibility programs | Inclusive benefits | MentorshipMid-level Full TimeKolkata DN 57, India14h ago
-
Apache Airflow | Apache Hadoop | Apache Spark | App Service | Azure AppFlexibility programmes | Inclusive benefits | MentorshipSenior-level Full TimeKolkata DN 57, India14h ago
-
Apache Airflow | Apache Spark | Azure Cosmos | Azure Cosmos DB | Azure DataSenior-level Full TimeKolkata DN 57, India14h ago
-
Apache Airflow | Apache Hadoop | Apache Kafka | Apache Spark | App ServiceSenior-level Full TimeKolkata DN 57, India14h ago
-
IN_Manager_Data Analyst_Data and Analytics_Advisory_Bangalore INR 1500K-2000KApache Airflow | Apache Flink | Azure | Azure DevOps | CI/CDMid-level Full TimeBengaluru Millenia, India14h ago
-
API Integration | Agile | Apache Airflow | Apache Hadoop | Apache KafkaFlexibility programs | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeKolkata DN 57, India14h ago
-
Amazon Web Services | Apache Airflow | Apache Databricks | Apache Hadoop | Apache SparkSenior-level Full TimeKolkata DN 57, India14h ago
-
API ingestion | Agile | Apache Airflow | Apache Hadoop | Apache KafkaFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeKolkata DN 57, India14h ago
-
Ab Initio | Apache Airflow | BigQuery | Cloud Storage | Cloud platformFlexible work arrangements | Inclusive workplace culture | MentorshipSenior-level Full TimeBengaluru Millenia, India14h ago